Does zillow.com block AI crawlers?

Can AI assistants cite zillow.com?

• ChatGPT search: its search crawlers may read the site
• Claude: its search crawlers may read the site
• Perplexity: its search crawlers may read the site

zillow.com opts out of AI training by Apple, Meta. Training crawlers and answer crawlers are separate: blocking training doesn't by itself remove a site from AI answers.

AI crawler access, bot by bot

How zillow.com compares

• 19% of the 1,278 popular sites we checked block GPTBot; zillow.com does not.
• 18% of the 1,278 popular sites we checked block ClaudeBot; zillow.com does not.
• 14% of the 1,278 popular sites we checked block PerplexityBot; zillow.com does not.
• Among 197 sites of similar popularity, 28% block at least one AI crawler.

The robots.txt rules that apply to AI crawlers

User-agent: *
Allow: /homes/for_sale/$
Allow: /homes/for_sale/fore_lt/$
Allow: /homes/fsbo/$
Allow: /homes/for_sale/1_open/$
Allow: /homes/new_homes/$
Allow: /homes/coming_soon/$
Allow: /homes/for_rent/$
Allow: /homes/for_rent/condo,apartment_duplex_type/$
Allow: /homes/for_rent/house,townhouse_type/$
Allow: /homes/recently_sold/$
Allow: /homes/apartment-communities/$
Allow: /homes/for_sale/*_p/$
Allow: /homes/for_sale/fore_lt/*_p/$
Allow: /homes/fsbo/*_p/$
Allow: /homes/for_sale/1_open/*_p/$
Allow: /homes/new_homes/*_p/$
Allow: /homes/coming_soon/*_p/$
Allow: /homes/for_rent/*_p/$
Allow: /homes/for_rent/condo,apartment_duplex_type/*_p/$
Allow: /homes/for_rent/house,townhouse_type/*_p/$
Allow: /homes/recently_sold/*_p/$
Allow: /homes/apartment-communities/*_p/$
Allow: /homes/apartments-pet-friendly/$
Allow: /homes/apartments-1-bedrooms/$
Allow: /homes/apartments-2-bedrooms/$
Allow: /homes/apartments-under-1500/$
Allow: /homes/apartments-under-2000/$
Allow: /homes/apartments-3-bedrooms/$
Allow: /homes/pet-friendly/$
Allow: /homes/rooms-for-rent/$
Allow: /homes/apartments-with-washer-dryer/$
Allow: /homes/apartments-pet-friendly/*_p/$
Allow: /homes/apartments-1-bedrooms/*_p/$
Allow: /homes/apartments-2-bedrooms/*_p/$
Allow: /homes/apartments-under-1500/*_p/$
Allow: /homes/apartments-under-2000/*_p/$
Allow: /homes/apartments-3-bedrooms/*_p/$
Allow: /homes/pet-friendly/*_p/$
Allow: /homes/rooms-for-rent/*_p/$
Allow: /homes/apartments-with-washer-dryer/*_p/$

User-agent: YouBot
User-agent: YandexAdditional
User-agent: YandexAdditionalBot
User-agent: Applebot-Extended
User-agent: Amazonbot
User-agent: amazon-kendra
User-agent: AI2Bot
User-agent: AI2Bot-DeepResearchEval
User-agent: Ai2Bot-Dolma
User-agent: meta-externalagent
User-agent: Meta-ExternalAgent
Allow: /agent-resources/
Allow: /blog/
Allow: /data-science/
Allow: /digs/guides/
Allow: /engineering/
Allow: /foreclosures/
Allow: /home-buying-guide/
Allow: /info/
Allow: /lender-resources/
Allow: /marketing/
Allow: /mortgage-learning/
Allow: /multifamily-knowledge-center/
Allow: /promo/
Allow: /public-engagement/
Allow: /rent/guide/
Allow: /rental-manager/resources/
Allow: /resources/
Allow: /research/
Allow: /sellers-guide/
Allow: /tech/
Allow: /video/
Allow: /z/
Disallow: /

Excerpt: only groups for all user-agents (*) or named AI crawlers, up to 40 rules per group.

Sites with a similar AI policy

• ted.com · 7 blocked
• moloco.com · 1 blocked
• airbnb.com · 3 blocked
• bandcamp.com · 6 blocked
• academia.edu · 7 blocked
• cbsnews.com · 1 blocked
• figma.com · 5 blocked
• hbr.org · 3 blocked

All sites that are “blocks ai training, allows ai answers” →