zillow.com: what it tells AI crawlers

On 27 October 2026, zillow.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel
top 1k (Tranco)
robots.txt
ok (HTTP 200) · https://www.zillow.com/robots.txt
unchanged since 2026-10-26 · sha256 48aa7b503b17187c… · view as recorded
The * group
allows applies to every agent without its own group

Per AI bot, 2026-10-27

User agentVerdictHow
GPTBotallowsthrough the * group
OAI-SearchBotallowsthrough the * group
ChatGPT-Userallowsthrough the * group
ClaudeBotallowsthrough the * group
Claude-SearchBotallowsthrough the * group
Claude-Userallowsthrough the * group
PerplexityBotallowsthrough the * group
Perplexity-Userallowsthrough the * group
Googlebotallowsthrough the * group
Google-Extendedallowsthrough the * group
Applebot-Extendedpartialnamed in its own group
CCBotallowsthrough the * group
Bytespiderallowsthrough the * group
Meta-ExternalAgentpartialnamed in its own group
Amazonbotpartialnamed in its own group
amazon-kendrapartialnamed in its own group
facebookexternalhitallowsnamed in its own group
YandexAdditionalpartialnamed in its own group
YandexAdditionalBotpartialnamed in its own group
YouBotpartialnamed in its own group

Other signals

Publishes /llms.txtnot observed
Publishes /ai.txtnot observed
Publishes /.well-known/tdmrep.jsonno
Reserves TDM rights (TDMRep file, header or meta)not observed
Declares Content Signals (robots.txt or header)not observed
Says ai-train=no in a Content Signalnot observed
Points to an RSL licence (robots.txt License line or Link header)not observed
Answers with an x402 payment offer (lower bound: only the homepage is probed)not observed
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)not observed
Sends noai / noimageai directivesnot observed
Refused our fetcher (403 / challenge)no

robots.txt as recorded sha256 09d6014949285928…

# Access to and use of Zillow.com is governed by our Terms of Use. See http://www.zillow.com/corp/Terms.htm

User-agent: *
Disallow: /?url=
Disallow: /*_rect
Disallow: /*_rect/
Disallow: /*_rid
Disallow: /*_sort/
Disallow: /*.sdirect
Disallow: /*1_fs/
Disallow: /*3ab9b0d/
Disallow: /*3bec89b
Disallow: /*/_type/
Disallow: /*/0-0_beds/
Disallow: /*/admin-ajax.php
Disallow: /*/apartments-are_att/
Disallow: /*/apartments-madden_att/
Disallow: /*/apartments-offers_att/
Disallow: /*/apartments-rent_att/
Disallow: /*cbpartner=
Disallow: /*/CountyAssessorPage.htm?*
Disallow: /*/duplex-apartments_att/
Disallow: /*/floor-map-annotator/*
Disallow: /*/foreclosure--
Disallow: */foreclosed/*
Disallow: /*/GetResults.htm*
Disallow: /*/house_type/
Disallow: /*/house,apartment_duplex_type/
Disallow: /*/house,mobile_type/
Disallow: /*/house,mobile,land_type/
Disallow: /*/house,mobile,townhouse_type/
Disallow: /*/loft-apartments_att/
Disallow: /*/mostrecentchange_sort/
Disallow: /*/node_modules/.bin/
Disallow: /*/plus/
Disallow: /*/rent-house_att/
Disallow: /*/rino-_att/
Disallow: /*/qc/
Disallow: /*-qc/
Disallow: /*/townhome_att/
Disallow: /*/u1_sch/
Disallow: /*RentalConfirmedClaim
Disallow: /*?searchQueryState=*
Disallow: /ads/
Disallow: /advice-thread/
Disallow: /advicepages/
Disallow: /aerial/
Disallow: /advice/
Disallow: /agent-websites/
Disallow: /ajax/homedetail/CompareWithPublicFactsData.htm
Disallow: /ajax/homedetail/HomeValueChartData.htm
Disallow: /ajax/nav/UserNavAsync.htm?pageframe=true
Disallow: /ajax/rentals/ClaimedRentalProperties.htm?actionType=claims
Disallow: /ajax/ownerview/PerformSellerLeadContact.htm
Disallow: /ajax/ownerview/SellerLeadData.htm
Disallow: /app?
Disallow: /b/*/rental-manager/resources/
Disallow: /b/*bed*/
Disallow: /b/*month*/
Disallow: /b/*!*/
Disallow: /b/*(*/
Disallow: /b/*&*/
Disallow: /b/*/*_ll/
Disallow: /bal/impression/
Disallow: /bal/impression/RecordImpression.htm?
Disallow: /browse/homes/all/
Disallow: /captcha/
Disallow: /careers/apply/
Disallow: /careers/jobs/
Disallow: /claiming/
Disallow: /claiming/ClaimProperty.htm?
Disallow: /community/error-subdivision-name-unavailable/
Disallow: /contact/
Disallow: /corp/Privacy.htm
Disallow: /corp/Terms.htm
Disallow: /CountyAssessorPage.htm
Disallow: /del/
Disallow: /discovery/
Disallow: /editing/
Disallow: /email/EnrollmentUnsubscribe.htm
Disallow: /email/SubscriptionTypeUnsubscribe.htm 
Disallow: /email/Unsubscribe.htm
Disallow: /for-sale-by-owner/?zpid=
Disallow: /home-improvement-dueling-digs/
Disallow: /homedetail/AuthRequired.htm
Disallow: /homedetail/HomeDetail,*Border.*debug*DebugBar.*InspectorButton.link.sdirect
Disallow: /homedetails/*view=owner
Disallow: /homedetails/*/rental-manager/resources/
Disallow: /homeimprovement/EmbeddedProfile.htm
Disallow: /homepage/HomepageVideoMetrics.htm
Disallow: /homes/*+
Disallow: /homes/*_rb
Disallow: /homes/*_zpid/
Disallow: /homes/*mapBounds*
Disallow: /homes/com.zillow.service.search.SearchURLImpl
Disallow: /homes/comps_for_rent/
Disallow: /homes/comps_for_sale/
Disallow: /homes/comps/
Disallow: /homes/for_sale/*_agent_list/
Disallow: /homes/for_sale/1_favorite_list/1_rs/1_fr/
Disallow: /howto/GoodNeighborPolicy.htm
Disallow: /HYx10rg3/xhr/api/v1/collector
Disallow: /HYx10rg3/xhr/api/v2/collector
Disallow: /IMAGE
Disallow: /imf-fetch-message/api/v1/request/fetch-message/MOBILE_APP_UPSELL
Disallow: /instant-offers/version/
Disallow: /l/
Disallow: /learnmore/
Disallow: /license/
Disallow: /m/
Disallow: /make-me-move?zpid=
Disallow: /make-me-move/?zpid=
Disallow: /mobile/GetAdConfiguration.htm
Disallow: /mobile/MobilePropertyDetails.htm
Disallow: /mobile/WinmoPropertyDetails.htm
Disallow: /mobile/WPPropertyDetails.htm
Disallow: /mortgage/SmallMortgageLoanCalculatorWidget.htm
Disallow: /mortgage/MortgageCalculatorWidgetLarge.htm
Disallow: /mortgage/MortgageRateTable.htm
Disallow: /mortgage/widgets/AffordabilityCalculatorWidget.htm
Disallow: /mortgage/MortgageRateTableWidget.htm
Disallow: /mortgage/MortgageLoanCalculatorWidget.htm
Disallow: /mortgage/RateExplorerGraphWidget.htm
Disallow: /myzillow/
Disallow: /offers/request/
Disallow: /ofr/api/v3/questionnaire
Disallow: /pbflex/
Disallow: /personalization/
Disallow: /post-real-estate-listings?zpid=
Disallow: /post-real-estate-listings/?zpid=
Disallow: /post-rental-listings?zpid=
Disallow: /postings/
Disallow: /postings/PostForSale.htm?
Disallow: /postings/PostMakeMeMoveStreamlined.htm?
Disallow: */pre-foreclosure/*
Disallow: /pricing/
Disallow: /profile/*/Advice/
Disallow: /profile/*/Reviews-Written/
Disallow: /profile/*/photos/
Disallow: /profiles/ProfileBorderTemplate,*myzillow*MyListingsTabulated.*postings*owners*OwnersProfileUpsell.*DirectLink.sdirect
Disallow: /real-estate-listings
Disallow: /rental-manager/?source=topnav&itc=postbutton_topnav
Disallow: /rental-manager/?zpid=
Disallow: /rental-manager/properties?postingPath=true
Disallow: /rental-manager/properties/?source=*
Disallow: /rental-manager/r/
Disallow: /rentals/
Disallow: /rentalsrevenue/
Disallow: /rentalsrevenue/resume/UpdatePasswordInline*
Disallow: /renter-hub/
Disallow: /research/monthly-reports/
Disallow: /reviews/write?s=
Disallow: /reviews/write/?s=
Disallow: /routing/email/
Disallow: /s/
Disallow: /savedhomes/
Disallow: /schools/TestHistoryAsync.htm
Disallow: /search/browse/HDPTree,*Border.*debug*DebugBar.*InspectorButton.link.sdirect
Disallow: /search/HDPMapResults.htm
Disallow: /search/SavedSearchLightboxContent.htm
Disallow: /showcase/Click.htm?
Disallow: /sitemap/catalog/hdp/
Disallow: /trk/
Disallow: /ui/
Disallow: /url-shortner/
Disallow: /user/account/SaveSearchOptions.htm
Disallow: /user/account/services/
Disallow: /user/account/services/WhoAmI.htm
Disallow: /user/acct/login/
Disallow: /user/InlineLogin.htm?
Disallow: /user/Login
Disallow: /user/Register
Disallow: /util/ClientLogger.htm
Disallow: /videodetails/
Disallow: /walkscore/
Disallow: /webservice/
Disallow: /webtools/
Disallow: /widgets/
Disallow: /wikipages/
Disallow: /ajax/profile-broker-website 
Disallow: /agent-resources/zgwp/app/themes/paxl/assets/fonts/stargate.ttf
Disallow: /my-agent/eligibility*
Disallow: /jsonp/Bdp.htm?*
Disallow: /ajax/homedetail/MarkPropertyViewed*
Disallow: /wiki/Help*
Disallow: */allunits/*
Disallow: /reviews/batch-request/
Disallow: /myzillow/ChangePassword.htm
Disallow: /editing/EditHomeFacts.htm
Disallow: /community/error-subdivision-name-unavailable/
Disallow: /user/account/
Disallow: /user/InlineLogin.htm
Disallow: /reviews/request/
Disallow: /CountyAssessorPage.htm
Disallow: /error/PageNotFound.htm
Disallow: /mortgage/MortgageRateTableWidget.htm
Disallow: /imf-fetch-message/*
Disallow: /app$
Disallow: /*/node_modules/.bin/jest
Disallow: /view-3d-home
Disallow: /b/*/*_p/

User-agent: Mediapartners-Google
Disallow: /*?searchQueryState=*

User-agent: AdsBot-Google-Mobile
Disallow: /*?searchQueryState=*

User-agent: AdsBot-Google
Disallow: /*?searchQueryState=*

Sitemap: https://mortgageapi.zillow.com/sitemap.xml
Sitemap: https://www.zillow.com/sitemap/catalog/cdp/index.xml
Sitemap: https://www.zillow.com/sitemap/catalog/sitemap.xml
Sitemap: https://www.zillow.com/sitemap/xml/index.xml
Sitemap: https://www.zillow.com/sitemap/xml/srp-index.xml

robots.txt versions

FromThroughStateVersion
2026-10-262026-10-28ok 20048aa7b503b17

Timeline of changes

DateWhat changed
No changes since the first observation (2026-10-26).

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

CrawlHostStateGPTBotOAI-SearchBotChatGPT-UserClaudeBotClaude-SearchBotClaude-UserPerplexityBot
2020-09-28 CC-MAIN-2020-40www.zillow.comok viewallowsallowsunknownallowsallowsunknownallows
2019-09-23 CC-MAIN-2019-39www.zillow.comok viewallowsallowsunknownallowsallowsunknownallows
2018-01-29 CC-MAIN-2018-05zillow.comredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2017-10-23 CC-MAIN-2017-43www.zillow.comredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2017-09-25 CC-MAIN-2017-39www.zillow.comredirect-onlyunknownunknownunknownunknownunknownunknownunknown

Evidence

Every daily observation of zillow.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/zillow.com