netflix.com: what it tells AI crawlers

On 27 October 2026, netflix.com's robots.txt fully blocked CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel: top 1k (Tranco)
robots.txt: ok (HTTP 200) · https://www.netflix.com/robots.txt
unchanged since 2026-10-26 · sha256 1e14fa0284e9757b… · view as recorded
The * group: blocks applies to every agent without its own group

Per AI bot, 2026-10-27

User agent	Verdict	How
GPTBot	allows	named in its own group
OAI-SearchBot	allows	named in its own group
ChatGPT-User	allows	named in its own group
ClaudeBot	allows	named in its own group
Claude-SearchBot	allows	named in its own group
Claude-User	allows	named in its own group
PerplexityBot	allows	named in its own group
Perplexity-User	blocks	through the * group
Googlebot	allows	named in its own group
Google-Extended	allows	named in its own group
Applebot-Extended	blocks	through the * group
CCBot	blocks	through the * group
Bytespider	blocks	through the * group
Meta-ExternalAgent	blocks	through the * group
Amazonbot	blocks	through the * group
Applebot	allows	named in its own group
facebookexternalhit	allows	named in its own group

Other signals

Publishes /llms.txt	not observed
Publishes /ai.txt	not observed
Publishes /.well-known/tdmrep.json	not observed
Reserves TDM rights (TDMRep file, header or meta)	not observed
Declares Content Signals (robots.txt or header)	not observed
Says ai-train=no in a Content Signal	not observed
Points to an RSL licence (robots.txt License line or Link header)	not observed
Answers with an x402 payment offer (lower bound: only the homepage is probed)	not observed
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)	not observed
Sends noai / noimageai directives	not observed
Refused our fetcher (403 / challenge)	no

robots.txt as recorded sha256 d6bd5123c936ed33…

User-agent: *
Disallow: /

User-agent: googlebot
User-agent: Googlebot-Video
User-agent: Applebot
User-agent: bingbot
User-agent: Baiduspider
User-agent: Baiduspider-mobile
User-agent: Baiduspider-video
User-agent: Baiduspider-image
User-agent: NaverBot
User-agent: Yeti
User-agent: Yandex
User-agent: YandexBot
User-agent: YandexMobileBot
User-agent: YandexVideo
User-agent: YandexWebmaster
User-agent: YandexSitelinks
User-agent: SeznamBot
Allow: /

Disallow: /accountstatus
Disallow: /AccountStatus
Disallow: /aui/inbound
Disallow: /authenticate
Disallow: /autologin
Disallow: /clearcookies
Disallow: /companies
Disallow: /dvdterms
Disallow: /editpayment
Disallow: /emailunsubscribe
Disallow: /error
Disallow: /eula
Disallow: /geooverride
Disallow: /help
Disallow: /imagelibrary
Disallow: /learnmorelayer
Disallow: /learnmorelayertv
Disallow: /login
Disallow: /loginhelp
Disallow: /loginhelp/lookup
Disallow: /loginhelpsucess
Disallow: /LoginHelp
Disallow: /password
Disallow: /logout
Disallow: /Logout
Disallow: /mcd
Disallow: /modernizr
Disallow: /n/
Disallow: /notamember
Disallow: /notfound
Disallow: /notices
Disallow: /nrdapp
Disallow: /optout
Disallow: /overviewblockseeother
Disallow: /popup/codewhatisthis
Disallow: /popupdetails
Disallow: /PopupDetails
Disallow: /popupprivacypolicy
Disallow: /privacypolicychanges
Disallow: /registration
Disallow: /rememberme
Disallow: /signout
Disallow: /signurl
Disallow: /subscriptioncancel
Disallow: /tastesurvey
Disallow: /termsofusechanges
Disallow: /tvsignup
Disallow: /upcomingevents
Disallow: /verifyidentity
Disallow: /whysecure

Disallow: /arabic
Disallow: /Arabic
Disallow: /chinese
Disallow: /Chinese
Disallow: /korean
Disallow: /Korean

Disallow: /airtel
Disallow: /anan
Disallow: /bouyguestelecom
Disallow: /britishairways
Disallow: /brutus
Disallow: /comhem
Disallow: /courts
Disallow: /csl
Disallow: /elisa
Disallow: /entertain
Disallow: /FireTV
Disallow: /firetv
Disallow: /freemonth
Disallow: /kpn
Disallow: /lg
Disallow: /maxis
Disallow: /Maxis
Disallow: /meo
Disallow: /Meo
Disallow: /orangefrance
Disallow: /Panasonic
Disallow: /panasonic
Disallow: /playstation
Disallow: /proximus
Disallow: /qantas
Disallow: /samsung
Disallow: /Sony
Disallow: /sony
Disallow: /talktalk
Disallow: /tdc
Disallow: /telenor
Disallow: /telfort
Disallow: /tim
Disallow: /virginaustralia
Disallow: /vodafone
Disallow: /vodafonedemobilelaunch
Disallow: /xboxone
Disallow: /xfinity
Disallow: /xs4all
Disallow: /ziggo

Disallow: /accountaccess
Disallow: /AccountAccess
Disallow: /activate
Disallow: /Activate
Disallow: /app
Disallow: /BillingActivity
Disallow: /browse
Disallow: /browse/*
Allow: /browse/genre/*
Disallow: /CancelPlan
Disallow: /ChangePlan
Disallow: /changeplan
Disallow: /deviceManagement
Disallow: /DoNotTest
Disallow: /EditProfiles
Disallow: /email
Disallow: /EmailPreferences
Disallow: /entrytrap
Disallow: /HdToggle
Disallow: /LanguagePreferences
Disallow: /ManageDevices
Disallow: /ManageProfiles
Disallow: /MoviesYouveSeen
Disallow: /NewWatchInstantlyRSS
Disallow: /NewWatchInstantlyRSS/*
Disallow: /payment
Disallow: /Payment
Disallow: /phonenumber
Disallow: /pin
Disallow: /profiles
Disallow: /profiles/*
Disallow: /ProfilesGate
Disallow: /search
Disallow: /search/*
Disallow: /viewingactivity
Disallow: /WiViewingActivity
Disallow: /yourAccount
Disallow: /youraccount
Disallow: /YourAccount
Disallow: /YourAccountPayment

User-agent: AdsBot-Google
User-agent: Twitterbot
User-agent: Adidxbot
Allow: /

User-agent: Yahoo Pipes 1.0
User-agent: Facebot
User-agent: externalfacebookhit
Disallow: /

robots.txt versions

From	Through	State	Version
2026-10-26	2026-10-27	ok 200	`1e14fa0284e9`

Timeline of changes

Date	What changed
No changes since the first observation (2026-10-26).

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Crawl	Host	State	GPTBot	OAI-SearchBot	ChatGPT-User	ClaudeBot	Claude-SearchBot	Claude-User	PerplexityBot
2026-09-21 CC-MAIN-2026-39	www.netflix.com	ok view	allows	allows	unknown	allows	allows	unknown	allows
2025-09-15 CC-MAIN-2025-38	www.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2024-09-16 CC-MAIN-2024-38	www.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2023-10-02 CC-MAIN-2023-40	www.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2022-10-03 CC-MAIN-2022-40	www.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2021-09-27 CC-MAIN-2021-39	www.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2020-09-28 CC-MAIN-2020-40	www.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2019-09-23 CC-MAIN-2019-39	www.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2018-09-24 CC-MAIN-2018-39	www.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2017-09-25 CC-MAIN-2017-39	www1.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2017-01-23 CC-MAIN-2017-04	netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2016-10-03 CC-MAIN-2016-40	netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks
2016-09-05 CC-MAIN-2016-36	www1.netflix.com	ok view	blocks	blocks	unknown	blocks	blocks	unknown	blocks

Evidence

Every daily observation of netflix.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/netflix.com