netflix.com: what it tells AI crawlers
On 27 October 2026, netflix.com's robots.txt fully blocked CCBot.
Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.
- Panel
- top 1k (Tranco)
- robots.txt
- ok (HTTP 200) · https://www.netflix.com/robots.txt
unchanged since 2026-10-26 · sha2561e14fa0284e9757b…· view as recorded - The * group
- blocks applies to every agent without its own group
Per AI bot, 2026-10-27
| User agent | Verdict | How |
|---|---|---|
| GPTBot | allows | named in its own group |
| OAI-SearchBot | allows | named in its own group |
| ChatGPT-User | allows | named in its own group |
| ClaudeBot | allows | named in its own group |
| Claude-SearchBot | allows | named in its own group |
| Claude-User | allows | named in its own group |
| PerplexityBot | allows | named in its own group |
| Perplexity-User | blocks | through the * group |
| Googlebot | allows | named in its own group |
| Google-Extended | allows | named in its own group |
| Applebot-Extended | blocks | through the * group |
| CCBot | blocks | through the * group |
| Bytespider | blocks | through the * group |
| Meta-ExternalAgent | blocks | through the * group |
| Amazonbot | blocks | through the * group |
| Applebot | allows | named in its own group |
| facebookexternalhit | allows | named in its own group |
Other signals
| Publishes /llms.txt | not observed |
| Publishes /ai.txt | not observed |
| Publishes /.well-known/tdmrep.json | not observed |
| Reserves TDM rights (TDMRep file, header or meta) | not observed |
| Declares Content Signals (robots.txt or header) | not observed |
| Says ai-train=no in a Content Signal | not observed |
| Points to an RSL licence (robots.txt License line or Link header) | not observed |
| Answers with an x402 payment offer (lower bound: only the homepage is probed) | not observed |
| Answers HTTP 402 Payment Required (lower bound: only the homepage is probed) | not observed |
| Sends noai / noimageai directives | not observed |
| Refused our fetcher (403 / challenge) | no |
robots.txt as recorded sha256 6599c9f3db9698f0…
User-agent: * Allow: /browse Disallow: / User-agent: googlebot User-agent: Googlebot-Video User-agent: bingbot User-agent: Baiduspider User-agent: Baiduspider-mobile User-agent: Baiduspider-video User-agent: Baiduspider-image User-agent: NaverBot User-agent: Yeti User-agent: Yandex User-agent: YandexBot User-agent: YandexMobileBot User-agent: YandexVideo User-agent: YandexWebmaster User-agent: YandexSitelinks Allow: / Disallow: /accountstatus Disallow: /authenticate Disallow: /autologin Disallow: /companies Disallow: /dvdterms Disallow: /emailunsubscribe Disallow: /error Disallow: /eula Disallow: /geooverride Disallow: /help Disallow: /imagelibrary Disallow: /learnmorelayer Disallow: /learnmorelayertv Disallow: /login Disallow: /loginhelp Disallow: /loginhelp/lookup Disallow: /loginhelpsucess Disallow: /logout Disallow: /mcd Disallow: /modernizr Disallow: /notamember Disallow: /notfound Disallow: /notices Disallow: /nrdapp Disallow: /optout Disallow: /overviewblockseeother Disallow: /popup/codewhatisthis Disallow: /popupdetails Disallow: /popupprivacypolicy Disallow: /privacypolicychanges Disallow: /registration Disallow: /rememberme Disallow: /signout Disallow: /signurl Disallow: /subscriptioncancel Disallow: /tastesurvey Disallow: /termsofusechanges Disallow: /upcomingevents Disallow: /whysecure Disallow: /arabic Disallow: /chinese Disallow: /korean Disallow: /Arabic Disallow: /Chinese Disallow: /Korean Disallow: /anan Disallow: /bouyguestelecom Disallow: /brutus Disallow: /comhem Disallow: /courts Disallow: /csl Disallow: /elisa Disallow: /entertain Disallow: /freemonth Disallow: /kpn Disallow: /orangefrance Disallow: /playstation Disallow: /proximus Disallow: /qantas Disallow: /talktalk Disallow: /tdc Disallow: /telenor Disallow: /telfort Disallow: /tim Disallow: /virginaustralia Disallow: /vodafone Disallow: /xfinity Disallow: /xs4all Disallow: /ziggo User-agent: AdsBot-Google User-agent: Twitterbot User-agent: Adidxbot Allow: / User-agent: Yahoo Pipes 1.0 User-agent: Facebot User-agent: externalfacebookhit Disallow: / Sitemap: https://www.netflix.com/sitemap Sitemap: https://www.netflix.com/ad/sitemap Sitemap: https://www.netflix.com/ae/sitemap Sitemap: https://www.netflix.com/af/sitemap Sitemap: https://www.netflix.com/ag/sitemap Sitemap: https://www.netflix.com/ai/sitemap Sitemap: https://www.netflix.com/al/sitemap Sitemap: https://www.netflix.com/am/sitemap Sitemap: https://www.netflix.com/an/sitemap Sitemap: https://www.netflix.com/ao/sitemap Sitemap: https://www.netflix.com/aq/sitemap Sitemap: https://www.netflix.com/ar/sitemap Sitemap: https://www.netflix.com/as/sitemap Sitemap: https://www.netflix.com/at/sitemap Sitemap: https://www.netflix.com/au/sitemap Sitemap: https://www.netflix.com/aw/sitemap Sitemap: https://www.netflix.com/ax/sitemap Sitemap: https://www.netflix.com/az/sitemap Sitemap: https://www.netflix.com/ba/sitemap Sitemap: https://www.netflix.com/bb/sitemap Sitemap: https://www.netflix.com/bd/sitemap Sitemap: https://www.netflix.com/be/sitemap Sitemap: https://www.netflix.com/bf/sitemap Sitemap: https://www.netflix.com/bg/sitemap Sitemap: https://www.netflix.com/bh/sitemap Sitemap: https://www.netflix.com/bi/sitemap Sitemap: https://www.netflix.com/bj/sitemap Sitemap: https://www.netflix.com/bl/sitemap Sitemap: https://www.netflix.com/bm/sitemap Sitemap: https://www.netflix.com/bn/sitemap Sitemap: https://www.netflix.com/bo/sitemap Sitemap: https://www.netflix.com/bq/sitemap Sitemap: https://www.netflix.com/br/sitemap Sitemap: https://www.netflix.com/bs/sitemap Sitemap: https://www.netflix.com/bt/sitemap Sitemap: https://www.netflix.com/bv/sitemap Sitemap: https://www.netflix.com/bw/sitemap Sitemap: https://www.netflix.com/by/sitemap Sitemap: https://www.netflix.com/bz/sitemap Sitemap: https://www.netflix.com/ca/sitemap Sitemap: https://www.netflix.com/cc/sitemap Sitemap: https://www.netflix.com/cd/sitemap Sitemap: https://www.netflix.com/cf/sitemap Sitemap: https://www.netflix.com/cg/sitemap Sitemap: https://www.netflix.com/ch/sitemap Sitemap: https://www.netflix.com/ci/sitemap Sitemap: https://www.netflix.com/ck/sitemap Sitemap: https://www.netflix.com/cl/sitemap Sitemap: https://www.netflix.com/cm/sitemap Sitemap: https://www.netflix.com/co/sitemap Sitemap: https://www.netflix.com/cr/sitemap Sitemap: https://www.netflix.com/cu/sitemap Sitemap: https://www.netflix.com/cv/sitemap Sitemap: https://www.netflix.com/cw/sitemap Sitemap: https://www.netflix.com/cx/sitemap Sitemap: https://www.netflix.com/cy/sitemap Sitemap: https://www.netflix.com/cz/sitemap Sitemap: https://www.netflix.com/de/sitemap Sitemap: https://www.netflix.com/dj/sitemap Sitemap: https://www.netflix.com/dk/sitemap Sitemap: https://www.netflix.com/dm/sitemap Sitemap: https://www.netflix.com/do/sitemap Sitemap: https://www.netflix.com/dz/sitemap Sitemap: https://www.netflix.com/ec/sitemap Sitemap: https://www.netflix.com/ee/sitemap Sitemap: https://www.netflix.com/eg/sitemap Sitemap: https://www.netflix.com/eh/sitemap Sitemap: https://www.netflix.com/er/sitemap Sitemap: https://www.netflix.com/es/sitemap Sitemap: https://www.netflix.com/et/sitemap Sitemap: https://www.netflix.com/fi/sitemap Sitemap: https://www.netflix.com/fj/sitemap Sitemap: https://www.netflix.com/fk/sitemap Sitemap: https://www.netflix.com/fm/sitemap Sitemap: https://www.netflix.com/fo/sitemap Sitemap: https://www.netflix.com/fr/sitemap Sitemap: https://www.netflix.com/ga/sitemap Sitemap: https://www.netflix.com/gb/sitemap Sitemap: https://www.netflix.com/gd/sitemap Sitemap: https://www.netflix.com/ge/sitemap Sitemap: https://www.netflix.com/gf/sitemap Sitemap: https://www.netflix.com/gg/sitemap Sitemap: https://www.netflix.com/gh/sitemap Sitemap: https://www.netflix.com/gi/sitemap Sitemap: https://www.netflix.com/gl/sitemap Sitemap: https://www.netflix.com/gm/sitemap Sitemap: https://www.netflix.com/gn/sitemap Sitemap: https://www.netflix.com/gp/sitemap Sitemap: https://www.netflix.com/gq/sitemap Sitemap: https://www.netflix.com/gr/sitemap Sitemap: https://www.netflix.com/gs/sitemap Sitemap: https://www.netflix.com/gt/sitemap Sitemap: https://www.netflix.com/gu/sitemap Sitemap: https://www.netflix.com/gw/sitemap Sitemap: https://www.netflix.com/gy/sitemap Sitemap: https://www.netflix.com/hk/sitemap Sitemap: https://www.netflix.com/hm/sitemap Sitemap: https://www.netflix.com/hn/sitemap Sitemap: https://www.netflix.com/hr/sitemap Sitemap: https://www.netflix.com/ht/sitemap Sitemap: https://www.netflix.com/hu/sitemap Sitemap: https://www.netflix.com/id/sitemap Sitemap: https://www.netflix.com/ie/sitemap Sitemap: https://www.netflix.com/il/sitemap Sitemap: https://www.netflix.com/im/sitemap Sitemap: https://www.netflix.com/in/sitemap Sitemap: https://www.netflix.com/io/sitemap Sitemap: https://www.netflix.com/iq/sitemap Sitemap: https://www.netflix.com/ir/sitemap Sitemap: https://www.netflix.com/is/sitemap Sitemap: https://www.netflix.com/it/sitemap Sitemap: https://www.netflix.com/je/sitemap Sitemap: https://www.netflix.com/jm/sitemap Sitemap: https://www.netflix.com/jo/sitemap Sitemap: https://www.netflix.com/jp/sitemap Sitemap: https://www.netflix.com/ke/sitemap Sitemap: https://www.netflix.com/kg/sitemap Sitemap: https://www.netflix.com/kh/sitemap Sitemap: https://www.netflix.com/ki/sitemap Sitemap: https://www.netflix.com/km/sitemap Sitemap: https://www.netflix.com/kn/sitemap Sitemap: https://www.netflix.com/kr/sitemap Sitemap: https://www.netflix.com/kw/sitemap Sitemap: https://www.netflix.com/ky/sitemap Sitemap: https://www.netflix.com/kz/sitemap Sitemap: https://www.netflix.com/la/sitemap Sitemap: https://www.netflix.com/lb/sitemap Sitemap: https://www.netflix.com/lc/sitemap Sitemap: https://www.netflix.com/li/sitemap Sitemap: https://www.netflix.com/lk/sitemap Sitemap: https://www.netflix.com/lr/sitemap Sitemap: https://www.netflix.com/ls/sitemap Sitemap: https://www.netflix.com/lt/sitemap Sitemap: https://www.netflix.com/lu/sitemap Sitemap: https://www.netflix.com/lv/sitemap Sitemap: https://www.netflix.com/ly/sitemap Sitemap: https://www.netflix.com/ma/sitemap Sitemap: https://www.netflix.com/mc/sitemap Sitemap: https://www.netflix.com/md/sitemap Sitemap: https://www.netflix.com/me/sitemap Sitemap: https://www.netflix.com/mf/sitemap Sitemap: https://www.netflix.com/mg/sitemap Sitemap: https://www.netflix.com/mh/sitemap Sitemap: https://www.netflix.com/mk/sitemap Sitemap: https://www.netflix.com/ml/sitemap Sitemap: https://www.netflix.com/mm/sitemap Sitemap: https://www.netflix.com/mn/sitemap Sitemap: https://www.netflix.com/mo/sitemap Sitemap: https://www.netflix.com/mp/sitemap Sitemap: https://www.netflix.com/mq/sitemap Sitemap: https://www.netflix.com/mr/sitemap Sitemap: https://www.netflix.com/ms/sitemap Sitemap: https://www.netflix.com/mt/sitemap Sitemap: https://www.netflix.com/mu/sitemap Sitemap: https://www.netflix.com/mv/sitemap Sitemap: https://www.netflix.com/mw/sitemap Sitemap: https://www.netflix.com/mx/sitemap Sitemap: https://www.netflix.com/my/sitemap Sitemap: https://www.netflix.com/mz/sitemap Sitemap: https://www.netflix.com/na/sitemap Sitemap: https://www.netflix.com/nc/sitemap Sitemap: https://www.netflix.com/ne/sitemap Sitemap: https://www.netflix.com/nf/sitemap Sitemap: https://www.netflix.com/ng/sitemap Sitemap: https://www.netflix.com/ni/sitemap Sitemap: https://www.netflix.com/nl/sitemap Sitemap: https://www.netflix.com/no/sitemap Sitemap: https://www.netflix.com/np/sitemap Sitemap: https://www.netflix.com/nr/sitemap Sitemap: https://www.netflix.com/nu/sitemap Sitemap: https://www.netflix.com/nz/sitemap Sitemap: https://www.netflix.com/om/sitemap Sitemap: https://www.netflix.com/pa/sitemap Sitemap: https://www.netflix.com/pe/sitemap Sitemap: https://www.netflix.com/pf/sitemap Sitemap: https://www.netflix.com/pg/sitemap Sitemap: https://www.netflix.com/ph/sitemap Sitemap: https://www.netflix.com/pk/sitemap Sitemap: https://www.netflix.com/pl/sitemap Sitemap: https://www.netflix.com/pm/sitemap Sitemap: https://www.netflix.com/pn/sitemap Sitemap: https://www.netflix.com/pr/sitemap Sitemap: https://www.netflix.com/ps/sitemap Sitemap: https://www.netflix.com/pt/sitemap Sitemap: https://www.netflix.com/pw/sitemap Sitemap: https://www.netflix.com/py/sitemap Sitemap: https://www.netflix.com/qa/sitemap Sitemap: https://www.netflix.com/re/sitemap Sitemap: https://www.netflix.com/ro/sitemap Sitemap: https://www.netflix.com/rs/sitemap Sitemap: https://www.netflix.com/ru/sitemap Sitemap: https://www.netflix.com/rw/sitemap Sitemap: https://www.netflix.com/sa/sitemap Sitemap: https://www.netflix.com/sb/sitemap Sitemap: https://www.netflix.com/sc/sitemap Sitemap: https://www.netflix.com/sd/sitemap Sitemap: https://www.netflix.com/se/sitemap Sitemap: https://www.netflix.com/sg/sitemap Sitemap: https://www.netflix.com/sh/sitemap Sitemap: https://www.netflix.com/si/sitemap Sitemap: https://www.netflix.com/sj/sitemap Sitemap: https://www.netflix.com/sk/sitemap Sitemap: https://www.netflix.com/sl/sitemap Sitemap: https://www.netflix.com/sm/sitemap Sitemap: https://www.netflix.com/sn/sitemap Sitemap: https://www.netflix.com/so/sitemap Sitemap: https://www.netflix.com/sr/sitemap Sitemap: https://www.netflix.com/ss/sitemap Sitemap: https://www.netflix.com/st/sitemap Sitemap: https://www.netflix.com/sv/sitemap Sitemap: https://www.netflix.com/sx/sitemap Sitemap: https://www.netflix.com/sz/sitemap Sitemap: https://www.netflix.com/tc/sitemap Sitemap: https://www.netflix.com/td/sitemap Sitemap: https://www.netflix.com/tf/sitemap Sitemap: https://www.netflix.com/tg/sitemap Sitemap: https://www.netflix.com/th/sitemap Sitemap: https://www.netflix.com/tj/sitemap Sitemap: https://www.netflix.com/tk/sitemap Sitemap: https://www.netflix.com/tl/sitemap Sitemap: https://www.netflix.com/tm/sitemap Sitemap: https://www.netflix.com/tn/sitemap Sitemap: https://www.netflix.com/to/sitemap Sitemap: https://www.netflix.com/tr/sitemap Sitemap: https://www.netflix.com/tt/sitemap Sitemap: https://www.netflix.com/tv/sitemap Sitemap: https://www.netflix.com/tw/sitemap Sitemap: https://www.netflix.com/tz/sitemap Sitemap: https://www.netflix.com/ua/sitemap Sitemap: https://www.netflix.com/ug/sitemap Sitemap: https://www.netflix.com/um/sitemap Sitemap: https://www.netflix.com/uy/sitemap Sitemap: https://www.netflix.com/uz/sitemap Sitemap: https://www.netflix.com/va/sitemap Sitemap: https://www.netflix.com/vc/sitemap Sitemap: https://www.netflix.com/ve/sitemap Sitemap: https://www.netflix.com/vg/sitemap Sitemap: https://www.netflix.com/vi/sitemap Sitemap: https://www.netflix.com/vn/sitemap Sitemap: https://www.netflix.com/vu/sitemap Sitemap: https://www.netflix.com/wf/sitemap Sitemap: https://www.netflix.com/ws/sitemap Sitemap: https://www.netflix.com/ye/sitemap Sitemap: https://www.netflix.com/yt/sitemap Sitemap: https://www.netflix.com/za/sitemap Sitemap: https://www.netflix.com/zm/sitemap Sitemap: https://www.netflix.com/zw/sitemap
robots.txt versions
| From | Through | State | Version | |
|---|---|---|---|---|
| 2026-10-26 | 2026-10-28 | ok 200 | 1e14fa0284e9 |
Timeline of changes
| Date | What changed |
|---|---|
| No changes since the first observation (2026-10-26). | |
Reconstructed history (Common Crawl)
From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.
| Crawl | Host | State | GPTBot | OAI-SearchBot | ChatGPT-User | ClaudeBot | Claude-SearchBot | Claude-User | PerplexityBot |
|---|---|---|---|---|---|---|---|---|---|
| 2026-09-21 CC-MAIN-2026-39 | www.netflix.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2025-09-15 CC-MAIN-2025-38 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2024-09-16 CC-MAIN-2024-38 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2023-10-02 CC-MAIN-2023-40 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2022-10-03 CC-MAIN-2022-40 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2021-09-27 CC-MAIN-2021-39 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2020-09-28 CC-MAIN-2020-40 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2019-09-23 CC-MAIN-2019-39 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2018-09-24 CC-MAIN-2018-39 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2018-04-23 CC-MAIN-2018-17 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2018-01-29 CC-MAIN-2018-05 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2017-10-23 CC-MAIN-2017-43 | www.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2017-09-25 CC-MAIN-2017-39 | www1.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2017-07-24 CC-MAIN-2017-30 | www2.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2017-04-24 CC-MAIN-2017-17 | netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2017-01-23 CC-MAIN-2017-04 | netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2016-10-03 CC-MAIN-2016-40 | netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2016-09-05 CC-MAIN-2016-36 | www1.netflix.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
Evidence
Every daily observation of netflix.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).
API: https://infrarabbit.com/crawlers/api/v1/policy/netflix.com