State of AI opt-outs, October 2026
Between 26 October 2026 and 26 October 2026, the share of top 10k websites fully blocking GPTBot went from 14.6% to 14.6%.
Month in progress: figures run to 2026-10-26 and will change until the month ends.
Last verified 2026-10-26 21:13 UTC (daily run of 2026-10-26). Proof for that day.
Share of the top 10k blocking each AI bot
| Bot | 2026-10-26 | 2026-10-26 | Change |
|---|---|---|---|
| GPTBot OpenAI | 14.6% | 14.6% | +0.0 pt |
| OAI-SearchBot OpenAI | 7.3% | 7.3% | +0.0 pt |
| ChatGPT-User OpenAI | 8.7% | 8.7% | +0.0 pt |
| ClaudeBot Anthropic | 13.8% | 13.8% | +0.0 pt |
| Claude-SearchBot Anthropic | 7.2% | 7.2% | +0.0 pt |
| Claude-User Anthropic | 7.2% | 7.2% | +0.0 pt |
| PerplexityBot Perplexity | 10.0% | 10.0% | +0.0 pt |
| Perplexity-User Perplexity | 7.5% | 7.5% | +0.0 pt |
| Googlebot Google | 2.8% | 2.8% | +0.0 pt |
| Google-Extended Google | 12.5% | 12.5% | +0.0 pt |
| Applebot-Extended Apple | 12.1% | 12.1% | +0.0 pt |
| CCBot Common Crawl | 15.4% | 15.4% | +0.0 pt |
| Bytespider ByteDance | 15.1% | 15.1% | +0.0 pt |
| Meta-ExternalAgent Meta | 12.4% | 12.4% | +0.0 pt |
| Amazonbot Amazon | 11.9% | 11.9% | +0.0 pt |
Signals
| Signal | 2026-10-26 | 2026-10-26 |
|---|---|---|
| Publishes /llms.txt | 12.7% | 12.7% |
| Publishes /ai.txt | 0.2% | 0.2% |
| Publishes /.well-known/tdmrep.json | 0.4% | 0.4% |
| Reserves TDM rights (TDMRep file, header or meta) | 0.8% | 0.8% |
| Declares Content Signals (robots.txt or header) | 5.2% | 5.2% |
| Says ai-train=no in a Content Signal | 3.7% | 3.7% |
| Points to an RSL licence (robots.txt License line or Link header) | 0.2% | 0.2% |
| Answers with an x402 payment offer (lower bound: only the homepage is probed) | 0.0% | 0.0% |
| Answers HTTP 402 Payment Required (lower bound: only the homepage is probed) | 0.0% | 0.0% |
| Sends noai / noimageai directives | 0.3% | 0.3% |
| Refused our fetcher (403 / challenge) | 11.2% | 11.2% |
New blocks of headline bots (137)
| Date | Site | What changed |
|---|---|---|
| 2026-10-27 | n-tv.de top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | n-tv.de top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | n-tv.de top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | n-tv.de top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | n-tv.de top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks ChatGPT-User (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks Claude-User (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | ptt.cc top 10k | now blocks Perplexity-User (was allow) |
| 2026-10-27 | xnxx.health top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | xnxx.health top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | xnxx.health top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | xnxx.health top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | xnxx.health top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | xnxx.health top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | xnxx.health top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | xnxx.health top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | manhwaweb.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | manhwaweb.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | manhwaweb.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | manhwaweb.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | manhwaweb.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | manhwaweb.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | manhwaweb.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | manhwaweb.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | xn--12c1ezaww.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | xn--12c1ezaww.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | xn--12c1ezaww.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | xn--12c1ezaww.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | xn--12c1ezaww.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | xn--12c1ezaww.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | xn--12c1ezaww.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | xn--12c1ezaww.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | loteriadehoy.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | loteriadehoy.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | loteriadehoy.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | loteriadehoy.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | loteriadehoy.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | loteriadehoy.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | loteriadehoy.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | loteriadehoy.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | elmundo.es top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | elmundo.es top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | elmundo.es top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | elmundo.es top 10k | now blocks Claude-SearchBot (was allow) |
| 2026-10-27 | elmundo.es top 10k | now blocks Claude-User (was allow) |
| 2026-10-27 | elmundo.es top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | elmundo.es top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | elmundo.es top 10k | now blocks Perplexity-User (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks ChatGPT-User (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Claude-SearchBot (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Claude-User (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Googlebot (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks OAI-SearchBot (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks Perplexity-User (was allow) |
| 2026-10-27 | kasserver.com top 10k | now blocks PerplexityBot (was allow) |
| 2026-10-27 | filmyzilla56.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | filmyzilla56.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | filmyzilla56.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | filmyzilla56.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | filmyzilla56.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | filmyzilla56.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | filmyzilla56.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | filmyzilla56.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | filmyzilla62.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | filmyzilla62.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | filmyzilla62.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | filmyzilla62.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | filmyzilla62.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | filmyzilla62.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | filmyzilla62.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | filmyzilla62.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | filmyzilla63.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | filmyzilla63.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | filmyzilla63.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | filmyzilla63.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | filmyzilla63.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | filmyzilla63.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | filmyzilla63.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | filmyzilla63.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | mastodon.social top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | mastodon.social top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | mastodon.social top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | mastodon.social top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | mastodon.social top 10k | now blocks Google-Extended (was allow) |
Lifted blocks (47)
| Date | Site | What changed |
|---|---|---|
| 2026-10-27 | vnexpress.net top 10k | now allows Applebot-Extended (was block) |
| 2026-10-27 | vnexpress.net top 10k | now allows Bytespider (was block) |
| 2026-10-27 | vnexpress.net top 10k | now allows CCBot (was block) |
| 2026-10-27 | vnexpress.net top 10k | now allows ClaudeBot (was block) |
| 2026-10-27 | vnexpress.net top 10k | now allows Google-Extended (was block) |
| 2026-10-27 | vnexpress.net top 10k | now allows GPTBot (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows Amazonbot (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows Applebot-Extended (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows Bytespider (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows CCBot (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows ChatGPT-User (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows Claude-SearchBot (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows Claude-User (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows ClaudeBot (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows Google-Extended (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows GPTBot (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows Meta-ExternalAgent (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows OAI-SearchBot (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows Perplexity-User (was block) |
| 2026-10-27 | zimbra.com top 10k | now allows PerplexityBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Amazonbot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Applebot-Extended (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Bytespider (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows CCBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows ClaudeBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Google-Extended (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows GPTBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Meta-ExternalAgent (was block) |
| 2026-10-27 | delfi.lt top 10k | now allows Google-Extended (was block) |
| 2026-10-27 | fragrantica.com top 10k | now allows Claude-SearchBot (was block) |
| 2026-10-27 | fragrantica.com top 10k | now allows PerplexityBot (was block) |
| 2026-10-27 | resetera.com top 10k | now allows Applebot-Extended (was block) |
| 2026-10-27 | resetera.com top 10k | now allows ChatGPT-User (was block) |
| 2026-10-27 | resetera.com top 10k | now allows Google-Extended (was block) |
| 2026-10-27 | resetera.com top 10k | now allows GPTBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Amazonbot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Applebot-Extended (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Bytespider (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks CCBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks ChatGPT-User (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks ClaudeBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Google-Extended (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks GPTBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Meta-ExternalAgent (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks OAI-SearchBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Perplexity-User (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks PerplexityBot (was block) |
511 bot-verdict changes in the month in total; all of them in changes.csv.
Cite this
InfraRabbit AI Crawl Ledger, "State of AI opt-outs, October 2026", https://infrarabbit.com/crawlers/reports/2026-10. CC BY 4.0.