Changes
On 27 October 2026, 1,261 changes were recorded across the panel.
Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.
Show: all bot verdicts robots.txt edits llms.txt / ai.txt / TDMRep headers, x402 fetch states · Atom · CSV
Days: 2026-10-27 (1261)
Filtered · bot
| Date | Site | What changed |
|---|---|---|
| 2026-10-27 | rae.es top 10k | now blocks Diffbot (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks Google-CloudVertexBot (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks GoogleOther (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks ICC-Crawler (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks KimiBot (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks MistralAI-Training (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks omgili (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks PetalBot (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks QualifiedBot (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks SemrushBot-SWA (was allow) |
| 2026-10-27 | rae.es top 10k | now blocks WARDBot (was allow) |
| 2026-10-27 | nova-app.eu top 10k | now allows Amazonbot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows anthropic-ai (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Applebot-Extended (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows atlassian-bot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Bytespider (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows CCBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Claude-Web (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows ClaudeBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows cohere-ai (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Cotoyogi (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Diffbot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Google-CloudVertexBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Google-Extended (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows GoogleOther (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows GPTBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows ICC-Crawler (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows KimiBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows Meta-ExternalAgent (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows MistralAI-Training (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows omgili (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows PetalBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows QualifiedBot (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows SemrushBot-SWA (was block) |
| 2026-10-27 | nova-app.eu top 10k | now allows WARDBot (was block) |
| 2026-10-27 | delfi.lt top 10k | now allows Google-Extended (was block) |
| 2026-10-27 | denverpost.com top 10k | now blocks meta-externalfetcher (was allow) |
| 2026-10-27 | denverpost.com top 10k | now blocks meta-webindexer (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks AI2Bot (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks AI2Bot-DeepResearchEval (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks Ai2Bot-Dolma (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks Brightbot 1.0 (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks Googlebot (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks iaskspider/2.0 (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks img2dataset (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks Kangaroo Bot (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks Perplexity-User (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks Sidetrade indexer bot (was allow) |
| 2026-10-27 | parismatch.com top 10k | now partly blocks every agent without its own group (*) (was allow) |
| 2026-10-27 | is.fi top 10k | now blocks meta-webindexer (was allow) |
| 2026-10-27 | astro.com top 10k | now blocks PerplexityBot (was allow) |
| 2026-10-27 | astro.com top 10k | now blocks ShapBot (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now allows aiHitBot (was block) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks anthropic-ai (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks atlassian-bot (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now allows Claude-SearchBot (was block) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Claude-Web (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks cohere-ai (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Cotoyogi (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Diffbot (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now allows ExaBot (was block) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Google-CloudVertexBot (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks GoogleOther (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks ICC-Crawler (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks KimiBot (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks MistralAI-Training (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks omgili (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now allows Panscient (was block) |
| 2026-10-27 | fragrantica.com top 10k | now allows PerplexityBot (was block) |
| 2026-10-27 | fragrantica.com top 10k | now blocks PetalBot (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks QualifiedBot (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now allows Scrapy (was block) |
| 2026-10-27 | fragrantica.com top 10k | now blocks SemrushBot-SWA (was allow) |
| 2026-10-27 | fragrantica.com top 10k | now blocks WARDBot (was allow) |
| 2026-10-27 | resetera.com top 10k | now allows Applebot-Extended (was block) |
| 2026-10-27 | resetera.com top 10k | now allows ChatGPT-User (was block) |
| 2026-10-27 | resetera.com top 10k | now allows Google-Extended (was block) |
| 2026-10-27 | resetera.com top 10k | now allows GPTBot (was block) |
| 2026-10-27 | poznan.pl top 10k | now allows ExaSearchBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Amazonbot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Amzn-SearchBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Amzn-User (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks anthropic-ai (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Applebot-Extended (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Bytespider (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks CCBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks ChatGPT-User (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Claude-Web (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks ClaudeBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks cohere-ai (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Google-CloudVertexBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Google-Extended (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks GPTBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Meta-ExternalAgent (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks OAI-SearchBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks omgili (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks omgilibot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Perplexity-User (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks PerplexityBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks PetalBot (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks Scrapy (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks YandexAdditional (was block) |
| 2026-10-27 | olhardigital.com.br top 10k | now partly blocks YandexAdditionalBot (was block) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks anthropic-ai (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks atlassian-bot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Claude-Web (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks cohere-ai (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Cotoyogi (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Diffbot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Google-CloudVertexBot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks GoogleOther (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks ICC-Crawler (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks KimiBot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks MistralAI-Training (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks omgili (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks PetalBot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks QualifiedBot (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks SemrushBot-SWA (was allow) |
| 2026-10-27 | dmitriy-mevedev-tor.top top 10k | now blocks WARDBot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks anthropic-ai (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks atlassian-bot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Claude-Web (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks cohere-ai (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Cotoyogi (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Diffbot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Google-CloudVertexBot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks GoogleOther (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks ICC-Crawler (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks KimiBot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks MistralAI-Training (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks omgili (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks PetalBot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks QualifiedBot (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks SemrushBot-SWA (was allow) |
| 2026-10-27 | beatport.com top 10k | now blocks WARDBot (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks atlassian-bot (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now allows ChatGPT-User (was block) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks Cotoyogi (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks Diffbot (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now allows FacebookBot (was block) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks Google-CloudVertexBot (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks GoogleOther (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks ICC-Crawler (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now allows ImagesiftBot (was block) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks KimiBot (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks MistralAI-Training (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now allows omgilibot (was block) |
| 2026-10-27 | bestjavporn.com top 10k | now allows PerplexityBot (was block) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks QualifiedBot (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks SemrushBot-SWA (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now blocks WARDBot (was allow) |
| 2026-10-27 | bestjavporn.com top 10k | now allows YaK (was block) |
| 2026-10-27 | bestjavporn.com top 10k | now allows YouBot (was block) |
| 2026-10-27 | restspan.com top 10k | now blocks Amazonbot (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks anthropic-ai (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks Applebot-Extended (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks atlassian-bot (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks Bytespider (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks CCBot (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks Claude-Web (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks ClaudeBot (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks cohere-ai (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks Cotoyogi (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks Diffbot (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks Google-CloudVertexBot (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks Google-Extended (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks GoogleOther (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks GPTBot (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks ICC-Crawler (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks KimiBot (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks Meta-ExternalAgent (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks MistralAI-Training (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks omgili (was allow) |
| 2026-10-27 | restspan.com top 10k | now blocks PetalBot (was allow) |
A change is recorded when a day's result differs from the previous run's. Bot verdicts are compared with the last readable robots.txt, so a day on which a site refused our fetcher does not show as an unblock and a re-block.