bblaa.com: what it tells AI crawlers

On 27 October 2026, bblaa.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel
top 10k (Tranco)
robots.txt
ok (HTTP 200) · https://bblaa.com/robots.txt
unchanged since 2026-10-26 · sha256 3938c63e8b782001… · view as recorded

Per AI bot, 2026-10-27

User agentVerdictHow
GPTBotallowsno applicable rules
OAI-SearchBotallowsno applicable rules
ChatGPT-Userallowsno applicable rules
ClaudeBotallowsno applicable rules
Claude-SearchBotallowsno applicable rules
Claude-Userallowsno applicable rules
PerplexityBotallowsno applicable rules
Perplexity-Userallowsno applicable rules
Googlebotallowsno applicable rules
Google-Extendedallowsno applicable rules
Applebot-Extendedallowsno applicable rules
CCBotallowsno applicable rules
Bytespiderallowsno applicable rules
Meta-ExternalAgentallowsno applicable rules
Amazonbotallowsno applicable rules

Other signals

Publishes /llms.txtno
Publishes /ai.txtno
Publishes /.well-known/tdmrep.jsonno
Reserves TDM rights (TDMRep file, header or meta)no
Declares Content Signals (robots.txt or header)no
Says ai-train=no in a Content Signalno
Points to an RSL licence (robots.txt License line or Link header)no
Answers with an x402 payment offer (lower bound: only the homepage is probed)no
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)no
Sends noai / noimageai directivesno
Refused our fetcher (403 / challenge)no

robots.txt as recorded sha256 ab7568b32bfef7b0…

# As a condition of accessing this website, you agree to abide by the following
# content signals:

# (a)  If a Content-Signal = yes, you may collect content for the corresponding
#      use.
# (b)  If a Content-Signal = no, you may not collect content for the
#      corresponding use.
# (c)  If the website operator does not include a Content-Signal for a
#      corresponding use, the website operator neither grants nor restricts
#      permission via Content-Signal with respect to the corresponding use.

# The content signals and their meanings are:

# search:   building a search index and providing search results (e.g., returning
#           hyperlinks and short excerpts from your website's contents). Search does not
#           include providing AI-generated search summaries.
# ai-input: inputting content into one or more AI models (e.g., retrieval
#           augmented generation, grounding, or other real-time taking of content for
#           generative AI search answers).
# ai-train: training or fine-tuning AI models.
# use:      how AI systems may consume the content (immediate, reference, or full).

# ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
# RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
# AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.

# BEGIN Cloudflare Managed content


User-agent: *
Content-Signal: search=yes,ai-train=no,use=reference
Allow: /

# Training crawlers
User-agent: Amazonbot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: omgili
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: Claude-Web
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: MistralAI-Training
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: GoogleOther
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: AwarioSmartBot
User-agent: AwarioRssBot
Disallow: /

User-agent: Google-CloudVertexBot
Disallow: /

User-agent: QualifiedBot
Disallow: /

User-agent: Cotoyogi
Disallow: /

User-agent: ICC-Crawler
Disallow: /

User-agent: atlassian-bot
Disallow: /

User-agent: FishBot
Disallow: /

User-agent: BorderxBot
Disallow: /

User-agent: NavuBot
Disallow: /

User-agent: SemrushBot-SWA
Disallow: /

User-agent: WARDBot
Disallow: /

User-agent: magpie-crawler
Disallow: /

User-agent: KimiBot
Disallow: /

User-agent: CitibotSiteCrawler
Disallow: /

# END Cloudflare Managed Content

empty OK

robots.txt versions

FromThroughStateVersion
2026-10-282026-10-28ok 200ab7568b32bfediff with previous
2026-10-262026-10-27ok 2003938c63e8b78

Timeline of changes

DateWhat changed
2026-10-28robots.txt changed
2026-10-28now blocks Amazonbot (was allow)
2026-10-28now blocks anthropic-ai (was allow)
2026-10-28now blocks Applebot-Extended (was allow)
2026-10-28now blocks atlassian-bot (was allow)
2026-10-28now blocks Bytespider (was allow)
2026-10-28now blocks CCBot (was allow)
2026-10-28now blocks Claude-Web (was allow)
2026-10-28now blocks ClaudeBot (was allow)
2026-10-28now blocks cohere-ai (was allow)
2026-10-28now blocks Cotoyogi (was allow)
2026-10-28now blocks Diffbot (was allow)
2026-10-28now blocks Google-CloudVertexBot (was allow)
2026-10-28now blocks Google-Extended (was allow)
2026-10-28now blocks GoogleOther (was allow)
2026-10-28now blocks GPTBot (was allow)
2026-10-28now blocks ICC-Crawler (was allow)
2026-10-28now blocks KimiBot (was allow)
2026-10-28now blocks Meta-ExternalAgent (was allow)
2026-10-28now blocks MistralAI-Training (was allow)
2026-10-28now blocks omgili (was allow)
2026-10-28now blocks PetalBot (was allow)
2026-10-28now blocks QualifiedBot (was allow)
2026-10-28now blocks SemrushBot-SWA (was allow)
2026-10-28now blocks WARDBot (was allow)
2026-10-28Content-Signal lines changed

Reconstructed history (Common Crawl)

No reconstructed history for this site yet.

Evidence

Every daily observation of bblaa.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/bblaa.com