olhardigital.com.br: what it tells AI crawlers

On 27 October 2026, olhardigital.com.br's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 10k (Tranco)

robots.txt

ok (HTTP 200) · https://olhardigital.com.br/robots.txt
unchanged since 2026-10-27 · sha256 ec97c20304f7970a… · view as recorded

The * group

partial applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

robots.txt as recorded sha256 bb9023a3083a3f21…

User-agent: *
Sitemap: https://olhardigital.com.br/sitemap/sitemap.xml
Sitemap: https://olhardigital.com.br/sitemap-news.xml

Disallow: /wp-admin/
Disallow: /search/
Disallow: /entrar/
Disallow: /af/
Disallow: /sq/
Disallow: /am/
Disallow: /ar/
Disallow: /hy/
Disallow: /az/
Disallow: /eu/
Disallow: /be/
Disallow: /bn/
Disallow: /bs/
Disallow: /bg/
Disallow: /ca/
Disallow: /ceb/
Disallow: /ny/
Disallow: /zh-CN/
Disallow: /zh-TW/
Disallow: /co/
Disallow: /hr/
Disallow: /cs/
Disallow: /da/
Disallow: /nl/
Disallow: /en/
Disallow: /eo/
Disallow: /et/
Disallow: /tl/
Disallow: /fi/
Disallow: /fr/
Disallow: /fy/
Disallow: /gl/
Disallow: /ka/
Disallow: /de/
Disallow: /el/
Disallow: /gu/
Disallow: /ht/
Disallow: /ha/
Disallow: /haw/
Disallow: /iw/
Disallow: /hi/
Disallow: /hmn/
Disallow: /hu/
Disallow: /is/
Disallow: /ig/
Disallow: /id/
Disallow: /ga/
Disallow: /it/
Disallow: /ja/
Disallow: /jw/
Disallow: /kn/
Disallow: /kk/
Disallow: /km/
Disallow: /ko/
Disallow: /ku/
Disallow: /ky/
Disallow: /lo/
Disallow: /la/
Disallow: /lv/
Disallow: /lt/
Disallow: /lb/
Disallow: /mk/
Disallow: /mg/
Disallow: /ms/
Disallow: /ml/
Disallow: /mt/
Disallow: /mi/
Disallow: /mr/
Disallow: /mn/
Disallow: /my/
Disallow: /ne/
Disallow: /no/
Disallow: /ps/
Disallow: /fa/
Disallow: /pl/
Disallow: /pa/
Disallow: /ro/
Disallow: /ru/
Disallow: /sm/
Disallow: /gd/
Disallow: /sr/
Disallow: /st/
Disallow: /sn/
Disallow: /sd/
Disallow: /si/
Disallow: /sk/
Disallow: /sl/
Disallow: /so/
Disallow: /es/
Disallow: /su/
Disallow: /sw/
Disallow: /sv/
Disallow: /tg/
Disallow: /ta/
Disallow: /te/
Disallow: /th/
Disallow: /tr/
Disallow: /uk/
Disallow: /ur/
Disallow: /uz/
Disallow: /vi/
Disallow: /cy/
Disallow: /xh/
Disallow: /yi/
Disallow: /yo/
Disallow: /zu/


Allow: /wp-admin/admin-ajax.php

User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Google-Extended
Disallow: /

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of olhardigital.com.br is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/olhardigital.com.br