ameblo.jp: what it tells AI crawlers

On 27 October 2026, ameblo.jp's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://ameblo.jp/robots.txt
unchanged since 2026-10-26 · sha256 3d6d58d8713dd7d7… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

robots.txt as recorded sha256 e34a926478da13fa…

User-agent: Googlebot
# /:amebaId/*
Disallow: /*/page-*.html
Allow: /*/entry-*.html
Allow: /*/entry*-*.html
Allow: /*/entrylist.html
Allow: /*/entrylist-*.html
Disallow: /*/amemberentrylist.html
Disallow: /*/amemberentrylist-*.html
Disallow: /*/amemberentry-*.html
Disallow: /*/archivetop.html
Disallow: /*/imagelist.html
Disallow: /*/imagelist-*.html
Disallow: /*/image-*.html
Disallow: /*/comment-*
Disallow: /*/reblog-*
Disallow: /*/message-board.html
Disallow: /*/reader.html
Disallow: /*/reader-*.html
Disallow: /*/favorite.html
Disallow: /*/favorite-*.html
Disallow: /*/bookmark.html
Disallow: /*/bookmark-*.html
Disallow: /*/entry-preview/*
Disallow: /*/day*.html
Disallow: /*/iine_entry-*.html
Disallow: /*/skin-preview/*
# embed
Disallow: /p/embed/*
Disallow: /s/embed/*
# video
Allow: /*/video-*.html$
Allow: /*/videolist.html
Allow: /*/videolist-*.html
Disallow: /*/video-*.html?*vnm=*
# api
Disallow: /_api/*
Allow: /_api/readerCount*
Allow: /_api/blogEntryReactions*
Allow: /_api/blogger*
Allow: /_api/officialSecondaryCategory*
Allow: /_api/rankingOfficial*
Allow: /_api/genreRankingEntry*
Allow: /_api/bloggerPaidPlanFeature*
Allow: /_api/adPickInreadBanner*
Allow: /_api/mypick*
Allow: /_api/blogRecentEntry*
Allow: /_api/blogEntry*
# old paths
Disallow: /error-status/*
Disallow: /summary/api/
Disallow: /accesslog/BlogAccessLog
Disallow: /_hook/*.html
# others
Disallow: /health-check/*
Disallow: /.sxg
Disallow: /.well-known/*
Disallow: /_shell/*
Disallow: /_static/*

User-agent: bingbot
Crawl-delay: 1

Sitemap: https://ameblo.jp/sitemap_index.xml

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of ameblo.jp is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/ameblo.jp