note.com: what it tells AI crawlers

On 27 October 2026, note.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://note.com/robots.txt
unchanged since 2026-10-26 · sha256 6ce52a654f74e7a4… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

robots.txt as recorded sha256 6ce52a654f74e7a4…

User-agent: *
Disallow: /embed/*
Disallow: /intent/*
Disallow: /preview/*
Disallow: /api/*
Disallow: /pdf/*
Disallow: /wrap_up/*
Disallow: /search
Disallow: /login?*
Disallow: /signup?*
Disallow: /m/*/archive

# /:urlname/~
Disallow: /*/archives
Disallow: /*/archives/*
Disallow: /*/followers
Disallow: /*/followings
Disallow: /*/likes
Disallow: /*/magazines
Disallow: /*/menu/*
Disallow: /*/message
Disallow: /*/terms/specified

User-agent: Googlebot
User-agent: bingbot
User-agent: Yeti
Disallow: /*/message
Disallow: /login?*
Disallow: /signup?*
Disallow: /embed/*
Disallow: /*/archives
Disallow: /*/archives/*
Disallow: /*/terms/specified
Disallow: /api/v2/boards/*/reserved_posts
Disallow: /api/v2/attachments
Disallow: /*/rss
Disallow: /intent/*
Disallow: /wrap_up/*
Disallow: /preview/*
Disallow: /search

User-agent: Twitterbot
Disallow: /*/message
Disallow: /*/terms/specified
Disallow: /*/menu/*
Disallow: /embed/*
Disallow: /intent/*
Disallow: /preview/*
Disallow: /api/*
Disallow: /pdf/*
Allow: /wrap_up/*

User-agent: Livelapbot
Disallow: /

User-agent: Megalodon
Disallow: /

User-agent: ia_archiver
Disallow: /

Sitemap: https://note.com/sitemaps/production/note.com/sitemap.xml.gz

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of note.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/note.com