pinterest.com: what it tells AI crawlers

On 26 October 2026, pinterest.com's robots.txt fully blocked GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-26 21:13 UTC (daily run of 2026-10-26). Proof for that day.

Panel
top 1k (Tranco)
robots.txt
ok (HTTP 200) · https://www.pinterest.com/robots.txt
unchanged since 2026-10-26 · sha256 539891c099eacc58… · view as recorded
The * group
blocks applies to every agent without its own group

Per AI bot, 2026-10-26

User agentVerdictHow
GPTBotblocksthrough the * group
OAI-SearchBotblocksthrough the * group
ChatGPT-Userblocksthrough the * group
ClaudeBotblocksthrough the * group
Claude-SearchBotblocksthrough the * group
Claude-Userblocksthrough the * group
PerplexityBotblocksthrough the * group
Perplexity-Userblocksthrough the * group
Googlebotallowsnamed in its own group
Google-Extendedblocksthrough the * group
Applebot-Extendedblocksthrough the * group
CCBotblocksthrough the * group
Bytespiderblocksthrough the * group
Meta-ExternalAgentblocksthrough the * group
Amazonbotblocksthrough the * group
Applebotallowsnamed in its own group
Awarioallowsnamed in its own group
Bravebotallowsnamed in its own group
CloudflareBrowserRenderingCrawlerallowsnamed in its own group
DuckAssistBotallowsnamed in its own group
FacebookBotallowsnamed in its own group
facebookexternalhitallowsnamed in its own group
Google-Firebaseallowsnamed in its own group
Google-NotebookLMallowsnamed in its own group
QualifiedBotallowsnamed in its own group
SemrushBot-OCOBallowsnamed in its own group
SemrushBot-SWAallowsnamed in its own group
YaKallowsnamed in its own group
YandexAdditionalblocksnamed in its own group
YandexAdditionalBotblocksnamed in its own group

Other signals

Publishes /llms.txtnot observed
Publishes /ai.txtnot observed
Publishes /.well-known/tdmrep.jsonnot observed
Reserves TDM rights (TDMRep file, header or meta)not observed
Declares Content Signals (robots.txt or header)not observed
Says ai-train=no in a Content Signalnot observed
Points to an RSL licence (robots.txt License line or Link header)not observed
Answers with an x402 payment offer (lower bound: only the homepage is probed)not observed
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)not observed
Sends noai / noimageai directivesnot observed
Refused our fetcher (403 / challenge)no

robots.txt versions

FromThroughStateVersion
2026-10-272026-10-27ok 2006d279ad829c5diff with previous
2026-10-262026-10-26ok 200539891c099ea

Timeline of changes

DateWhat changed
2026-10-27robots.txt changed

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

CrawlHostStateGPTBotOAI-SearchBotChatGPT-UserClaudeBotClaude-SearchBotClaude-UserPerplexityBot
2026-09-21 CC-MAIN-2026-39www.pinterest.comok viewblocksblocksunknownblocksblocksunknownblocks
2024-09-16 CC-MAIN-2024-38www.pinterest.comok viewblocksallowsunknownblocksallowsunknownallows
2023-10-02 CC-MAIN-2023-40www.pinterest.comok viewblocksallowsunknownallowsallowsunknownallows
2022-10-03 CC-MAIN-2022-40www.pinterest.comok viewallowsallowsunknownallowsallowsunknownallows
2021-09-27 CC-MAIN-2021-39www.pinterest.comok viewallowsallowsunknownallowsallowsunknownallows
2020-09-28 CC-MAIN-2020-40www.pinterest.comok viewallowsallowsunknownallowsallowsunknownallows
2019-09-23 CC-MAIN-2019-39www.pinterest.comok viewallowsallowsunknownallowsallowsunknownallows
2018-09-24 CC-MAIN-2018-39www.pinterest.comok viewallowsallowsunknownallowsallowsunknownallows
2017-09-25 CC-MAIN-2017-39www.pinterest.comok viewallowsallowsunknownallowsallowsunknownallows
2016-09-05 CC-MAIN-2016-36pinterest.comok viewallowsallowsunknownallowsallowsunknownallows

Evidence

Every daily observation of pinterest.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-26: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973294)).

API: https://infrarabbit.com/crawlers/api/v1/policy/pinterest.com