MCP server

Remote MCP server (streamable HTTP, stateless, no auth): https://infrarabbit.com/crawlers/mcp. All tools are read-only and answer from the ledger's own database; nothing is fetched live.

ai_policy(domain, date?)

What a website told AI crawlers on a date: verdict per AI bot, llms.txt, TDMRep, Content Signals, RSL, x402, with the day's Merkle root.

bot_block_share(ua, from?, to?)

Share of the top sites blocking an AI user agent per day, plus the reconstructed series since 2016.

recent_changes(since?, ua?, kind?, limit?)

Sites that changed their AI crawler policy, newest first.

Connect

claude mcp add --transport http ai-crawl-ledger https://infrarabbit.com/crawlers/mcp