vimeo.com: what it tells AI crawlers

On 27 October 2026, vimeo.com's robots.txt fully blocked CCBot and partly blocked GPTBot, ClaudeBot and Google-Extended.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel
top 1k (Tranco)
robots.txt
ok (HTTP 200) · https://vimeo.com/robots.txt
unchanged since 2026-10-27 · sha256 b076c41a641a33ac… · view as recorded
The * group
allows applies to every agent without its own group

Per AI bot, 2026-10-27

User agentVerdictHow
GPTBotpartialnamed in its own group
OAI-SearchBotallowsthrough the * group
ChatGPT-Userallowsthrough the * group
ClaudeBotpartialnamed in its own group
Claude-SearchBotallowsthrough the * group
Claude-Userallowsthrough the * group
PerplexityBotallowsthrough the * group
Perplexity-Userallowsthrough the * group
Googlebotallowsthrough the * group
Google-Extendedpartialnamed in its own group
Applebot-Extendedallowsthrough the * group
CCBotblocksnamed in its own group
Bytespiderblocksnamed in its own group
Meta-ExternalAgentallowsthrough the * group
Amazonbotallowsthrough the * group
anthropic-aipartialnamed in its own group
Claude-Webpartialnamed in its own group
Diffbotblocksnamed in its own group
FacebookBotblocksnamed in its own group
ImagesiftBotblocksnamed in its own group
omgiliblocksnamed in its own group
omgilibotblocksnamed in its own group

Other signals

Publishes /llms.txtno
Publishes /ai.txtno
Publishes /.well-known/tdmrep.jsonno
Reserves TDM rights (TDMRep file, header or meta)no
Declares Content Signals (robots.txt or header)no
Says ai-train=no in a Content Signalno
Points to an RSL licence (robots.txt License line or Link header)no
Answers with an x402 payment offer (lower bound: only the homepage is probed)no
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)no
Sends noai / noimageai directivesno
Refused our fetcher (403 / challenge)no

robots.txt as recorded sha256 31e14d3729f587d5…

# You know, for robots
#
# robots@vimeo.com

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: */format:thumbnail
Disallow: /download/
Disallow: /*/download?
Disallow: /couchmode/
Disallow: /groups/*/forum/*
Disallow: /musicstore/preview
Disallow: /musicstore/download
Disallow: /forgot_password
Disallow: /help/forgot_login
Disallow: /help/verify_email
Disallow: /help/zendesk_sso
Disallow: /help/sso
Disallow: /user/verify
Disallow: /search
Disallow: /_*
Allow: /_rv/viewer
Allow: /_next/viewer
Allow: /_rv/gtm
Allow: /_next/gtm
Allow: /_global_notifications
Allow: /_rv/jwt
Allow: /_next/jwt
Allow: /_rv/title
Allow: /_next/title
Crawl-delay: 2

User-agent: SeznamBot
Request-rate: 1/10s
Disallow: */format:thumbnail
Disallow: /download/
Disallow: /*/download?
Disallow: /couchmode/
Disallow: /musicstore/preview
Disallow: /musicstore/download
Disallow: /forgot_password
Disallow: /help/forgot_login
Disallow: /help/verify_email
Disallow: /help/zendesk_sso
Disallow: /help/sso
Disallow: /api/
Disallow: /user/verify
Disallow: /search/
Disallow: /search?
Disallow: /search\?
Disallow: /_*

User-agent: msnbot
Crawl-delay: 5

User-agent: Bingbot
Crawl-delay: 5

User-agent: AdIdxBot
Crawl-delay: 5

User-agent: BingPreview
Crawl-delay: 5

User-agent: Yandex
Crawl-delay: 2

# Block Open AI
User-agent: GPTBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /

# Block Google (Gemini)
User-agent: Google-Extended
Disallow: /

# Block Claude
User-agent: anthropic-ai
Disallow: /
User-agent: Claude-Web
Disallow: /
User-agent: Claudebot
Disallow: /

# Block CommonCrawl
User-agent: CCBot
Disallow: /

# Block Diffbot
User-agent: Diffbot
Disallow: /

# Block Meta (Facebook)
User-agent: FacebookBot
Disallow: /

# Block ByteDance
User-agent: Bytespider
Disallow: /

# Block Webz.io
User-agent: Omgilibot
Disallow: /
User-agent: Omgili
Disallow: /

# Block ImagesiftBot
User-agent: ImagesiftBot
Disallow: /

# Block Meltwater
User-agent: Meltwater
Disallow: /

# Block Seekr
User-agent: Seekr
Disallow: /

robots.txt versions

FromThroughStateVersion
2026-10-272026-10-27ok 200b076c41a641adiff with previous
2026-10-262026-10-26ok 200021ea0af6b29

Timeline of changes

DateWhat changed
2026-10-27robots.txt changed

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

CrawlHostStateGPTBotOAI-SearchBotChatGPT-UserClaudeBotClaude-SearchBotClaude-UserPerplexityBot
2026-09-21 CC-MAIN-2026-39vimeo.comok viewpartialallowsunknownpartialallowsunknownallows
2025-09-15 CC-MAIN-2025-38vimeo.comok viewpartialallowsunknownpartialallowsunknownallows
2024-09-16 CC-MAIN-2024-38vimeo.comok viewblocksallowsunknownblocksallowsunknownallows
2023-10-02 CC-MAIN-2023-40vimeo.comok viewblocksallowsunknownallowsallowsunknownallows
2022-10-03 CC-MAIN-2022-40vimeo.comok viewallowsallowsunknownallowsallowsunknownallows
2021-09-27 CC-MAIN-2021-39vimeo.comok viewallowsallowsunknownallowsallowsunknownallows
2020-09-28 CC-MAIN-2020-40vimeo.comok viewallowsallowsunknownallowsallowsunknownallows
2019-09-23 CC-MAIN-2019-39vimeo.comok viewallowsallowsunknownallowsallowsunknownallows
2018-09-24 CC-MAIN-2018-39vimeo.comok viewallowsallowsunknownallowsallowsunknownallows
2017-09-25 CC-MAIN-2017-39vimeo.comok viewallowsallowsunknownallowsallowsunknownallows
2017-01-23 CC-MAIN-2017-04vimeo.comok viewallowsallowsunknownallowsallowsunknownallows
2016-10-03 CC-MAIN-2016-40vimeo.comok viewallowsallowsunknownallowsallowsunknownallows
2016-09-05 CC-MAIN-2016-36vimeo.comok viewallowsallowsunknownallowsallowsunknownallows

Evidence

Every daily observation of vimeo.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/vimeo.com