behance.net: what it tells AI crawlers

On 28 October 2026, behance.net's robots.txt fully blocked GPTBot, ClaudeBot, Google-Extended and CCBot.

Last verified 2026-10-29 03:59 UTC (daily run of 2026-10-28). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.behance.net/robots.txt
unchanged since 2026-10-26 · sha256 1a55abe2475b1430… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-28

Other signals

robots.txt as recorded sha256 1a55abe2475b1430…

Sitemap: https://www.behance.net/sitemap

# Disallow AI bots
User-agent: AI2Bot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCbot
User-agent: Claude-Web
User-agent: ClaudeBot
User-agent: cohere-training-data-crawler
User-agent: Diffbot
User-agent: FacebookBot
User-agent: Google-Extended
User-agent: GPTBot
User-agent: ImagesiftBot
User-agent: Kangaroo Bot
User-agent: Meta-ExternalAgent
User-agent: Omgili
User-agent: Omgilibot
User-agent: PanguBot
User-agent: Timpibot
User-agent: Webzio-Extended
Disallow: /

User-agent: *
Disallow: /v2/
Disallow: /v3/
Disallow: /log$
Disallow: /search/*?*assetsCategory=*
Disallow: /search/*?*assetsPriceTier=*
Disallow: /search/*?*assetsExtensionTypes=*
Disallow: /search/*?*color_hex=*
Disallow: /search/*?*country=*
Disallow: /search/*?*exif_aperture=*
Disallow: /search/*?*exif_focal_length=*
Disallow: /search/*?*exif_lens_brand=*
Disallow: /search/*?*exif_make=*
Disallow: /search/*?*exif_shutter_speed=*
Disallow: /search/*?*exif_zoom=*
Disallow: /search/*?*field=*
Disallow: /search/*?*gif=*
Disallow: /search/*?*premium=*
Disallow: /search/*?*sort=*
Disallow: /search/*?*schools=*
Disallow: /search/*?*tools=*
Disallow: /search/*?*time=*
Disallow: /search/*?*userAvailability=*
Disallow: /hire/browse
Disallow: /*/undefined

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of behance.net is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-28: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973640)).

API: https://infrarabbit.com/crawlers/api/v1/policy/behance.net