intel.com: what it tells AI crawlers

On 27 October 2026, intel.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot; it also published llms.txt.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.intel.com/robots.txt
unchanged since 2026-10-26 · sha256 930a465dbf2bd43f… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

llms.txt: "Intel Corporation", 12,892 bytes, 64 links.

robots.txt as recorded sha256 3f9eb28d4dccb281…

# robots.txt exclusion for www.intel.com/ - US
User-agent: *
Disallow: /cgi
Disallow: /iaweb/
Disallow: /cpc/vision/
Disallow: /intel/june297/
Disallow: /cpc/eps/
Disallow: /design/june297/
Disallow: /cpc/archive/
Disallow: /cpc/dia/
Disallow: /cpc/ecs/
Disallow: /cpc/fcs/
Disallow: /cpc/gif/
Disallow: /cpc/OptContent/
Disallow: /cpc/pix/
Disallow: /cpc/sound/
Disallow: /cpc/feature/
Disallow: /emergency/
Disallow: /content/www/*/*/buy/intelinside/
Disallow: /content/www/*/*/buy/inteltechnologyprovider/
Disallow: /content/www/*/*/buy/intelproducts/
Disallow: /content/www/*/*/homepage/_jcr_content/
Disallow: /content/data/disclaimers/
Disallow: /content/www/*/*/contentlibrary.html?
Disallow: /content/iip/
Disallow: /*.swf$
Disallow: /*/swf/
Disallow: /content/dam/www/secure/
Disallow: /buy/*/retailers/*
Disallow: /buy/*/catalog/variations/*
Disallow: /buy/ca/en/
Disallow: /buy/ca/fr/
Disallow: /buy/br/pt/
Disallow: /buy/mx/es/
Disallow: /buy/de/de/
Disallow: /buy/es/es/
Disallow: /buy/fr/fr/
Disallow: /buy/it/it/
Disallow: /buy/nl/nl/
Disallow: /buy/pl/pl/
Disallow: /buy/ru/ru/
Disallow: /buy/se/sv/
Disallow: /buy/tr/tr/
Disallow: /buy/ua/uk/
Disallow: /buy/uk/en/
Disallow: /buy/cn/zh/
Disallow: /buy/jp/ja/
Disallow: /buy/sg/en/
Disallow: /buy/au/en/
Disallow: /buy/id/id/
Disallow: /buy/in/en/
Disallow: /buy/kr/ko/
Disallow: /buy/th/th/
Disallow: /buy/tw/zh/
Disallow: /buy/vn/vi/
Disallow: /buy/eg/
Disallow: /buy/ng/
Disallow: /buy/xl/es/
Disallow: /content/www/ca/en/
Disallow: /content/www/ca/fr/
Disallow: /content/www/br/pt/
Disallow: /content/www/xl/es/
Disallow: /content/www/eu/en/
Disallow: /content/www/xe/en/
Disallow: /content/www/ch/de/
Disallow: /content/www/de/de/
Disallow: /content/www/es/es/
Disallow: /content/www/fr/fr/
Disallow: /content/www/ie/en/
Disallow: /content/www/it/it/
Disallow: /content/www/nl/nl/
Disallow: /content/www/pl/pl/
Disallow: /content/www/ru/ru/
Disallow: /content/www/se/sv/
Disallow: /content/www/tr/tr/
Disallow: /content/www/ua/uk/
Disallow: /content/www/uk/en/
Disallow: /content/www/cn/zh/
Disallow: /content/www/jp/ja/
Disallow: /content/www/xa/en/
Disallow: /content/www/au/en/
Disallow: /content/www/id/id/
Disallow: /content/www/in/en/
Disallow: /content/www/kr/ko/
Disallow: /content/www/th/th/
Disallow: /content/www/tw/zh/
Disallow: /content/www/vn/vi/
Disallow: /content/www/sg/en/
Disallow: /content/www/za/en/
Disallow: /content/www/me/

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of intel.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/intel.com