intel.com: what it tells AI crawlers

On 27 October 2026, intel.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot; it also published llms.txt.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.intel.com/robots.txt
unchanged since 2026-10-26 · sha256 930a465dbf2bd43f… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

llms.txt: "Intel Corporation", 12,892 bytes, 64 links.

robots.txt as recorded sha256 930a465dbf2bd43f…

# robots.txt exclusion for www.intel.com/ - US

User-agent: OmtrBot/1.0
Allow: /content/www/us/en/products/devices-systems/
Allow: /content/dam/products/
Allow: /libs/apps/intel/services/productseedlist
Disallow: /cgi
Disallow: /iaweb/
Disallow: /cpc/vision/
Disallow: /intel/june297/
Disallow: /cpc/eps/
Disallow: /design/june297/
Disallow: /cpc/archive/
Disallow: /cpc/dia/
Disallow: /cpc/ecs/
Disallow: /cpc/fcs/
Disallow: /cpc/gif/
Disallow: /cpc/OptContent/
Disallow: /cpc/pix/
Disallow: /cpc/sound/
Disallow: /cpc/feature/
Disallow: /emergency/
Disallow: /content/www/*/*/buy/intelinside/
Disallow: /content/www/*/*/buy/inteltechnologyprovider/
Disallow: /content/www/*/*/buy/intelproducts/
Disallow: /content/www/*/*/homepage/_jcr_content/
Disallow: /content/www/*/*/test/
Disallow: /content/data/disclaimers/
Disallow: /content/www/*/*/contentlibrary.html?
Disallow: /content/iip/
Disallow: /content/dam/altera-www/global/*/pdfs/assets/
Disallow: /content/dam/www/programmable/*/*/pdfs/assets/
Disallow: /content/dam/www/public/*/forms/
Disallow: /*.swf$
Disallow: /*/swf/
Disallow: /*/secure/
Disallow: /*/wp-expand-server-memory-with-optane*.pdf$
Disallow: /*/wp-01288-intel-fpgas-accelerate-intel-xeon-scalable*.pdf$
Disallow: /content/dam/www/secure/

# GEO: Allow all major AI crawlers — supports brand citation in AI-generated answers

User-agent: GPTBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: anthropic-ai
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: *
Allow: /llms.txt
Allow: /llms-full.txt
Allow: /content/dam/products/catalog/
Allow: /content/dam/products/hero/
Disallow: /cgi
Disallow: /iaweb/
Disallow: /cpc/vision/
Disallow: /intel/june297/
Disallow: /cpc/eps/
Disallow: /design/june297/
Disallow: /cpc/archive/
Disallow: /cpc/dia/
Disallow: /cpc/ecs/
Disallow: /cpc/fcs/
Disallow: /cpc/gif/
Disallow: /cpc/OptContent/
Disallow: /cpc/pix/
Disallow: /cpc/sound/
Disallow: /cpc/feature/
Disallow: /emergency/
Disallow: /content/www/*/*/buy/intelinside/
Disallow: /content/www/*/*/buy/inteltechnologyprovider/
Disallow: /content/www/*/*/buy/intelproducts/
Disallow: /content/www/*/*/homepage/_jcr_content/
Disallow: /content/www/*/*/test/
Disallow: /content/data/disclaimers/
Disallow: /content/www/*/*/contentlibrary.html?
Disallow: /content/iip/
Disallow: /content/dam/altera-www/global/*/pdfs/assets/
Disallow: /content/dam/www/programmable/*/*/pdfs/assets/
Disallow: /content/dam/www/public/*/forms/
Disallow: /content/dam/products/
Disallow: /libs/apps/intel/services/productseedlist
Disallow: /now/
Disallow: /*countrylabel=*&countrylabel=*
Disallow: /*&_escaped_fragment_=*
Disallow: /*.swf$
Disallow: /*/swf/
Disallow: /*/secure/
Disallow: /*/wp-expand-server-memory-with-optane*.pdf$
Disallow: /*/wp-01288-intel-fpgas-accelerate-intel-xeon-scalable*.pdf$
Disallow: /content/dam/www/secure/
Disallow: /content/www/br/pt/
Disallow: /content/www/xl/es/
Disallow: /content/www/de/de/
Disallow: /content/www/es/es/
Disallow: /content/www/fr/fr/
Disallow: /content/www/jp/ja/
Disallow: /content/www/id/id/
Disallow: /content/www/kr/ko/
Disallow: /content/www/th/th/
Disallow: /content/www/tw/zh/
Disallow: /content/www/vn/vi/

User-agent: SEOkicks
Crawl-Delay: 10

User-agent: coccocbot
Crawl-Delay: 10

User-agent: AhrefsBot
Crawl-Delay: 10

User-agent: SemrushBot
Crawl-Delay: 10

User-agent: trendictionbot
Crawl-Delay: 10

User-agent: serpstatbot
Crawl-Delay: 10

User-agent: startmebot
Crawl-Delay: 10

User-agent: HatenaBlog-bot
Crawl-Delay: 10

User-agent: Cincraw
Crawl-Delay: 10

User-agent: InfoTigerBot
Crawl-Delay: 10

User-agent: snapchat
Crawl-Delay: 10

User-agent: Superfeedr
Crawl-Delay: 10

User-agent: YaK
Crawl-Delay: 10

User-agent: digitalshadowsbot
Crawl-Delay: 10

User-agent: Magus
Crawl-Delay: 10

User-agent: Quora-Bot
Crawl-Delay: 10

User-agent: INETDEX-BOT
Crawl-Delay: 10

User-agent: DataForSeoBot
Crawl-Delay: 10

User-agent: SerendeputyBot
Crawl-Delay: 10

User-agent: Deskyobot
Crawl-Delay: 10

User-agent: MJ12bot
Crawl-Delay: 10

User-agent: BrightEdge
Crawl-Delay: 10

User-agent: ICC-Crawler
Disallow: /

Sitemap: https://www.intel.com/sitemap.xml

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of intel.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/intel.com