nike.com: what it tells AI crawlers

On 28 October 2026, nike.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-29 03:59 UTC (daily run of 2026-10-28). Proof for that day.

Panel
top 1k (Tranco)
robots.txt
ok (HTTP 200) · https://www.nike.com/robots.txt
unchanged since 2026-10-26 · sha256 54ba534bff9e8b4c… · view as recorded
The * group
partial applies to every agent without its own group

Per AI bot, 2026-10-28

User agentVerdictHow
GPTBotpartialthrough the * group
OAI-SearchBotpartialthrough the * group
ChatGPT-Userpartialthrough the * group
ClaudeBotpartialthrough the * group
Claude-SearchBotpartialthrough the * group
Claude-Userpartialthrough the * group
PerplexityBotpartialthrough the * group
Perplexity-Userpartialthrough the * group
Googlebotpartialthrough the * group
Google-Extendedpartialthrough the * group
Applebot-Extendedpartialthrough the * group
CCBotpartialthrough the * group
Bytespiderpartialthrough the * group
Meta-ExternalAgentpartialthrough the * group
Amazonbotpartialthrough the * group

Other signals

Publishes /llms.txtno
Publishes /ai.txtno
Publishes /.well-known/tdmrep.jsonno
Reserves TDM rights (TDMRep file, header or meta)no
Declares Content Signals (robots.txt or header)no
Says ai-train=no in a Content Signalno
Points to an RSL licence (robots.txt License line or Link header)no
Answers with an x402 payment offer (lower bound: only the homepage is probed)no
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)no
Sends noai / noimageai directivesno
Refused our fetcher (403 / challenge)no

robots.txt as recorded sha256 8a8ad22f88bf13ce…

# https://www.nike.com robots.txt -- just crawl it.

User-agent: *
Disallow: /us/en_cs/
Disallow: /il/en_il/
Disallow: /us/en_eu/
Disallow: */member/inbox/
Disallow: */n/
Disallow: */p/
Disallow: */checkout/
Disallow: */w?q=
Disallow: /*.swf$
Disallow: /*.pdf$
Disallow: /ar/help/
Disallow: /br/help/
Disallow: /hk/help/
Disallow: /kr/help/
Disallow: /ph/help/
Disallow: /uy/help/
Disallow: /xf/help/
Disallow: /xl/help/
Disallow: /xm/help/


User-agent: Baiduspider
Disallow: /ae/
Disallow: /ar/
Disallow: /at/
Disallow: /au/
Disallow: /be/
Disallow: /bg/
Disallow: /br/
Disallow: /BR/
Disallow: /ca/
Disallow: /ch/
Disallow: /cl/
Disallow: /cz/
Disallow: /de/
Disallow: /dk/
Disallow: /eg/
Disallow: /es/
Disallow: /fi/
Disallow: /fr/
Disallow: /gb/
Disallow: /gr/
Disallow: /hk/
Disallow: /hr/
Disallow: /hu/
Disallow: /id/
Disallow: /ie/
Disallow: /il/
Disallow: /in/
Disallow: /it/
Disallow: /jp/
Disallow: /kr/
Disallow: /lu/
Disallow: /ma/
Disallow: /mx/
Disallow: /my/
Disallow: /nl/
Disallow: /no/
Disallow: /nz/
Disallow: /ph/
Disallow: /pl/
Disallow: /pr/
Disallow: /pt/
Disallow: /ro/
Disallow: /ru/
Disallow: /sa/
Disallow: /se/
Disallow: /sg/
Disallow: /si/
Disallow: /sk/
Disallow: /th/
Disallow: /tr/
Disallow: /tw/
Disallow: /us/
Disallow: /uy/
Disallow: /vn/
Disallow: /xf/
Disallow: /xl/
Disallow: /xm/
Disallow: /za/
 
User-agent: HaoSouSpider
Disallow: /ae/
Disallow: /ar/
Disallow: /at/
Disallow: /au/
Disallow: /be/
Disallow: /bg/
Disallow: /br/
Disallow: /BR/
Disallow: /ca/
Disallow: /ch/
Disallow: /cl/
Disallow: /cz/
Disallow: /de/
Disallow: /dk/
Disallow: /eg/
Disallow: /es/
Disallow: /fi/
Disallow: /fr/
Disallow: /gb/
Disallow: /gr/
Disallow: /hk/
Disallow: /hr/
Disallow: /hu/
Disallow: /id/
Disallow: /ie/
Disallow: /il/
Disallow: /in/
Disallow: /it/
Disallow: /jp/
Disallow: /kr/
Disallow: /lu/
Disallow: /ma/
Disallow: /mx/
Disallow: /my/
Disallow: /nl/
Disallow: /no/
Disallow: /nz/
Disallow: /ph/
Disallow: /pl/
Disallow: /pr/
Disallow: /pt/
Disallow: /ro/
Disallow: /ru/
Disallow: /sa/
Disallow: /se/
Disallow: /sg/
Disallow: /si/
Disallow: /sk/
Disallow: /th/
Disallow: /tr/
Disallow: /tw/
Disallow: /us/
Disallow: /uy/
Disallow: /vn/
Disallow: /xf/
Disallow: /xl/
Disallow: /xm/
Disallow: /za/

User-agent: Sogou web spider
Disallow: /*
Allow: /cn/*

User-agent: Sogou inst spider
Disallow: /*
Allow: /cn/*

User-agent: Sogou spider2
Disallow: /*
Allow: /cn/*

Sitemap: https://www.nike.com/sitemap-c-index.xml
Sitemap: https://www.nike.com/sitemap-pw-index.xml
Sitemap: https://www.nike.com/sitemap-pdp-index.xml
Sitemap: https://www.nike.com/sitemap-launch-index.xml
Sitemap: https://www.nike.com/sitemap-bootroom-index.xml

#                                                                                                    
#                 ``                                                                        ```.`    
#               `+/                                                                 ``.-/+o+:-.      
#             `/mo                                                          ``.-:+syhdhs/-`          
#            -hMd                                                    `..:+oyhmNNmds/-`               
#          `oNMM/                                            ``.-/oyhdmMMMMNdy+:.                    
#         .hMMMM-                                     `.-/+shdmNMMMMMMNdy+:.                         
#        :mMMMMM+                             `.-:+sydmNMMMMMMMMMNmho:.`                             
#       :NMMMMMMN:                    `.-:/oyhmmNMMMMMMMMMMMNmho:.`                                  
#      .NMMMMMMMMNy:`          `.-/oshdmNMMMMMMMMMMMMMMMmhs/-`                                       
#      hMMMMMMMMMMMMmhysooosyhdmNMMMMMMMMMMMMMMMMMMmds/-`                                            
#     .MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.`                                                
#     -MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.`                                                     
#     `NMMMMMMMMMMMMMMMMMMMMMMMMMMMMMmyo:.`                                                          
#      /NMMMMMMMMMMMMMMMMMMMMMMMmho:.`                                                               
#       .yNMMMMMMMMMMMMMMMMmhs/.`                                                                    
#         ./shdmNNmmdhyo/-``                                                                         
#              `````                                                                                 

robots.txt versions

FromThroughStateVersion
2026-10-262026-10-28ok 20054ba534bff9e

Timeline of changes

DateWhat changed
No changes since the first observation (2026-10-26).

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

CrawlHostStateGPTBotOAI-SearchBotChatGPT-UserClaudeBotClaude-SearchBotClaude-UserPerplexityBot
2026-09-21 CC-MAIN-2026-39www.nike.comok viewpartialpartialunknownpartialpartialunknownpartial
2025-09-15 CC-MAIN-2025-38www.nike.comok viewpartialpartialunknownpartialpartialunknownpartial
2024-09-16 CC-MAIN-2024-38www.nike.comok viewpartialpartialunknownpartialpartialunknownpartial
2023-10-02 CC-MAIN-2023-40www.nike.comok viewpartialpartialunknownpartialpartialunknownpartial
2022-10-03 CC-MAIN-2022-40www.nike.comok viewpartialpartialunknownpartialpartialunknownpartial
2021-09-27 CC-MAIN-2021-39www.nike.comok viewpartialpartialunknownpartialpartialunknownpartial
2020-09-28 CC-MAIN-2020-40www.nike.comok viewpartialpartialunknownpartialpartialunknownpartial
2019-09-23 CC-MAIN-2019-39www.nike.comok viewpartialpartialunknownpartialpartialunknownpartial
2018-10-22 CC-MAIN-2018-43www.nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2018-09-24 CC-MAIN-2018-39www.nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2018-07-23 CC-MAIN-2018-30www.nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2018-04-23 CC-MAIN-2018-17www.nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2018-01-29 CC-MAIN-2018-05www.nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2017-10-23 CC-MAIN-2017-43www.nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2017-09-25 CC-MAIN-2017-39www.nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2017-07-24 CC-MAIN-2017-30www.nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2017-04-24 CC-MAIN-2017-17nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2017-01-23 CC-MAIN-2017-04nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2016-10-03 CC-MAIN-2016-40nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown
2016-09-05 CC-MAIN-2016-36nike.comfetch-blockedunknownunknownunknownunknownunknownunknownunknown

Evidence

Every daily observation of nike.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-28: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973640)).

API: https://infrarabbit.com/crawlers/api/v1/policy/nike.com