nike.com: what it tells AI crawlers
On 28 October 2026, nike.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.
Last verified 2026-10-29 03:59 UTC (daily run of 2026-10-28). Proof for that day.
- Panel
- top 1k (Tranco)
- robots.txt
- ok (HTTP 200) · https://www.nike.com/robots.txt
unchanged since 2026-10-26 · sha25654ba534bff9e8b4c…· view as recorded - The * group
- partial applies to every agent without its own group
Per AI bot, 2026-10-28
| User agent | Verdict | How |
|---|---|---|
| GPTBot | partial | through the * group |
| OAI-SearchBot | partial | through the * group |
| ChatGPT-User | partial | through the * group |
| ClaudeBot | partial | through the * group |
| Claude-SearchBot | partial | through the * group |
| Claude-User | partial | through the * group |
| PerplexityBot | partial | through the * group |
| Perplexity-User | partial | through the * group |
| Googlebot | partial | through the * group |
| Google-Extended | partial | through the * group |
| Applebot-Extended | partial | through the * group |
| CCBot | partial | through the * group |
| Bytespider | partial | through the * group |
| Meta-ExternalAgent | partial | through the * group |
| Amazonbot | partial | through the * group |
Other signals
| Publishes /llms.txt | no |
| Publishes /ai.txt | no |
| Publishes /.well-known/tdmrep.json | no |
| Reserves TDM rights (TDMRep file, header or meta) | no |
| Declares Content Signals (robots.txt or header) | no |
| Says ai-train=no in a Content Signal | no |
| Points to an RSL licence (robots.txt License line or Link header) | no |
| Answers with an x402 payment offer (lower bound: only the homepage is probed) | no |
| Answers HTTP 402 Payment Required (lower bound: only the homepage is probed) | no |
| Sends noai / noimageai directives | no |
| Refused our fetcher (403 / challenge) | no |
robots.txt as recorded sha256 8a8ad22f88bf13ce…
# https://www.nike.com robots.txt -- just crawl it. User-agent: * Disallow: /us/en_cs/ Disallow: /il/en_il/ Disallow: /us/en_eu/ Disallow: */member/inbox/ Disallow: */n/ Disallow: */p/ Disallow: */checkout/ Disallow: */w?q= Disallow: /*.swf$ Disallow: /*.pdf$ Disallow: /ar/help/ Disallow: /br/help/ Disallow: /hk/help/ Disallow: /kr/help/ Disallow: /ph/help/ Disallow: /uy/help/ Disallow: /xf/help/ Disallow: /xl/help/ Disallow: /xm/help/ User-agent: Baiduspider Disallow: /ae/ Disallow: /ar/ Disallow: /at/ Disallow: /au/ Disallow: /be/ Disallow: /bg/ Disallow: /br/ Disallow: /BR/ Disallow: /ca/ Disallow: /ch/ Disallow: /cl/ Disallow: /cz/ Disallow: /de/ Disallow: /dk/ Disallow: /eg/ Disallow: /es/ Disallow: /fi/ Disallow: /fr/ Disallow: /gb/ Disallow: /gr/ Disallow: /hk/ Disallow: /hr/ Disallow: /hu/ Disallow: /id/ Disallow: /ie/ Disallow: /il/ Disallow: /in/ Disallow: /it/ Disallow: /jp/ Disallow: /kr/ Disallow: /lu/ Disallow: /ma/ Disallow: /mx/ Disallow: /my/ Disallow: /nl/ Disallow: /no/ Disallow: /nz/ Disallow: /ph/ Disallow: /pl/ Disallow: /pr/ Disallow: /pt/ Disallow: /ro/ Disallow: /ru/ Disallow: /sa/ Disallow: /se/ Disallow: /sg/ Disallow: /si/ Disallow: /sk/ Disallow: /th/ Disallow: /tr/ Disallow: /tw/ Disallow: /us/ Disallow: /uy/ Disallow: /vn/ Disallow: /xf/ Disallow: /xl/ Disallow: /xm/ Disallow: /za/ User-agent: HaoSouSpider Disallow: /ae/ Disallow: /ar/ Disallow: /at/ Disallow: /au/ Disallow: /be/ Disallow: /bg/ Disallow: /br/ Disallow: /BR/ Disallow: /ca/ Disallow: /ch/ Disallow: /cl/ Disallow: /cz/ Disallow: /de/ Disallow: /dk/ Disallow: /eg/ Disallow: /es/ Disallow: /fi/ Disallow: /fr/ Disallow: /gb/ Disallow: /gr/ Disallow: /hk/ Disallow: /hr/ Disallow: /hu/ Disallow: /id/ Disallow: /ie/ Disallow: /il/ Disallow: /in/ Disallow: /it/ Disallow: /jp/ Disallow: /kr/ Disallow: /lu/ Disallow: /ma/ Disallow: /mx/ Disallow: /my/ Disallow: /nl/ Disallow: /no/ Disallow: /nz/ Disallow: /ph/ Disallow: /pl/ Disallow: /pr/ Disallow: /pt/ Disallow: /ro/ Disallow: /ru/ Disallow: /sa/ Disallow: /se/ Disallow: /sg/ Disallow: /si/ Disallow: /sk/ Disallow: /th/ Disallow: /tr/ Disallow: /tw/ Disallow: /us/ Disallow: /uy/ Disallow: /vn/ Disallow: /xf/ Disallow: /xl/ Disallow: /xm/ Disallow: /za/ User-agent: Sogou web spider Disallow: /* Allow: /cn/* User-agent: Sogou inst spider Disallow: /* Allow: /cn/* User-agent: Sogou spider2 Disallow: /* Allow: /cn/* Sitemap: https://www.nike.com/sitemap-c-index.xml Sitemap: https://www.nike.com/sitemap-pw-index.xml Sitemap: https://www.nike.com/sitemap-pdp-index.xml Sitemap: https://www.nike.com/sitemap-launch-index.xml Sitemap: https://www.nike.com/sitemap-bootroom-index.xml # # `` ```.` # `+/ ``.-/+o+:-. # `/mo ``.-:+syhdhs/-` # -hMd `..:+oyhmNNmds/-` # `oNMM/ ``.-/oyhdmMMMMNdy+:. # .hMMMM- `.-/+shdmNMMMMMMNdy+:. # :mMMMMM+ `.-:+sydmNMMMMMMMMMNmho:.` # :NMMMMMMN: `.-:/oyhmmNMMMMMMMMMMMNmho:.` # .NMMMMMMMMNy:` `.-/oshdmNMMMMMMMMMMMMMMMmhs/-` # hMMMMMMMMMMMMmhysooosyhdmNMMMMMMMMMMMMMMMMMMmds/-` # .MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.` # -MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.` # `NMMMMMMMMMMMMMMMMMMMMMMMMMMMMMmyo:.` # /NMMMMMMMMMMMMMMMMMMMMMMMmho:.` # .yNMMMMMMMMMMMMMMMMmhs/.` # ./shdmNNmmdhyo/-`` # `````
robots.txt versions
| From | Through | State | Version | |
|---|---|---|---|---|
| 2026-10-26 | 2026-10-28 | ok 200 | 54ba534bff9e |
Timeline of changes
| Date | What changed |
|---|---|
| No changes since the first observation (2026-10-26). | |
Reconstructed history (Common Crawl)
From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.
| Crawl | Host | State | GPTBot | OAI-SearchBot | ChatGPT-User | ClaudeBot | Claude-SearchBot | Claude-User | PerplexityBot |
|---|---|---|---|---|---|---|---|---|---|
| 2026-09-21 CC-MAIN-2026-39 | www.nike.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2025-09-15 CC-MAIN-2025-38 | www.nike.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2024-09-16 CC-MAIN-2024-38 | www.nike.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2023-10-02 CC-MAIN-2023-40 | www.nike.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2022-10-03 CC-MAIN-2022-40 | www.nike.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2021-09-27 CC-MAIN-2021-39 | www.nike.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2020-09-28 CC-MAIN-2020-40 | www.nike.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2019-09-23 CC-MAIN-2019-39 | www.nike.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2018-10-22 CC-MAIN-2018-43 | www.nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2018-09-24 CC-MAIN-2018-39 | www.nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2018-07-23 CC-MAIN-2018-30 | www.nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2018-04-23 CC-MAIN-2018-17 | www.nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2018-01-29 CC-MAIN-2018-05 | www.nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-10-23 CC-MAIN-2017-43 | www.nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-09-25 CC-MAIN-2017-39 | www.nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-07-24 CC-MAIN-2017-30 | www.nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-04-24 CC-MAIN-2017-17 | nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-01-23 CC-MAIN-2017-04 | nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2016-10-03 CC-MAIN-2016-40 | nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2016-09-05 CC-MAIN-2016-36 | nike.com | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
Evidence
Every daily observation of nike.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-28: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973640)).
API: https://infrarabbit.com/crawlers/api/v1/policy/nike.com