meraki.com: what it tells AI crawlers
On 27 October 2026, meraki.com's robots.txt refused our fetcher (HTTP 403 or a bot challenge), so its policy could not be read.
Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.
- Panel
- top 1k (Tranco)
- robots.txt
- fetch-blocked (HTTP 401) · https://meraki.cisco.com/robots.txt
unchanged since 2026-10-27
Per AI bot, 2026-10-27
| User agent | Verdict | How |
|---|---|---|
| GPTBot | unknown | fetch-blocked |
| OAI-SearchBot | unknown | fetch-blocked |
| ChatGPT-User | unknown | fetch-blocked |
| ClaudeBot | unknown | fetch-blocked |
| Claude-SearchBot | unknown | fetch-blocked |
| Claude-User | unknown | fetch-blocked |
| PerplexityBot | unknown | fetch-blocked |
| Perplexity-User | unknown | fetch-blocked |
| Googlebot | unknown | fetch-blocked |
| Google-Extended | unknown | fetch-blocked |
| Applebot-Extended | unknown | fetch-blocked |
| CCBot | unknown | fetch-blocked |
| Bytespider | unknown | fetch-blocked |
| Meta-ExternalAgent | unknown | fetch-blocked |
| Amazonbot | unknown | fetch-blocked |
Other signals
| Publishes /llms.txt | not observed |
| Publishes /ai.txt | not observed |
| Publishes /.well-known/tdmrep.json | not observed |
| Reserves TDM rights (TDMRep file, header or meta) | not observed |
| Declares Content Signals (robots.txt or header) | not observed |
| Says ai-train=no in a Content Signal | not observed |
| Points to an RSL licence (robots.txt License line or Link header) | not observed |
| Answers with an x402 payment offer (lower bound: only the homepage is probed) | not observed |
| Answers HTTP 402 Payment Required (lower bound: only the homepage is probed) | not observed |
| Sends noai / noimageai directives | not observed |
| Refused our fetcher (403 / challenge) | yes |
robots.txt as recorded sha256 97df1dd76ec8eb07…
################################# ROBOTS.TXT ################################### # Updates can be retrieved from: https://github.com/jonasjacek/robots.txt # # This document is licensed with a CC BY-NC-SA 4.0 license. # # Last update: 2020-02-20 # ################################################################################ User-agent: 360Spider User-agent: 360Spider-Image User-agent: 360Spider-Video User-agent: AdsBot-Google User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google-Mobile-Apps User-agent: adidxbot User-agent: Applebot User-agent: AppleNewsBot User-agent: Baiduspider User-agent: Baiduspider-image User-agent: Baiduspider-news User-agent: Baiduspider-video User-agent: bingbot User-agent: BingPreview User-agent: BublupBot User-agent: CCBot User-agent: Cliqzbot User-agent: coccoc User-agent: coccocbot-image User-agent: coccocbot-web User-agent: Daumoa User-agent: Dazoobot User-agent: DeuSu User-agent: DuckDuckBot User-agent: DuckDuckGo-Favicons-Bot User-agent: EuripBot User-agent: Exploratodo User-agent: Facebot User-agent: Feedly User-agent: Findxbot User-agent: Googlebot User-agent: Googlebot-Image User-agent: Googlebot-Mobile User-agent: Googlebot-News User-agent: Googlebot-Video User-agent: HaoSouSpider User-agent: ichiro User-agent: istellabot User-agent: JikeSpider User-agent: Lycos User-agent: Mail.Ru User-agent: Mediapartners-Google User-agent: MojeekBot User-agent: msnbot User-agent: msnbot-media User-agent: OrangeBot User-agent: Pinterest User-agent: Plukkie User-agent: Qwantify User-agent: Rambler User-agent: SeznamBot User-agent: Sosospider User-agent: Slurp User-agent: Sogou blog User-agent: Sogou inst spider User-agent: Sogou News Spider User-agent: Sogou Orion spider User-agent: Sogou spider2 User-agent: Sogou web spider User-agent: SputnikBot User-agent: Teoma User-agent: Twitterbot User-agent: wotbox User-agent: yacybot User-agent: Yandex User-agent: YandexMobileBot User-agent: Yeti User-agent: YioopBot User-agent: yoozBot User-agent: YoudaoBot Disallow: /wp-admin/ User-agent: * Disallow: /
robots.txt versions
| From | Through | State | Version | |
|---|---|---|---|---|
| 2026-10-27 | 2026-10-27 | fetch-blocked 401 | – | |
| 2026-10-26 | 2026-10-26 | ok 200 | 97df1dd76ec8 |
Timeline of changes
| Date | What changed |
|---|---|
| 2026-10-27 | robots.txt fetch: ok → fetch-blocked |
Reconstructed history (Common Crawl)
From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.
| Crawl | Host | State | GPTBot | OAI-SearchBot | ChatGPT-User | ClaudeBot | Claude-SearchBot | Claude-User | PerplexityBot |
|---|---|---|---|---|---|---|---|---|---|
| 2026-09-21 CC-MAIN-2026-39 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2025-09-15 CC-MAIN-2025-38 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2024-09-16 CC-MAIN-2024-38 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2023-10-02 CC-MAIN-2023-40 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2022-10-03 CC-MAIN-2022-40 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2020-09-28 CC-MAIN-2020-40 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2019-09-23 CC-MAIN-2019-39 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2018-09-24 CC-MAIN-2018-39 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-09-25 CC-MAIN-2017-39 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-07-24 CC-MAIN-2017-30 | meraki.com | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-04-24 CC-MAIN-2017-17 | www.meraki.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2017-01-23 CC-MAIN-2017-04 | www.meraki.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2016-10-03 CC-MAIN-2016-40 | www.meraki.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2016-09-05 CC-MAIN-2016-36 | www.meraki.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
Evidence
Every daily observation of meraki.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).
API: https://infrarabbit.com/crawlers/api/v1/policy/meraki.com