amap.com: what it tells AI crawlers
On 27 October 2026, amap.com's robots.txt fully blocked ClaudeBot and Claude-SearchBot.
Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.
- Panel
- top 10k (Tranco)
- robots.txt
- ok (HTTP 200) · https://amap.com/robots.txt
unchanged since 2026-10-26 · sha2562d839fd774dd0953…· view as recorded - The * group
- blocks applies to every agent without its own group
Per AI bot, 2026-10-27
| User agent | Verdict | How |
|---|---|---|
| GPTBot | allows | named in its own group |
| OAI-SearchBot | allows | named in its own group |
| ChatGPT-User | allows | named in its own group |
| ClaudeBot | blocks | through the * group |
| Claude-SearchBot | blocks | through the * group |
| Claude-User | blocks | through the * group |
| PerplexityBot | allows | named in its own group |
| Perplexity-User | blocks | through the * group |
| Googlebot | allows | named in its own group |
| Google-Extended | allows | named in its own group |
| Applebot-Extended | blocks | through the * group |
| CCBot | allows | named in its own group |
| Bytespider | allows | named in its own group |
| Meta-ExternalAgent | allows | named in its own group |
| Amazonbot | allows | named in its own group |
| anthropic-ai | allows | named in its own group |
| Applebot | allows | named in its own group |
| ChatGLM-Spider | allows | named in its own group |
| Claude-Web | allows | named in its own group |
| cohere-ai | allows | named in its own group |
| DeepSeekBot | allows | named in its own group |
| Hunyuan | allows | named in its own group |
| MoonshotBot | allows | named in its own group |
| PanguBot | allows | named in its own group |
| QwenBot | allows | named in its own group |
| TongyiBot | allows | named in its own group |
| YiBot | allows | named in its own group |
| YouBot | allows | named in its own group |
Other signals
| Publishes /llms.txt | not observed |
| Publishes /ai.txt | not observed |
| Publishes /.well-known/tdmrep.json | not observed |
| Reserves TDM rights (TDMRep file, header or meta) | not observed |
| Declares Content Signals (robots.txt or header) | not observed |
| Says ai-train=no in a Content Signal | not observed |
| Points to an RSL licence (robots.txt License line or Link header) | not observed |
| Answers with an x402 payment offer (lower bound: only the homepage is probed) | not observed |
| Answers HTTP 402 Payment Required (lower bound: only the homepage is probed) | not observed |
| Sends noai / noimageai directives | not observed |
| Refused our fetcher (403 / challenge) | no |
robots.txt as recorded sha256 2d839fd774dd0953…
# ============================================ # 高德地图 PC 端爬虫访问规则 # 更新时间: 2026-06-01 # 策略: 全面放开公开路由,保护敏感接口 # AI爬虫开放 /place/ /ranking/ /postcode/ 等内容页 # ============================================ # ===== 百度爬虫 ===== User-agent: Baiduspider Allow: / # 保护敏感接口 Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/setcookie Disallow: /service/pushMessage Disallow: /service/pushRoadbook Disallow: /service/qrcodeGet Disallow: /service/qrcodeConfirm Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ # 爬取延迟(秒) Crawl-delay: 1 # ===== 百度图片爬虫 ===== User-agent: Baiduspider-image Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Google 爬虫 ===== User-agent: Googlebot Allow: / # 保护敏感接口 Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/setcookie Disallow: /service/pushMessage Disallow: /service/pushRoadbook Disallow: /service/qrcodeGet Disallow: /service/qrcodeConfirm Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ # 爬取延迟(秒) Crawl-delay: 1 # ===== Bing 爬虫 ===== User-agent: MSNBot Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/setcookie Disallow: /service/pushMessage Disallow: /service/pushRoadbook Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 User-agent: bingbot Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/setcookie Disallow: /service/pushMessage Disallow: /service/pushRoadbook Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 搜狗爬虫 ===== User-agent: Sogou web spider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/setcookie Disallow: /service/pushMessage Disallow: /service/pushRoadbook Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 User-agent: Sogou inst spider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 User-agent: Sogou spider2 Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 User-agent: Sogou blog Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 User-agent: Sogou News Spider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 User-agent: Sogou Orion spider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 # ===== 360 搜索爬虫 ===== User-agent: 360Spider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/setcookie Disallow: /service/pushMessage Disallow: /service/pushRoadbook Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 # ===== 神马搜索爬虫 ===== User-agent: YisouSpider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 # ===== 有道爬虫 ===== User-agent: YoudaoBot Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 # ===== 中搜爬虫 ===== User-agent: ChinasoSpider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 # ===== 搜搜爬虫 ===== User-agent: Sosospider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 # ===== 宜搜爬虫 ===== User-agent: EasouSpider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 # ===== 即刻搜索爬虫 ===== User-agent: JikeSpider Allow: / Disallow: /service/fav/ Disallow: /service/checklogin Disallow: /service/logout Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /rb/ Disallow: /bin/ Crawl-delay: 3 # ===== 其他未知爬虫(含未单独列出的AI爬虫)===== # 覆盖:QwenBot/TongyiBot、DeepSeekBot、Kimi/MoonshotBot、 # ChatGLM-Spider、Hunyuan/TencentBot、MiniMaxBot 等 User-agent: * # 允许访问核心内容页面(SEO + GEO) Allow: /detail/ Allow: /search/ Allow: /dir/ Allow: /place/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips # 禁止其他所有路径(包括短信验证码接口) Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /roadbook/ Disallow: /bin/ Disallow: / # 更长的爬取延迟 Crawl-delay: 5 # ============================================ # AI 爬虫(GEO优化:开放核心内容页面) # ============================================ # ===== OpenAI GPTBot ===== User-agent: GPTBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== OpenAI ChatGPT User Agent ===== User-agent: ChatGPT-User Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Anthropic Claude ===== User-agent: Claude-Web Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 User-agent: Anthropic-AI Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Perplexity ===== User-agent: PerplexityBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Google Gemini (Google-Extended) ===== User-agent: Google-Extended Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Apple Siri/Spotlight ===== User-agent: Applebot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 字节跳动 AI (豆包等) ===== User-agent: Bytespider Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 阿里通义千问 (Qwen) ===== User-agent: QwenBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 User-agent: TongyiBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== DeepSeek ===== User-agent: DeepSeekBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 User-agent: DeepSeek-User Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 月之暗面 Kimi ===== User-agent: Kimi Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 User-agent: MoonshotBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 智谱 ChatGLM ===== User-agent: ChatGLM-Spider Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 腾讯混元 ===== User-agent: Hunyuan Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 User-agent: TencentBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== MiniMax ===== User-agent: MiniMaxBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== OpenAI SearchBot ===== User-agent: OAI-SearchBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 字节跳动 豆包 ===== User-agent: Doubao Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 阿里云 ===== User-agent: AliyunBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 华为盘古 ===== User-agent: PanguBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 科大讯飞星火 ===== User-agent: iFlytekBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 零一万物 ===== User-agent: YiBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== 商汤日日新 ===== User-agent: SenseBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Amazon (Alexa/AI) ===== User-agent: Amazonbot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== You.com ===== User-agent: YouBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Cohere ===== User-agent: Cohere-AI Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Meta AI ===== User-agent: Meta-ExternalAgent Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ===== Common Crawl (AI训练数据集) ===== User-agent: CCBot Allow: /dir/ Allow: /place/ Allow: /detail/ Allow: /search/ Allow: /ranking/ Allow: /postcode/ Allow: /ssr/doc Allow: /service/poiInfo Allow: /service/regeo Allow: /service/weather Allow: /service/poiTips Disallow: /service/smsGet Disallow: /service/smsFlush Disallow: /service/smsSend Disallow: /service/ Disallow: /rb/ Disallow: /bin/ Crawl-delay: 2 # ============================================ # Sitemap 配置 # ============================================ Sitemap: https://ditu.amap.com/sitemap.xml Sitemap: https://www.amap.com/ssr/sitemap-pc-ssr.xml # ============================================ # 说明: # 1. 主流搜索引擎(百度、Google、Bing等)可以访问所有公开路由 # 2. 敏感接口(收藏、登录、推送、短信验证码等)对所有爬虫禁止访问 # 3. 路书管理接口(/rb/)需要认证,禁止爬虫访问 # 4. 不同爬虫设置了不同的 Crawl-delay: # - Google/Bing/百度: 1-2秒(优先级最高) # - AI爬虫: 2秒(GPTBot/Claude/千问/DeepSeek/Kimi/智谱/混元/豆包/盘古/讯飞/零一/商汤等) # - 其他主流: 3秒(中等优先级) # - 未知爬虫: 5秒(低优先级,且限制访问范围) # 5. 建议配合服务器端限流机制使用 # 6. 短信验证码接口已全面禁止爬虫访问 # 7. AI爬虫开放 /place/ /ranking/ /postcode/ 等内容页(GEO优化) # ============================================
robots.txt versions
| From | Through | State | Version | |
|---|---|---|---|---|
| 2026-10-26 | 2026-10-27 | ok 200 | 2d839fd774dd |
Timeline of changes
| Date | What changed |
|---|---|
| No changes since the first observation (2026-10-26). | |
Reconstructed history (Common Crawl)
From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.
| Crawl | Host | State | GPTBot | OAI-SearchBot | ChatGPT-User | ClaudeBot | Claude-SearchBot | Claude-User | PerplexityBot |
|---|---|---|---|---|---|---|---|---|---|
| 2026-09-21 CC-MAIN-2026-39 | amap.com | ok view | allows | allows | unknown | blocks | blocks | unknown | allows |
| 2025-09-15 CC-MAIN-2025-38 | amap.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2024-09-16 CC-MAIN-2024-38 | amap.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2023-10-02 CC-MAIN-2023-40 | amap.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2022-10-03 CC-MAIN-2022-40 | amap.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2021-09-27 CC-MAIN-2021-39 | amap.com | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2020-09-28 CC-MAIN-2020-40 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2019-09-23 CC-MAIN-2019-39 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2018-09-24 CC-MAIN-2018-39 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2018-01-29 CC-MAIN-2018-05 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-10-23 CC-MAIN-2017-43 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-09-25 CC-MAIN-2017-39 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-07-24 CC-MAIN-2017-30 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-04-24 CC-MAIN-2017-17 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-01-23 CC-MAIN-2017-04 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2016-10-03 CC-MAIN-2016-40 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2016-09-05 CC-MAIN-2016-36 | amap.com | soft404 | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
Evidence
Every daily observation of amap.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).
API: https://infrarabbit.com/crawlers/api/v1/policy/amap.com