aliexpress.com: what it tells AI crawlers

On 28 October 2026, aliexpress.com's robots.txt fully blocked GPTBot, ClaudeBot, Google-Extended and CCBot.

Last verified 2026-10-29 03:59 UTC (daily run of 2026-10-28). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.aliexpress.com/robots.txt
unchanged since 2026-10-26 · sha256 8b70ec6337868263… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-28

Other signals

robots.txt as recorded sha256 292c1565ea3b9e5b…

# file: robots.txt,updated 2017-11-21 Save time save lives also apply to bots.
# author: weilie.chenwl
# host: www.aliexpress.com
# 
# Format is:
#       User-agent: <name of spider>
#       Disallow: <nothing> | <path>
# -----------------------------------------------------------------------------
User-agent: *
Disallow: /search/
Disallow: /productdetail/
Disallow: /wholesale
Disallow: /api/
Disallow: /af/
Disallow: /apps/
Disallow: /help/
Disallow: /downloads/
Disallow: /wishlist/
Disallow: /shopcart/
Disallow: /p4pforlist.html
Disallow: /orderList.htm
Disallow: /wsproduct-openapi-server.html
Disallow: /productGroupsAjax.htm
Disallow: /recommend.htm
Disallow: /brands/
Disallow: /premium/
Disallow: /cp/
Disallow: /item-img/
Disallow: /product/seller/
Disallow: /product/recommend.htm
Disallow: /ajax_show_product_display.do
Disallow: /getdescmoduleajax.htm
Disallow: /store/productgroupsajax.htm
Disallow: /buyerprotection/
Disallow: /api-get-feedback.html
Disallow: /smart-match.html

User-agent: Yandex
Disallow: /search/
Disallow: /productdetail/
Disallow: /wholesale
Disallow: /api/
Disallow: /af/
Disallow: /apps/
Disallow: /help/
Disallow: /downloads/
Disallow: /wishlist/
Disallow: /shopcart/
Disallow: /p4pforlist.html
Disallow: /orderList.htm
Disallow: /wsproduct-openapi-server.html
Disallow: /productGroupsAjax.htm
Disallow: /recommend.htm
Disallow: /brands/
Disallow: /premium/
Disallow: /cp/
Disallow: /item-img/
Disallow: /product/seller/
Disallow: /product/recommend.htm
Disallow: /ajax_show_product_display.do
Disallow: /getdescmoduleajax.htm
Disallow: /store/productgroupsajax.htm
Disallow: /buyerprotection/
Disallow: /api-get-feedback.html
Disallow: /smart-match.html
Host: https://ru.aliexpress.com
Clean-param: initiative_id&site&spm&g&isrefine&needquery&blanktest&sorttype&cpt&aff_trace_key&ispremium&aff_platform&misspelltext&isonlyaffiliate&afref&aff_short_key&isdl&albcp&albch&albag&crea&netw&trgt&src&plac&aff_id&p4p&tracelog&useimatch&_csrf&utm_source&utm_campaign&utm_term&smsign&smtoken&utm_medium&utm_content&isafchannel&viewtype&aff_click_id&t&transabtest&callback&_csrf_token_&_&origin&rowan_id1&rowan_msg_id&ck&json&iscates


User-agent: Baiduspider
Disallow: /

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of aliexpress.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-28: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973640)).

API: https://infrarabbit.com/crawlers/api/v1/policy/aliexpress.com