ozon.ru: what it tells AI crawlers

On 27 October 2026, ozon.ru's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel
top 1k (Tranco)
robots.txt
ok (HTTP 200) · https://www.ozon.ru/robots.txt?__rr=1
unchanged since 2026-10-26 · sha256 661b8425037042a6… · view as recorded
The * group
partial applies to every agent without its own group

Per AI bot, 2026-10-27

User agentVerdictHow
GPTBotpartialthrough the * group
OAI-SearchBotpartialthrough the * group
ChatGPT-Userpartialthrough the * group
ClaudeBotpartialthrough the * group
Claude-SearchBotpartialthrough the * group
Claude-Userpartialthrough the * group
PerplexityBotpartialthrough the * group
Perplexity-Userpartialthrough the * group
Googlebotpartialnamed in its own group
Google-Extendedpartialthrough the * group
Applebot-Extendedpartialthrough the * group
CCBotpartialthrough the * group
Bytespiderpartialthrough the * group
Meta-ExternalAgentpartialthrough the * group
Amazonbotpartialthrough the * group

Other signals

Publishes /llms.txtnot observed
Publishes /ai.txtnot observed
Publishes /.well-known/tdmrep.jsonnot observed
Reserves TDM rights (TDMRep file, header or meta)not observed
Declares Content Signals (robots.txt or header)not observed
Says ai-train=no in a Content Signalnot observed
Points to an RSL licence (robots.txt License line or Link header)not observed
Answers with an x402 payment offer (lower bound: only the homepage is probed)not observed
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)not observed
Sends noai / noimageai directivesnot observed
Refused our fetcher (403 / challenge)no

robots.txt as recorded sha256 b08e3535d8a02a61…

User-agent: Yandex
## Custom_rules ##
Allow: /category/*/?miniapp=supermarket
Allow: /search/
Allow: /category/*/?text=
Allow: /category/*/?deny_category_prediction=
Allow: /category/*/?from_global=
Allow: /category/*/?category_was_predicted=
Disallow: /?*
Disallow: /%
Disallow: /*.aspx
Disallow: /*.cfm
Disallow: /*.html
Disallow: /*catalog_select
Disallow: /*_catalog/
Disallow: /*?context=
Disallow: /action/*/?
Disallow: /auth/
Disallow: /amp/
Disallow: /brand/*/category
Disallow: /brand/*=
Disallow: /brand/*?
Disallow: /category/*/sub$
Disallow: /category/*/product$
Disallow: /category/*=
Disallow: /category/*?
Disallow: /category/smt-
Disallow: /my/set
Disallow: /my/chat
Allow: /category/*/?page=
Disallow: /context/client_opinion/
Disallow: /flashsale
Disallow: /ozonid
Disallow: /o
Disallow: /*-dlia-
Disallow: /publisher/*/category
Disallow: /publisher/*=
Disallow: /publisher/*?
Disallow: /series/*/category
Disallow: /series/*=
Disallow: /series/*?
Disallow: /seller/*/profile
Disallow: /person/*/category
Disallow: /person/*=
Disallow: /person/*?
Disallow: /product/*/*text=
Disallow: /seller/*/*text=
Disallow: /reviews/*/*text=
Disallow: /nuxt
Disallow: /webapi/
Disallow: /ozonid/account
Disallow: /travel/flight/search
Disallow: /travel/accountMergeAuth
Disallow: /travel/corporate/form/
Disallow: /travel/railway/search
Disallow: /travel/hotels/search
Disallow: /travel/guides
Disallow: /travel/*?
Disallow: */href/
Disallow: */buyAgain/
Disallow: /social/tags/
Disallow: /club/search/
## Single_pages ##
Disallow: /context/cart
Disallow: /context/compare
Disallow: /context/favourites
Disallow: /context/login
Disallow: /context/myadvice
Disallow: /context/orderdone
Disallow: /context/orderlist
Disallow: /highlight/*?*
##Delete##
Disallow: /club/article/trendy-pitaniya-segodnya-i-zavtra-1619960/
Disallow: /club/article/papy-v-instagrame-5-blogov-ob-ottsovstve-bez-filtrov-359628/
Disallow: /club/article/kak-otkryt-punkt-vydachi-zakazov-ozon-48321/
Disallow: /club/article/rassrochka-na-ozon-kak-oformit-46908/
## Global ##
Disallow: /brand/global-27923354
Disallow: /series/global-136263489
Disallow: /seller/global-4279
Disallow: /brand/global-87313963
Disallow: /seller/ozon-global-shop-140981
## Clean-param ##
Clean-param: utm&ref&partner&advert&stat&page&from&_bctx&partneragentid&sort&brand&type&code&gsaid&_gs_ref&_gs_cttl&asb&sh&tab
Clean-param: hs /context/detail/id
Clean-param: hs /product/
Clean-param: product_id /search/
Clean-param: asb2&actor&ID&carier&CID&_&dimentionn&material&sex2&opticalpower&item&comm&cid&userid&partnerAgentId&ectx&subid2&pid&is_retargeting&sub_id&rich&c&gclsrc&keywords&af_click_lookback
Clean-param: hs&bundle&utm_content&utm_source&utm_medium&utm_term&tab&ads_part_id&asb2&deny_category_prediction&hideEmail&token&shortlink&is_supermarket&vqWTa&gbraid&channel&seller_id&context&sku&layout_container&layout_page_index&addrbookid&pp&ppex&prv&regular&google_aid&android_id&clickid&partnerId&key&step&routes&dates&ServiceClass&Dlts&interface&HzcTd&fr&useRedirect&fromSku&price&is_ozon_delivery&point&order&redirect_query&classCodes&fareBasis
Clean-param: clid&shipment&posting&group&subid&subid1&newpartner&sa&ved&pvid&utm_partner&a&subscribe&action&bid&img&partnerAgentid&artner&partner-info21&cvredirect&changeCurrency&gilmour&iitt&source&nid&hid&track&sub_id2&partne&isspecialprice&russianlanguage&GV7E6uSmart_Books&ncid&isbn&parthner&userstyle&bt&gclid&partnerid&atm_marketing&apsource&CgLEo&cstrackid&ScpjX&hyperid&grhow&pa&perehod&show-uid&partner_baby_club&filtersizehght&sexmaster&reviewsVariantMode
Clean-param: lfrom&rcode&reviewId&reviewPid&is_retarget&login&reviewsFilters&addressbook_delivery_method_id&addressbook_id&create_address&keywor&keywo&buffer_share&parner&sms_ss&at_xt&chelovekci&Partner&tl&d079e63c&parther&kamnevn&martovskaya&utm_brand&p&qxpid&parnter&refresh&af_dp&partnar&DStOE&smartleads_src&smartleads_pid&smartleads_sid&category&isdiscount&filter&flock&pcat&ptype&fromapp&xcode&af_adset&areaId&AKNwC&route&XyBAL&YLTyO&dcWNo&dqYsQ&foreapp&id
Clean-param: orderId&pORVJ&pzkzw&qty&ytixn&vw&src&deep_link_value&message&RedirectURL&patner&2851ee80&g&fid&prdct&pt&no_js&widht&height&timezone&partnerizd_vk&reviewVid&merchant&acmode&chucktype&rating&new&features&color&bests&store&marketingcode&constructivefeatures&anons&is_discounted&modesoperation&sale&powervcol&security&newperiod&edition&foreignlanguage&movie&scid&writer&agesport&brakerear&framesize&brakefront&materialframe&biketype&wheeldiameter&sexvelo
Clean-param: sporttype&forktype&suspension&numsprocketsystem&numsprocketcassette&pedaltype&floatage&age&aspectratio&year&director&sound&personage&region&subtitles&captypecol&materialfunction&country&destination&lxw&fillermaterial&mount&powerv&purpose&ages&dieteticfood&animalsize&authorwork&tastetype&packagetype&recommendations&holidays&kit&ageconsumer&os&isdigital&packing&platform&statuette&publisher&seria&connector&intsource&pointId&keyword&elire_ru&bVhfJ&product
Clean-param: qXnPE&gcmes&gcmlg&idfa&number&bYjrL&af_reengagement_window&af_c_id&xLqkn&tcrrb&ke&filtersizeru&BrMsF&Children&Infants&fref&dti&ai&utm_c&fromprt_xml_facet&content&vero_id&vero_conv&click_id&bg&fbclid&start&VkrMN&ta&gcl&yEFsD&5f24edbd&tta&description-tab&gcli&weaponstoy&utm_cont&_bct&part&partner_potystorony_books&rimwidth&pcd&partn&pencaseview&utm_&ponymobook&itemDetail&filmpurpose&upsvolume&interfaces&coffeemakertype&coffeebrewtype&microwavemodes
Clean-param: managementtype&scalestype&units&functions&gpu&cpufamily&socket&cpuline&typeram&upspower&cookingprograms&location_audio&areause2&skintype&agerange&notdiscounted&pureetype&sortfolders&printformat&pentype&accpurpose&connectors&formfactor&dustcollectortype&nozzlestype&rigidity&sheetsize&exactmodels&casekind&feedsetup&animalclothes&animalseason&animalclothessize&period&maintheme&num&ageos&embroiderytype&subtype&sex&penform&bctx&simpleapparelcollection
Clean-param: russiansizeshoes&home_board&mobile_style&styledesign&utmsource&utmmedium&bvi2009&schweik&taste&agb77&targetUrl&8f401453&inside_admin&av&category_id&lang&centerholediameter&rimdiameter&offset&diameter&loadindex&materialsingle&numhole&season&sizesport&typerim&utm_medi&dclid&skrap_9&best_hit&epi&utm_so&size&vehicle&CFJxM&beauty&zDjSb&Tkwjl&af_ad&gt&newDesign&lpt&orderNumber&wiWIV&r&actual-format&banner-sizes&banner-test-tags&clickX&clickY&format-type
Clean-param: pcode-active-testids&pcodever&stat-id&test-tag&width&seller&startsku&ageo&bx_sender_conversion_id&ltclid&bagcategory&PAGEN_1&PAGEN_2&PAGEN_3&PAGEN_4&backurl&newfeatures&typefloor&typeheating&innermaterial&swingkind&ininterface&interfaceout&setkind&berrieskind&tyreheight&pastaadd&bouncemode&wallmount&viewprints&lookinside&gamestype&technologymatrix&partnersearch&giftrec&aging&typesport&areause_healthandbeauty&skindestination&texture&featuresconstitution
Clean-param: bound_cleaned&russiansizeclothes&split_address&path&product_id&QIBvU&byeducationalmaterialtype&bysubject&modelclothing&filters_key&commercialtype&orthopedicsize&shortagetype&platforms&driedfruitskind&search&screenresolution&tvtuner&structure&colorbase&dogsbreed&WGEEI&classificationpasta&jewerlymodel&wwsize&oaCRe&ifwFi&form&pastatype&effect&powerw&paymentToken&heightsetup&typehair&UHChG&media&dCsRE&toystheme&delete&TgMQX&cardkind&massagekind&FYsHA&MlSFv&sDgSP
Clean-param: carseatinstalltype&citytransport&url&nmtOR&exactmodelspump&deny_type_prediction&usBnu&specialtech&license&typeapparel&location_room&kMxPF&init&lat&long&switchTab&split_key&FRES&I&progdesc&referer1&referer2&compid&site&SIZEN_1&POLL_ID&SID&act&filter[category]&filter[os]&q&go&alias&bannerId&param&by&chsph&ARCHIVE&sphid&showprog&discount_code&ndcn&showall&singleOID&preview&COMPANY_ID&aid&datetime&hash&event_type&prodid&added&block&position&view_type&MESS_ID&THREAD
Clean-param: OPTION_ID&RCID&ORDER_ID&adv&buy&quantity&dtype&f&query&find_id&find_category_id&find_text&flt_TYPE&flt_PERIOD&forgot_password&noreg&clear&referer4&referer5&cc&logout&change_password&checkword&open&x&y&print&printable&referer3&where&show&letter&company&xnpe_cmp&k50id&musickind&filtersizeacs&style&eusize&accessoriesjewelrykind&uncheck&embeddedram&stovecompatibility&gref&organization&isbest&treespecies&k&keyw&lsOug&forceSwitch

User-agent: Googlebot
## Custom_rules ##
Allow: /category/*/?miniapp=supermarket
Allow: /search/
Allow: /category/*/?text=
Allow: /category/*/?deny_category_prediction=
Allow: /category/*/?from_global=
Allow: /category/*/?category_was_predicted=
Disallow: /?*
Disallow: /%
Disallow: /*.aspx
Disallow: /*.cfm
Disallow: /*.html
Disallow: /*catalog_select
Disallow: /*_catalog/
Disallow: /action/*/?
Disallow: /auth/
Disallow: */add-to-cart-modal/
Disallow: /brand/*=
Disallow: /brand/*?
Disallow: /category/*/sub$
Disallow: /category/*/product$
Disallow: /category/*=
Disallow: /category/*?
Disallow: /category/smt-
Disallow: /product/*/*asb=
Disallow: /product/*/*asb2=
Disallow: /product/*/*keywords=
Disallow: /product/*/*_bctx=
Disallow: /product/*/*stat=
Disallow: /product/*/*bundle=
Disallow: /product/*/*text=
Disallow: /seller/*/*text=
Disallow: /reviews/*/*text=
Disallow: /category/*/*tf_state=
Disallow: /*/?advert=
Disallow: /*/*&advert=
Disallow: /*/?hs=
Disallow: /*/*&hs=
Disallow: /*/?sh=
Disallow: /*/*&sh=
Disallow: /video
Allow: /category/*/?page=
Disallow: /context/client_opinion/
Disallow: /flashsale
Disallow: /modal/
Disallow: /my/chat
Disallow: /ozonid
Disallow: /o
Disallow: /publisher/*=
Disallow: /publisher/*?
Disallow: /series/*/category
Disallow: /series/*=
Disallow: /series/*?
Disallow: /seller/*/profile
Disallow: /person/*/category
Disallow: /person/*=
Disallow: /person/*?
Disallow: /nuxt
Disallow: /webapi/
Disallow: /ozonid/account
Disallow: /travel/flight/search
Disallow: /travel/accountMergeAuth
Disallow: /travel/corporate/form/
Disallow: /travel/railway/search
Disallow: /travel/hotels/search
Disallow: /travel/guides
Disallow: /travel/*?
Disallow: */href/
Disallow: */buyAgain/
Disallow: /social/tags/
Disallow: /club/search/
## Single_pages ##
Disallow: /context/cart
Disallow: /context/compare
Disallow: /context/favourites
Disallow: /context/login
Disallow: /context/myadvice
Disallow: /context/orderdone
Disallow: /context/orderlist
Disallow: /highlight/*?*
## Global ##
Disallow: /brand/global-27923354
Disallow: /series/global-136263489
Disallow: /seller/global-4279
Disallow: /brand/global-87313963
Disallow: /seller/ozon-global-shop-140981

User-agent: *
## Custom_rules ##
Allow: /search/?text=
Allow: /search/?deny_category_prediction=
Allow: /search/?from_global=
Allow: /category/*/?text=
Allow: /category/*/?deny_category_prediction=true&text=
Allow: /category/*/?from_global=true&text=
Allow: /category/*/?category_was_predicted=true
Disallow: /?*
Disallow: /%
Disallow: /*.aspx
Disallow: /*.cfm
Disallow: /*.html
Disallow: /*catalog_select
Disallow: /*_catalog/
Disallow: /*?context=
Disallow: /*?advert=
Disallow: /action/*/?
Disallow: /amp/
Disallow: /auth/
Disallow: /brand/*/category
Disallow: /brand/*=
Disallow: /brand/*?
Disallow: /category/*/sub$
Disallow: /category/*/product$
Disallow: /category/*=
Disallow: /category/*?
Disallow: /category/smt-
Disallow: /my/set
Disallow: /my/chat
Allow: /category/*/?page=
Disallow: /context/client_opinion/
Disallow: /flashsale
Disallow: /ozonid
Disallow: /o
Disallow: /publisher/*/category
Disallow: /publisher/*=
Disallow: /publisher/*?
Disallow: /search
Disallow: /series/*/category
Disallow: /series/*=
Disallow: /series/*?
Disallow: /seller/*/profile
Disallow: /person/*/category
Disallow: /person/*=
Disallow: /person/*?
Disallow: /product/*/*text=
Disallow: /seller/*/*text=
Disallow: /reviews/*/*text=
Disallow: /nuxt
Disallow: /webapi/
Disallow: /ozonid/account
Disallow: /travel/flight/search
Disallow: /travel/accountMergeAuth
Disallow: /travel/corporate/form/
Disallow: /travel/railway/search
Disallow: /travel/hotels/search
Disallow: /travel/guides
Disallow: /travel/*?
Disallow: */href/
Disallow: */buyAgain/
Disallow: /social/tags/
## Single_pages ##
Disallow: /context/cart
Disallow: /context/compare
Disallow: /context/favourites
Disallow: /context/login
Disallow: /context/myadvice
Disallow: /context/orderdone
Disallow: /context/orderlist
Disallow: /highlight/*?*
## Global ##
Disallow: /brand/global-27923354
Disallow: /series/global-136263489
Disallow: /seller/global-4279
Disallow: /brand/global-87313963
Disallow: /seller/ozon-global-shop-140981

robots.txt versions

FromThroughStateVersion
2026-10-262026-10-28ok 200661b84250370

Timeline of changes

DateWhat changed
No changes since the first observation (2026-10-26).

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

CrawlHostStateGPTBotOAI-SearchBotChatGPT-UserClaudeBotClaude-SearchBotClaude-UserPerplexityBot
2026-09-21 CC-MAIN-2026-39ozon.ruredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2025-09-15 CC-MAIN-2025-38ozon.ruredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2024-09-16 CC-MAIN-2024-38ozon.ruredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2023-10-02 CC-MAIN-2023-40www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2022-10-03 CC-MAIN-2022-40www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2021-09-27 CC-MAIN-2021-39www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2020-09-28 CC-MAIN-2020-40www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2019-09-23 CC-MAIN-2019-39www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2018-09-24 CC-MAIN-2018-39www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2018-01-29 CC-MAIN-2018-05www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-10-23 CC-MAIN-2017-43www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-09-25 CC-MAIN-2017-39www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-07-24 CC-MAIN-2017-30www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-04-24 CC-MAIN-2017-17ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-01-23 CC-MAIN-2017-04ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2016-10-03 CC-MAIN-2016-40ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2016-09-05 CC-MAIN-2016-36ozon.ruok viewallowsallowsunknownallowsallowsunknownallows

Evidence

Every daily observation of ozon.ru is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/ozon.ru