ozon.ru: what it tells AI crawlers

On 27 October 2026, ozon.ru's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel
top 1k (Tranco)
robots.txt
ok (HTTP 200) · https://www.ozon.ru/robots.txt?__rr=1
unchanged since 2026-10-26 · sha256 661b8425037042a6… · view as recorded
The * group
partial applies to every agent without its own group

Per AI bot, 2026-10-27

User agentVerdictHow
GPTBotpartialthrough the * group
OAI-SearchBotpartialthrough the * group
ChatGPT-Userpartialthrough the * group
ClaudeBotpartialthrough the * group
Claude-SearchBotpartialthrough the * group
Claude-Userpartialthrough the * group
PerplexityBotpartialthrough the * group
Perplexity-Userpartialthrough the * group
Googlebotpartialnamed in its own group
Google-Extendedpartialthrough the * group
Applebot-Extendedpartialthrough the * group
CCBotpartialthrough the * group
Bytespiderpartialthrough the * group
Meta-ExternalAgentpartialthrough the * group
Amazonbotpartialthrough the * group

Other signals

Publishes /llms.txtnot observed
Publishes /ai.txtnot observed
Publishes /.well-known/tdmrep.jsonnot observed
Reserves TDM rights (TDMRep file, header or meta)not observed
Declares Content Signals (robots.txt or header)not observed
Says ai-train=no in a Content Signalnot observed
Points to an RSL licence (robots.txt License line or Link header)not observed
Answers with an x402 payment offer (lower bound: only the homepage is probed)not observed
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)not observed
Sends noai / noimageai directivesnot observed
Refused our fetcher (403 / challenge)no

robots.txt as recorded sha256 661b8425037042a6…

User-agent: Yandex
## lang ##
Disallow: /*?hl=
## Custom_rules ##
Disallow: /ai/share*
Disallow: /aiConversation*
Allow: /category/*/?miniapp=supermarket
Allow: /highlight/*/?miniapp=supermarket
Disallow: /app-com/
Disallow: */likezone-100986204/*
Disallow: /achievements/
Disallow: /search/
Disallow: /%
Disallow: /*.aspx
Disallow: /*.cfm
Disallow: /*.html
Disallow: /*catalog_select
Disallow: /*_catalog/
Disallow: /*?context=
Disallow: /action/*/?
Disallow: /auth/
Disallow: /amp/
Disallow: /brand/[0-9]+$/     
Disallow: /brand/*/category
Disallow: /collection/
Disallow: /category/*/sub$
Disallow: /category/*/product$
Disallow: /category/*=
Disallow: /category/*?
Disallow: /category/smt-
Disallow: /my/set
Disallow: /my/chat
Allow: /category/*/?page=
Disallow: /context/client_opinion/
Disallow: /flashsale
Disallow: /my/favorites/shared*
Disallow: /ozonid
Disallow: /o/
Disallow: /publisher/*/category
Disallow: /publisher/*=
Disallow: /publisher/*?
Disallow: /series/
Disallow: /seller/*/profile
Disallow: /seller/*/*text=
Disallow: /reviews/*/*text=
Disallow: /nuxt
Disallow: /webapi/
Disallow: /ozonid/account
Disallow: /travel/flight/search
Disallow: /travel/accountMergeAuth
Disallow: /travel/corporate/form/
Disallow: /travel/railway/search
Disallow: /travel/hotels/search
Disallow: /travel/tours/search
Disallow: /travel/guides
Disallow: /travel/hotels/page
Disallow: /travel/*?
Disallow: /travel/routes
Disallow: */href/
Disallow: */buyAgain/
Disallow: /social/tags/
Disallow: /my/travel/favorites
## Single_pages ##
Disallow: /context/cart
Disallow: /context/compare
Disallow: /context/favourites
Disallow: /context/login
Disallow: /context/myadvice
Disallow: /context/orderdone
Disallow: /context/orderlist
Disallow: /highlight/*?*
##Delete##
Disallow: /club/article/trendy-pitaniya-segodnya-i-zavtra-1619960/
Disallow: /club/article/papy-v-instagrame-5-blogov-ob-ottsovstve-bez-filtrov-359628/
Disallow: /club/article/kak-otkryt-punkt-vydachi-zakazov-ozon-48321/
Disallow: /club/article/rassrochka-na-ozon-kak-oformit-46908/
Disallow: /brand/sdelano-v-respublike-belarus-100096910/
## Global ##
Disallow: /brand/global-27923354
Disallow: /series/global-136263489
Disallow: /seller/global-4279
Disallow: /brand/global-87313963
Disallow: /seller/ozon-global-shop-140981
Disallow: /geo/sankt-peterburg/*00000000/
## Clean-param ##
Clean-param: utm&ref&partner&advert&stat&page&from&_bctx&partneragentid&sort&brand&type&code&gsaid&_gs_ref&_gs_cttl&asb&sh&tab&page_key
Clean-param: hs /context/detail/id
Clean-param: hs /product/
Clean-param: product_id /search/
Clean-param: asb2&actor&ID&carier&CID&_&dimentionn&material&sex2&opticalpower&item&comm&cid&userid&partnerAgentId&ectx&subid2&pid&is_retargeting&sub_id&rich&c&gclsrc&keywords&af_click_lookback
Clean-param: hs&bundle&utm_content&utm_source&utm_medium&utm_term&tab&ads_part_id&asb2&deny_category_prediction&hideEmail&token&shortlink&is_supermarket&vqWTa&gbraid&channel&seller_id&context&sku&layout_container&layout_page_index&addrbookid&pp&ppex&prv&regular&google_aid&android_id&clickid&partnerId&key&step&routes&dates&ServiceClass&Dlts&interface&HzcTd&fr&useRedirect&fromSku&price&is_ozon_delivery&point&order&redirect_query&classCodes&fareBasis
Clean-param: clid&shipment&posting&group&subid&subid1&newpartner&sa&ved&pvid&utm_partner&a&subscribe&action&bid&img&partnerAgentid&artner&partner-info21&cvredirect&changeCurrency&gilmour&iitt&source&nid&hid&track&sub_id2&partne&isspecialprice&russianlanguage&GV7E6uSmart_Books&ncid&isbn&parthner&userstyle&bt&gclid&partnerid&atm_marketing&apsource&CgLEo&cstrackid&ScpjX&hyperid&grhow&pa&perehod&show-uid&partner_baby_club&filtersizehght&sexmaster&reviewsVariantMode
Clean-param: lfrom&rcode&reviewId&reviewPid&is_retarget&login&reviewsFilters&addressbook_delivery_method_id&addressbook_id&create_address&keywor&keywo&buffer_share&parner&sms_ss&at_xt&chelovekci&Partner&tl&d079e63c&parther&kamnevn&martovskaya&utm_brand&p&qxpid&parnter&refresh&af_dp&partnar&DStOE&smartleads_src&smartleads_pid&smartleads_sid&category&isdiscount&filter&flock&pcat&ptype&fromapp&xcode&af_adset&areaId&AKNwC&route&XyBAL&YLTyO&dcWNo&dqYsQ&foreapp&id
Clean-param: orderId&pORVJ&pzkzw&qty&ytixn&vw&src&deep_link_value&message&RedirectURL&patner&2851ee80&g&fid&prdct&pt&no_js&widht&height&timezone&partnerizd_vk&reviewVid&merchant&acmode&chucktype&rating&new&features&color&bests&store&marketingcode&constructivefeatures&anons&is_discounted&modesoperation&sale&powervcol&security&newperiod&edition&foreignlanguage&movie&scid&writer&agesport&brakerear&framesize&brakefront&materialframe&biketype&wheeldiameter&sexvelo
Clean-param: sporttype&forktype&suspension&numsprocketsystem&numsprocketcassette&pedaltype&floatage&age&aspectratio&year&director&sound&personage&region&subtitles&captypecol&materialfunction&country&destination&lxw&fillermaterial&mount&powerv&purpose&ages&dieteticfood&animalsize&authorwork&tastetype&packagetype&recommendations&holidays&kit&ageconsumer&os&isdigital&packing&platform&statuette&publisher&seria&connector&intsource&pointId&keyword&elire_ru&bVhfJ&product
Clean-param: qXnPE&gcmes&gcmlg&idfa&number&bYjrL&af_reengagement_window&af_c_id&xLqkn&tcrrb&ke&filtersizeru&BrMsF&Children&Infants&fref&dti&ai&utm_c&fromprt_xml_facet&content&vero_id&vero_conv&click_id&bg&fbclid&start&VkrMN&ta&gcl&yEFsD&5f24edbd&tta&description-tab&gcli&weaponstoy&utm_cont&_bct&part&partner_potystorony_books&rimwidth&pcd&partn&pencaseview&utm_&ponymobook&itemDetail&filmpurpose&upsvolume&interfaces&coffeemakertype&coffeebrewtype&microwavemodes
Clean-param: managementtype&scalestype&units&functions&gpu&cpufamily&socket&cpuline&typeram&upspower&cookingprograms&location_audio&areause2&skintype&agerange&notdiscounted&pureetype&sortfolders&printformat&pentype&accpurpose&connectors&formfactor&dustcollectortype&nozzlestype&rigidity&sheetsize&exactmodels&casekind&feedsetup&animalclothes&animalseason&animalclothessize&period&maintheme&num&ageos&embroiderytype&subtype&sex&penform&bctx&simpleapparelcollection
Clean-param: russiansizeshoes&home_board&mobile_style&styledesign&utmsource&utmmedium&bvi2009&schweik&taste&agb77&targetUrl&8f401453&inside_admin&av&category_id&lang&centerholediameter&rimdiameter&offset&diameter&loadindex&materialsingle&numhole&season&sizesport&typerim&utm_medi&dclid&skrap_9&best_hit&epi&utm_so&size&vehicle&CFJxM&beauty&zDjSb&Tkwjl&af_ad&gt&newDesign&lpt&orderNumber&wiWIV&r&actual-format&banner-sizes&banner-test-tags&clickX&clickY&format-type
Clean-param: pcode-active-testids&pcodever&stat-id&test-tag&width&seller&startsku&ageo&bx_sender_conversion_id&ltclid&bagcategory&PAGEN_1&PAGEN_2&PAGEN_3&PAGEN_4&backurl&newfeatures&typefloor&typeheating&innermaterial&swingkind&ininterface&interfaceout&setkind&berrieskind&tyreheight&pastaadd&bouncemode&wallmount&viewprints&lookinside&gamestype&technologymatrix&partnersearch&giftrec&aging&typesport&areause_healthandbeauty&skindestination&texture&featuresconstitution
Clean-param: bound_cleaned&russiansizeclothes&split_address&path&product_id&QIBvU&byeducationalmaterialtype&bysubject&modelclothing&filters_key&commercialtype&orthopedicsize&shortagetype&platforms&driedfruitskind&search&screenresolution&tvtuner&structure&colorbase&dogsbreed&WGEEI&classificationpasta&jewerlymodel&wwsize&oaCRe&ifwFi&form&pastatype&effect&powerw&paymentToken&heightsetup&typehair&UHChG&media&dCsRE&toystheme&delete&TgMQX&cardkind&massagekind&FYsHA&MlSFv&sDgSP
Clean-param: carseatinstalltype&citytransport&url&nmtOR&exactmodelspump&deny_type_prediction&usBnu&specialtech&license&typeapparel&location_room&kMxPF&init&lat&long&switchTab&split_key&FRES&I&progdesc&referer1&referer2&compid&site&SIZEN_1&POLL_ID&SID&act&filter[category]&filter[os]&q&go&alias&bannerId&param&by&chsph&ARCHIVE&sphid&showprog&discount_code&ndcn&showall&singleOID&preview&COMPANY_ID&aid&datetime&hash&event_type&prodid&added&block&position&view_type&MESS_ID&THREAD
Clean-param: OPTION_ID&RCID&ORDER_ID&adv&buy&quantity&dtype&f&query&find_id&find_category_id&find_text&flt_TYPE&flt_PERIOD&forgot_password&noreg&clear&referer4&referer5&cc&logout&change_password&checkword&open&x&y&print&printable&referer3&where&show&letter&company&xnpe_cmp&k50id&musickind&filtersizeacs&style&eusize&accessoriesjewelrykind&uncheck&embeddedram&stovecompatibility&gref&organization&isbest&treespecies&k&keyw&lsOug&forceSwitch
Clean-param: checkIn&checkOut&cityOrRegionId&hotelId&tf_state&category_was_predicted&from_global&text&avtc&avte&avts&from_sku&from_url&oos_search&utm_campaign&amp&from_sku&oos_search&sh&requestId&searchRawQuery&NameLocation&fromCity&night&nightRound&startDate&toCountry&tourId&dayRound&dimensionshort&miniapp&sorting&erid&prev_collection&_fr&campaignId
Clean-param: source_caller&opened&af_keywords&att&share&rr1&pge&page_key&promocode&in&reviewVuuid&_rr&at&rel_scan&__rr&pgid&itemId&af_xp&selectedExpressCategory&reviewPuuid&utm_mid&suggestion_type&force_spell&utm_medim&v&utm_mid&utm_medim&haad&Erid&products_subpage&utm_erid&clckid&yabizcmpgn&strollermat&adrclid&short&abt_att&undefined&achievement_id&short&title&utm_text&reviewUuid&is_apparel_size_selected&term&is_apparel_size_selected&utm_text&hideable_rating

User-agent: Googlebot
## lang ##
Disallow: /*?hl=
## Custom_rules ##
Disallow: /ai/share*
Disallow: /aiConversation*
Allow: /category/supermarket-25000/review/
Allow: /category/supermarket-25000/*/review/
Disallow: /category/supermarket-25000/*/
Allow: /highlight/*/?miniapp=supermarket
Allow: /category/*/?miniapp=supermarket
Disallow: /app-com/
Disallow: */likezone-100986204/*
Disallow: /achievements/
Disallow: /search/
Disallow: /category/*/?page=*&tf_state
Disallow: /%
Disallow: /*.aspx
Disallow: /*.cfm
Disallow: /*.html
Disallow: /*catalog_select
Disallow: /*_catalog/
Disallow: /action/*/?
Disallow: /auth/
Disallow: /brand/[0-9]+$/ 
Disallow: */add-to-cart-modal/
Disallow: /collection/
Disallow: /seller/*/*text=
Disallow: /reviews/*/*text=
Disallow: /video
Allow: /category/*/?page=
Disallow: /context/client_opinion/
Disallow: /flashsale
Disallow: /modal/
Disallow: /my/chat
Disallow: /ozonid
Disallow: /o/
Disallow: /series/
Disallow: /seller/*/profile
Disallow: /nuxt
Disallow: /webapi/
Disallow: /ozonid/account
Disallow: /travel/flight/search
Disallow: /travel/accountMergeAuth
Disallow: /travel/corporate/form/
Disallow: /travel/railway/search
Disallow: /travel/hotels/search
Disallow: /travel/tours/search
Disallow: /my/favorites/shared*
Disallow: /travel/guides
Disallow: /travel/hotels/page
Disallow: /travel/*?
Disallow: /travel/routes
Disallow: */href/
Disallow: */buyAgain/
Disallow: /social/tags/
Disallow: /my/travel/favorites
## Single_pages ##
Disallow: /context/cart
Disallow: /context/compare
Disallow: /context/favourites
Disallow: /context/login
Disallow: /context/myadvice
Disallow: /context/orderdone
Disallow: /context/orderlist
Disallow: /highlight/*?*
## Global ##
Disallow: /brand/global-27923354
Disallow: /series/global-136263489
Disallow: /seller/global-4279
Disallow: /brand/global-87313963
Disallow: /seller/ozon-global-shop-140981
##Delete##
Disallow: /brand/sdelano-v-respublike-belarus-100096910/


User-agent: *
## lang ##
Disallow: /*?hl=
## Custom_rules ##
Disallow: /ai/share*
Disallow: /aiConversation*
Disallow: /app-com/
Disallow: */likezone-100986204/*
Disallow: /achievements/
Disallow: /%
Disallow: /*.aspx
Disallow: /*.cfm
Disallow: /*.html
Disallow: /*catalog_select
Disallow: /*_catalog/
Disallow: /*?context=
Disallow: /action/*/?
Disallow: /amp/
Disallow: /auth/
Disallow: /brand/*/category
Disallow: /collection/
Disallow: /category/*/sub$
Disallow: /category/*/product$
Disallow: /category/smt-
Disallow: /my/set
Disallow: /my/chat
Allow: /category/*/?page=
Disallow: /context/client_opinion/
Disallow: /flashsale
Disallow: /ozonid
Disallow: /o/
Disallow: /publisher/*/category
Disallow: /search
Disallow: /series/
Disallow: /seller/*/profile
Disallow: /seller/*/*text=
Disallow: /reviews/*/*text=
Disallow: /nuxt
Disallow: /my/favorites/shared*
Disallow: /webapi/
Disallow: /ozonid/account
Disallow: /travel/flight/search
Disallow: /travel/accountMergeAuth
Disallow: /travel/corporate/form/
Disallow: /travel/railway/search
Disallow: /travel/hotels/search
Disallow: /travel/tours/search
Disallow: /travel/guides
Disallow: /travel/hotels/page
Disallow: /travel/*?
Disallow: /travel/routes
Disallow: */href/
Disallow: */buyAgain/
Disallow: /social/tags/
Disallow: /my/travel/favorites
## Single_pages ##
Disallow: /context/cart
Disallow: /context/compare
Disallow: /context/favourites
Disallow: /context/login
Disallow: /context/myadvice
Disallow: /context/orderdone
Disallow: /context/orderlist
Disallow: /highlight/*?*
Allow: /highlight/*/?miniapp=supermarket
## Global ##
Disallow: /brand/global-27923354
Disallow: /series/global-136263489
Disallow: /seller/global-4279
Disallow: /brand/global-87313963
Disallow: /seller/ozon-global-shop-140981
##Delete##
Disallow: /brand/sdelano-v-respublike-belarus-100096910/

robots.txt versions

FromThroughStateVersion
2026-10-262026-10-28ok 200661b84250370

Timeline of changes

DateWhat changed
No changes since the first observation (2026-10-26).

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

CrawlHostStateGPTBotOAI-SearchBotChatGPT-UserClaudeBotClaude-SearchBotClaude-UserPerplexityBot
2026-09-21 CC-MAIN-2026-39ozon.ruredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2025-09-15 CC-MAIN-2025-38ozon.ruredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2024-09-16 CC-MAIN-2024-38ozon.ruredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2023-10-02 CC-MAIN-2023-40www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2022-10-03 CC-MAIN-2022-40www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2021-09-27 CC-MAIN-2021-39www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2020-09-28 CC-MAIN-2020-40www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2019-09-23 CC-MAIN-2019-39www.ozon.ruok viewpartialpartialunknownpartialpartialunknownpartial
2018-09-24 CC-MAIN-2018-39www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2018-01-29 CC-MAIN-2018-05www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-10-23 CC-MAIN-2017-43www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-09-25 CC-MAIN-2017-39www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-07-24 CC-MAIN-2017-30www.ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-04-24 CC-MAIN-2017-17ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2017-01-23 CC-MAIN-2017-04ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2016-10-03 CC-MAIN-2016-40ozon.ruok viewallowsallowsunknownallowsallowsunknownallows
2016-09-05 CC-MAIN-2016-36ozon.ruok viewallowsallowsunknownallowsallowsunknownallows

Evidence

Every daily observation of ozon.ru is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/ozon.ru