yandex.ru: what it tells AI crawlers

On 27 October 2026, yandex.ru's robots.txt partly blocked OAI-SearchBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://yandex.ru/robots.txt
unchanged since 2026-10-26 · sha256 c51a208183d07eb7… · view as recorded

The * group

partial applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

robots.txt as recorded sha256 b11dd0613e3a3595…

# yandex.ru
User-agent: *
Disallow: /?
Disallow: /403.html
Disallow: /404.html
Disallow: /500.html
Disallow: /about.html
Disallow: /adddata
Disallow: /adresa-segmentator
Disallow: /advanced_engl.html
Disallow: /advertising
Disallow: /all-supported-params
Disallow: /articles
Disallow: /aura/
Allow: /aura/promo/
Disallow: /blog/*?text=
Disallow: /blog/*?tag=
Disallow: /blog/*/*/*
Disallow: /blog/punto
Disallow: /blogs*
Allow: /blogs$
Allow: /blogs/$
Allow: /blogs/pad/$
Allow: /blogs/pad$

Disallow: /bus/orders*
Disallow: /bus/api/*

Disallow: /catalog/?text=
Disallow: /chat
Disallow: /cgi-bin/
Disallow: /cgi/
Disallow: /chisla.html
Disallow: /clck

Disallow: /collections/feed
Disallow: /collections/search/
Disallow: /collections/*/search/*
Disallow: /collections/iznanka/
Disallow: /collections/*/_followers*
Disallow: /collections/*/_followings*
Disallow: /collections/share
Disallow: /collections/favorites
Disallow: /collections/embed
Disallow: /collections/picture/

Disallow: /company/*.rss
Disallow: /company/search

Disallow: /comments/*

Disallow: /courier

Disallow: /conflagexp
Disallow: /cy
Disallow: /cycounter
Disallow: /dzen
Disallow: /edu/ping
Disallow: /edu/tasks
Disallow: /edu/teachers
Disallow: /edu/test
Disallow: /experiments.xml
Disallow: /formfeedback
Disallow: /fresh
Disallow: /goto_issue/
Disallow: /goto_rubric/
Disallow: /i/
Disallow: /images-data
Disallow: /images.html
Disallow: /images/*
Disallow: /images-apphost/*

Allow: /images/$
Allow: /images/smart/$
Allow: /images/touch/$
Allow: /images/touch/?
Allow: /images/search?text=*&source=morda*
Allow: /images/search?rpt=imageview
Allow: /images/touch/search?text=*&source=morda*
Allow: /images/touch/search?rpt=imageview
Allow: /images/pad/search?text=*&source=morda*
Allow: /images/pad/search?rpt=imageview

Disallow: /index_m
Disallow: /infected
Disallow: /iznanka/
Allow: /health/
Disallow: /keyboard_qwerty.html
Disallow: /logotypes

Disallow: /local/

Disallow: /more_samples
Disallow: /msearch
Disallow: /msearchpart
Disallow: /map-constructor/loader*
Disallow: /maps?
Disallow: /maps/*?
Disallow: /maps/-/*
Disallow: /maps/print/*
Allow: /maps/*?lang=ru$
Allow: /maps/*?lang=uk$
Allow: /maps/*?lang=kk$
Allow: /maps/*?lang=uz$
Disallow: /nmaps/*?
Disallow: /mapeditor/*?

Disallow: /metro/*?from

Disallow: /norobot
Disallow: /opensearch.xml
Disallow: /padsearch
Disallow: /people/*
Allow: /people$
Allow: /people/$
Allow: /people/pad/$
Allow: /people/pad$
Disallow: /person
Disallow: /podpiska/login.pl
Disallow: /pogoda/search
Disallow: /pogoda/404
Disallow: /pogoda/*?*lat=*&*lon=*
Disallow: /pogoda/*?*lon=*&*lat=*

Disallow: /polling
Disallow: /poll/
Disallow: /prefetch
Disallow: /promo/*goodbye*
Disallow: /promo/diskelement
Disallow: /promo/launcher/mgoodbye/*
Disallow: /promo/skype*?*
Disallow: /promo/skype/*/*
Disallow: /promo/*welcome*
Disallow: /promo/yobject/changelog*

Disallow: /q/profile/*/answers
Disallow: /q/profile/*/questions
Disallow: /q/profile/*/verifies
Disallow: /q/profile/*/articles
Disallow: /q/profile/*/subscribers
Disallow: /q/profile/*/org_answers
Disallow: /q/user/*/answers
Disallow: /q/user/*/questions
Disallow: /q/user/*/verifies
Disallow: /q/user/*/articles
Disallow: /q/user/*/subscribers
Disallow: /q/user/*/org_answers

Disallow: /soft/bm/goodbye
Disallow: /soft/chrome/ext-install/*
Disallow: /soft/chrome/searchline-install/*
Disallow: /soft/*goodbye*
Disallow: /soft/punto/mac/uninstall/*
Disallow: /soft/punto/win/uninstall/*
Disallow: /soft/*welcome*
Disallow: /soft/win/?*
Disallow: /quotes
Disallow: /redir
Disallow: /region_map
Disallow: /regions_list.xml
Disallow: /regions.html?
Disallow: /rubric2sport
Disallow: /s/
Disallow: /save
Disallow: /safety/?*
Disallow: /search
Allow: /search/entity/touch/
Disallow: /setup
Disallow: /showcaptcha
Disallow: /sitesearch
Disallow: /skazki
Disallow: /sl/*.html
Disallow: /soft/extensions/goodbye
Disallow: /sportagent
Disallow: /storeclick
Disallow: /storerequest
Disallow: /subscribe/confirm.pl
Disallow: /subscribe/view.pl

Allow: /support/
Disallow: /support/direct-images
Disallow: /support/direct-tooltips
Disallow: /support/distr
Disallow: /support/dsp
Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
Disallow: /support/maps-beta
Disallow: /support/market-images
Disallow: /support/security
Disallow: /support/webmaster-images
Disallow: /support/*zout_
Disallow: /support/search-results/
Disallow: /support/praktikum/flow.html

Disallow: /talk/create
Disallow: /talk/api
Disallow: /talk/user/*/article
Allow: /talk
Allow: /talk/user
Disallow: /telsearch
Disallow: /themes
Disallow: /toggle-experiment
Disallow: /touchsearch
Disallow: /tune*retpath=

Allow: /ugcpub/
Disallow: /ugcpub/cabinet

Disallow: /v$
Disallow: /viewconfig$
Disallow: /video/v$
Disallow: /video/viewconfig$
Disallow: /images/v$
Disallow: /images/viewconfig$

Allow: /uslugi/*
Disallow: /uslugi/cab
Disallow: /uslugi/*/category/doctors/

Allow: /tutor
Disallow: /tutor/admin
Disallow: /tutor/search/problems

Disallow: /versions
Disallow: /video/*
Disallow: /video/*filmId=*
Disallow: /video/search
Disallow: /video/preview
Disallow: /video/*/search
Disallow: /video/*/preview
Allow: /video/$
Allow: /video/?
Allow: /video/sitemap
Allow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/*text=
Allow: /video/dizi-izle/
Allow: /video/dizi-izle/?
Allow: /video/yerli-dizi-izle/
Allow: /video/yabanci-dizi-izle/
Allow: /video/touch/
Allow: /video/pad/
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%B2%D0%BD%D0%B5-%D0%B8%D0%B3%D1%80%D1%8B*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%B4%D0%BE%D0%BC%D0%B0%D1%88%D0%BD%D0%B8%D0%B9-%D0%B0%D1%80%D0%B5%D1%81%D1%82*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%BC%D0%B8%D1%81%D1%82%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%B8%D0%B5-%D0%B8%D1%81%D1%82%D0%BE%D1%80%D0%B8%D0%B8*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%BE%D1%81%D1%82%D0%BE%D1%80%D0%BE%D0%B6%D0%BD%D0%BE-%D0%B7%D0%B5%D0%BC%D0%BB%D1%8F%D0%BD%D0%B5*
Disallow: /xmlsearch

Disallow: /yaca
Allow: /yaca/$
Allow: /yaca/m/$
Allow: /yaca/m/yca/cat/*/$
Allow: /yaca/*.xml$
Allow: /yaca/cat/*/$
Disallow: /yaca/result.xml
Disallow: /yaca/*/tungrp/
Disallow: /yaca/*/time/
Disallow: /yaca/*/geo/
Disallow: /yaca/cat/*/geo/*
Disallow: /yaca/*/synt2/
Disallow: /yandsearch
Disallow: /yca/cy

Allow: /yac2014
Disallow: /soft/distribution
Disallow: /soft/?*
Disallow: /promo/launcher/?*
Disallow: /opera/?*
Disallow: /firefox/?*
Disallow: /soft/bm/?*
Disallow: /soft/browsers/?*
Disallow: /soft/punto/?*
Disallow: /ie/?*
Disallow: /element/?*
Disallow: /element/*goodbye*
Disallow: /soft/*goodbye*
Disallow: /adult

Disallow: /sport*?*parent-reqid*
Disallow: /mirror*?*parent-reqid*
Disallow: /turbo*?*parent-reqid*
Disallow: /mirror/hide

Disallow: /turbo*?*ajax=1*
Disallow: /sport*?*ajax=1*
Disallow: /mirror*?*ajax=1*

Clean-Param: ncrnd&redircnt&clid&_&win /
Clean-Param: utm_source&utm_medium&utm_campaign&utm_term&utm_content&utm_nooverride&utm_expid&gclid&_openstat&yclid&gsaid&_gs_rmark&_gs_ref&_gs_cttl&iframe /health/
Clean-Param: p&msp&occupationId&specId&serviceId&rubric&afterWorkerPage&clarifier&create_order&workerId&categoryId&specializationId&title&onlyForInvited&price&priceMeasure&isPromotion&from&source&region&max_reactions_count&adbody&adurl&backpath&query&saas_webreqid&action&displayid&promoAction&ref&orderId&utm&ig_source&creative&campaignid&adgroupid&worker_id&order_access_key&push_id&intent&family&status&t&tss&utm_campa&utm_left&utm_sup_project&utm_sup_source&utm_sup_type&yhid /uslugi/*
Clean-Param: view&lonlat&span&baobab_event_id&etext&q&wizextra&utm_source&utm_medium&utm_campaign&utm_content&yclid&utm_term&clid&wprid&yaclid&id&noreask&retflag&type&completely_moderated&address_type&yandex_ad_order_id&acton&yandex_ad_client_id&idkey&city&geoname_exact&phone&repeatOrderId&call_center&retpath&exp_boxes&gref&referrer&cc&keyword&fyandex&state&code&description&template&s&lr&region_id&onboardingStep&bathroom&room&amp&createCleaningStep&selfieType&address&customerName /uslugi/*
Clean-Param: afterRegistration&gclid&selfieStep&whenGoDatetime&form_source&utm_from&queryReason&complainOrderId&cleaningCustomFormStep&review&customerEmail&disableHeader&detectParams&sort_by&fn&showCustomerPhone&sort_order&am_social&utm_sourc&distr_type&i&vid&fp&name&z&mclid&n&tkn&ut&pp&utm_so&fromQrCode&searchable&puid&utm_cgid&collectionId&go&m&redircnt&surname&useAddress&_aid&ard&c&cardId&cbir_page&cliff&language&list&cbird&ts&utm_m&w&country&Brow&banerid&eea&o&plc&utm_campaig /uslugi/*
Clean-Param: index&is_copy_url&utm_med&is_from_webapp&ncrnd&rpt&smartleads_src&url&utm_me&_prevcmd&cmbck&dedica&gbraid&lc&smartleads_pid&utm_&displayId /uslugi/*
Clean-Param: print=1 /tutor/
Clean-Param: w&w_question_id /q/question/*
Clean-Param: &appsearch_header=1&comments=1 /news/story/
Clean-Param: random_cgi&sign /turbo*
Clean-Param: app-id&game-id&div-rtx-reqid&lang&platform&header&from /games/

Sitemap: https://yandex.ru/pogoda/sitemap_index.xml
Sitemap: https://yandex.ru/support/sitemap.xml
Sitemap: https://yandex.ru/blog/sitemap.xml
Sitemap: https://yandex.ru/znatoki/sitemap/sitemap-index.xml
Sitemap: https://frontend.s3.yandex.net/health/sitemap.xml
Sitemap: https://yandex.ru/talk/sitemap.xml
Sitemap: https://yandex.ru/uslugi/sitemap/sitemap.xml.gz
Sitemap: https://yandex.ru/turbo/public/sitemap.xml
Sitemap: https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml
Sitemap: https://yandex.ru/turbo/talk-sitemap-index.xml
Sitemap: https://yandex.ru/patents/sitemap/sitemap.xml
Sitemap: https://yandex.ru/games/sitemaps/sitemap.index.xml
Sitemap: https://yandex.ru/q/sitemap/sitemap-index.xml
Sitemap: https://yandex.ru/efir/sitemap.xml
Sitemap: https://yandex.ru/images/sitemap.xml

User-Agent: Twitterbot
Allow: /images
Allow: /gorsel
Allow: /video
Allow: /collections/picture/
Disallow: /adult
Allow: /ugcpub/
Disallow: /ugcpub/cabinet
Sitemap: https://yandex.ru/pogoda/sitemap_index.xml
Sitemap: https://yandex.ru/support/sitemap.xml
Sitemap: https://yandex.ru/blog/sitemap.xml
Sitemap: https://yandex.ru/znatoki/sitemap/sitemap-index.xml
Sitemap: https://frontend.s3.yandex.net/health/sitemap.xml
Sitemap: https://yandex.ru/talk/sitemap.xml
Sitemap: https://yandex.ru/uslugi/sitemap/sitemap.xml.gz
Sitemap: https://yandex.ru/turbo/public/sitemap.xml
Sitemap: https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml
Sitemap: https://yandex.ru/turbo/talk-sitemap-index.xml
Sitemap: https://yandex.ru/patents/sitemap/sitemap.xml
Sitemap: https://yandex.ru/games/sitemaps/sitemap.index.xml
Sitemap: https://yandex.ru/q/sitemap/sitemap-index.xml
Sitemap: https://yandex.ru/efir/sitemap.xml
Sitemap: https://yandex.ru/images/sitemap.xml

User-agent: Applebot
Disallow: /?
Disallow: /403.html
Disallow: /404.html
Disallow: /500.html
Disallow: /about.html
Disallow: /adddata
Disallow: /adresa-segmentator
Disallow: /advanced_engl.html
Disallow: /advertising
Disallow: /all-supported-params
Disallow: /articles
Disallow: /aura/
Allow: /aura/promo/
Disallow: /blog/*?text=
Disallow: /blog/*?tag=
Disallow: /blog/*/*/*
Disallow: /blog/punto
Disallow: /blogs*
Allow: /blogs$
Allow: /blogs/$
Allow: /blogs/pad/$
Allow: /blogs/pad$

Disallow: /bus/orders*
Disallow: /bus/api/*

Disallow: /catalog/?text=
Disallow: /chat
Disallow: /cgi-bin/
Disallow: /cgi/
Disallow: /chisla.html
Disallow: /clck

Disallow: /collections/feed
Disallow: /collections/search/
Disallow: /collections/*/search/*
Disallow: /collections/iznanka/
Disallow: /collections/*/_followers*
Disallow: /collections/*/_followings*
Disallow: /collections/share
Disallow: /collections/favorites
Disallow: /collections/embed
Disallow: /collections/picture/

Disallow: /company/*.rss
Disallow: /company/search

Disallow: /comments/*

Disallow: /courier

Disallow: /conflagexp
Disallow: /cy
Disallow: /cycounter
Disallow: /dzen
Disallow: /edu/ping
Disallow: /edu/tasks
Disallow: /edu/teachers
Disallow: /edu/test
Disallow: /experiments.xml
Disallow: /formfeedback
Disallow: /fresh
Disallow: /goto_issue/
Disallow: /goto_rubric/
Disallow: /i/
Disallow: /images-data
Disallow: /images.html
Disallow: /images/*
Allow: /images/$
Allow: /images/smart/$
Allow: /images/touch/$
Allow: /images/touch/?
Allow: /images/search?text=*&source=morda*
Allow: /images/search?rpt=imageview
Allow: /images/touch/search?text=*&source=morda*
Allow: /images/touch/search?rpt=imageview
Allow: /images/pad/search?text=*&source=morda*
Allow: /images/pad/search?rpt=imageview


Disallow: /index_m
Disallow: /infected
Disallow: /iznanka/
Allow: /health/
Disallow: /keyboard_qwerty.html

Disallow: /local/

Disallow: /logotypes
Disallow: /map-constructor/loader*
Disallow: /more_samples
Disallow: /msearch
Disallow: /msearchpart
Disallow: /nmaps/*?
Allow: /maps/org/
Disallow: /mapeditor/*?

Disallow: /metro/*?from

Disallow: /norobot
Disallow: /opensearch.xml
Disallow: /padsearch
Disallow: /people/*
Allow: /people$
Allow: /people/$
Allow: /people/pad/$
Allow: /people/pad$
Disallow: /person
Disallow: /podpiska/login.pl
Disallow: /pogoda/search
Disallow: /pogoda/404
Disallow: /pogoda/*?*lat=*&*lon=*
Disallow: /pogoda/*?*lon=*&*lat=*

Disallow: /polling
Disallow: /poll/
Disallow: /promo/*goodbye*
Disallow: /promo/diskelement
Disallow: /promo/launcher/mgoodbye/*
Disallow: /promo/skype*?*
Disallow: /promo/skype/*/*
Disallow: /promo/*welcome*
Disallow: /promo/yobject/changelog*

Disallow: /q/profile/*/answers
Disallow: /q/profile/*/questions
Disallow: /q/profile/*/verifies
Disallow: /q/profile/*/articles
Disallow: /q/profile/*/subscribers
Disallow: /q/profile/*/org_answers
Disallow: /q/user/*/answers
Disallow: /q/user/*/questions
Disallow: /q/user/*/verifies
Disallow: /q/user/*/articles
Disallow: /q/user/*/subscribers
Disallow: /q/user/*/org_answers

Disallow: /soft/bm/goodbye
Disallow: /soft/chrome/ext-install/*
Disallow: /soft/chrome/searchline-install/*
Disallow: /soft/*goodbye*
Disallow: /soft/punto/mac/uninstall/*
Disallow: /soft/punto/win/uninstall/*
Disallow: /soft/*welcome*
Disallow: /soft/win/?*
Disallow: /quotes
Disallow: /redir
Disallow: /region_map
Disallow: /regions_list.xml
Disallow: /regions.html?
Disallow: /rubric2sport
Disallow: /s/
Disallow: /save
Disallow: /safety/?*
Disallow: /search
Allow: /search/entity/touch/
Disallow: /set/
Disallow: /setup
Disallow: /showcaptcha
Disallow: /sitesearch
Disallow: /skazki
Disallow: /sl/*.html
Disallow: /soft/extensions/goodbye
Disallow: /sportagent
Disallow: /storeclick
Disallow: /storerequest
Disallow: /subscribe/confirm.pl
Disallow: /subscribe/view.pl

Allow: /support/
Disallow: /support/direct-images
Disallow: /support/direct-tooltips
Disallow: /support/distr
Disallow: /support/dsp
Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
Disallow: /support/maps-beta
Disallow: /support/market-images
Disallow: /support/security
Disallow: /support/webmaster-images
Disallow: /support/*zout_
Disallow: /support/search-results/
Disallow: /support/praktikum/flow.html

Disallow: /talk/create
Disallow: /talk/api
Disallow: /talk/user/*/article
Allow: /talk
Allow: /talk/user
Disallow: /telsearch
Disallow: /themes
Disallow: /toggle-experiment
Disallow: /touchsearch
Disallow: /tune*retpath=

Allow: /tutor
Disallow: /tutor/admin

Allow: /ugcpub/
Disallow: /ugcpub/cabinet

Disallow: /v$
Disallow: /viewconfig$
Disallow: /video/v$
Disallow: /video/viewconfig$
Disallow: /images/v$
Disallow: /images/viewconfig$

Allow: /uslugi/*
Disallow: /uslugi/cab
Disallow: /uslugi/*/category/doctors/

Disallow: /versions
Disallow: /video/*
Disallow: /video/*filmId=*
Allow: /video/$
Allow: /video/?
Allow: /video/sitemap
Allow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/*text=
Allow: /video/dizi-izle/
Allow: /video/dizi-izle/?
Allow: /video/yerli-dizi-izle/
Allow: /video/yabanci-dizi-izle/
Allow: /video/touch/
Allow: /video/pad/
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%B2%D0%BD%D0%B5-%D0%B8%D0%B3%D1%80%D1%8B*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%B4%D0%BE%D0%BC%D0%B0%D1%88%D0%BD%D0%B8%D0%B9-%D0%B0%D1%80%D0%B5%D1%81%D1%82*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%BC%D0%B8%D1%81%D1%82%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%B8%D0%B5-%D0%B8%D1%81%D1%82%D0%BE%D1%80%D0%B8%D0%B8*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%BE%D1%81%D1%82%D0%BE%D1%80%D0%BE%D0%B6%D0%BD%D0%BE-%D0%B7%D0%B5%D0%BC%D0%BB%D1%8F%D0%BD%D0%B5*
Disallow: /xmlsearch

Disallow: /yaca
Allow: /yaca/$
Allow: /yaca/m/$
Allow: /yaca/m/yca/cat/*/$
Allow: /yaca/*.xml$
Allow: /yaca/cat/*/$
Disallow: /yaca/result.xml
Disallow: /yaca/*/tungrp/
Disallow: /yaca/*/time/
Disallow: /yaca/*/geo/
Disallow: /yaca/cat/*/geo/*
Disallow: /yaca/*/synt2/
Disallow: /yandsearch
Disallow: /yca/cy

Allow: /yac2014
Disallow: /soft/distribution
Disallow: /soft/?*
Disallow: /promo/launcher/?*
Disallow: /opera/?*
Disallow: /firefox/?*
Disallow: /soft/bm/?*
Disallow: /soft/browsers/?*
Disallow: /soft/punto/?*
Disallow: /ie/?*
Disallow: /element/?*
Disallow: /element/*goodbye*
Disallow: /soft/*goodbye*
Disallow: /adult

Clean-Param: ncrnd&redircnt&clid&_&win /
Clean-Param: utm_source&utm_medium&utm_campaign&utm_term&utm_content&utm_nooverride&utm_expid&gclid&_openstat&yclid&gsaid&_gs_rmark&_gs_ref&_gs_cttl&iframe /health/
Clean-Param: p&msp&occupationId&specId&serviceId&rubric&afterWorkerPage&clarifier&create_order&workerId&categoryId&specializationId&title&onlyForInvited&price&priceMeasure&isPromotion&from&source&region&max_reactions_count&adbody&adurl&backpath&query&saas_webreqid&action&displayid&promoAction&ref&orderId&utm&ig_source&creative&campaignid&adgroupid&worker_id&order_access_key&push_id&intent&family&status&t&tss&utm_campa&utm_left&utm_sup_project&utm_sup_source&utm_sup_type&yhid /uslugi/*
Clean-Param: view&lonlat&span&baobab_event_id&etext&q&wizextra&utm_source&utm_medium&utm_campaign&utm_content&yclid&utm_term&clid&wprid&yaclid&id&noreask&retflag&type&completely_moderated&address_type&yandex_ad_order_id&acton&yandex_ad_client_id&idkey&city&geoname_exact&phone&repeatOrderId&call_center&retpath&exp_boxes&gref&referrer&cc&keyword&fyandex&state&code&description&template&s&lr&region_id&onboardingStep&bathroom&room&amp&createCleaningStep&selfieType&address&customerName /uslugi/*
Clean-Param: afterRegistration&gclid&selfieStep&whenGoDatetime&form_source&utm_from&queryReason&complainOrderId&cleaningCustomFormStep&review&customerEmail&disableHeader&detectParams&sort_by&fn&showCustomerPhone&sort_order&am_social&utm_sourc&distr_type&i&vid&fp&name&z&mclid&n&tkn&ut&pp&utm_so&fromQrCode&searchable&puid&utm_cgid&collectionId&go&m&redircnt&surname&useAddress&_aid&ard&c&cardId&cbir_page&cliff&language&list&cbird&ts&utm_m&w&country&Brow&banerid&eea&o&plc&utm_campaig /uslugi/*
Clean-Param: index&is_copy_url&utm_med&is_from_webapp&ncrnd&rpt&smartleads_src&url&utm_me&_prevcmd&cmbck&dedica&gbraid&lc&smartleads_pid&utm_&displayId /uslugi/*
Clean-Param: print=1 /tutor/
Clean-Param: w&w_question_id /q/question/*
Clean-Param: &appsearch_header=1&comments=1 /news/story/
Clean-Param: random_cgi&sign /turbo*
Clean-Param: app-id&game-id&div-rtx-reqid&lang&platform&header&from /games/

Sitemap: https://yandex.ru/pogoda/sitemap_index.xml
Sitemap: https://yandex.ru/support/sitemap.xml
Sitemap: https://yandex.ru/blog/sitemap.xml
Sitemap: https://yandex.ru/znatoki/sitemap/sitemap-index.xml
Sitemap: https://frontend.s3.yandex.net/health/sitemap.xml
Sitemap: https://yandex.ru/talk/sitemap.xml
Sitemap: https://yandex.ru/uslugi/sitemap/sitemap.xml.gz
Sitemap: https://yandex.ru/turbo/public/sitemap.xml
Sitemap: https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml
Sitemap: https://yandex.ru/turbo/talk-sitemap-index.xml
Sitemap: https://yandex.ru/patents/sitemap/sitemap.xml
Sitemap: https://yandex.ru/games/sitemaps/sitemap.index.xml
Sitemap: https://yandex.ru/q/sitemap/sitemap-index.xml
Sitemap: https://yandex.ru/efir/sitemap.xml
Sitemap: https://yandex.ru/images/sitemap.xml

User-agent: Yandex
Disallow: /?
Disallow: /403.html
Disallow: /404.html
Disallow: /500.html
Disallow: /about.html
Disallow: /adddata
Disallow: /adresa-segmentator
Disallow: /advanced_engl.html
Disallow: /advertising
Disallow: /all-supported-params
Disallow: /articles
Disallow: /aura/
Allow: /aura/promo/
Disallow: /blog/*?text=
Disallow: /blog/*?tag=
Disallow: /blog/*/*/*
Disallow: /blog/punto
Disallow: /blogs*
Allow: /blogs$
Allow: /blogs/$
Allow: /blogs/pad/$
Allow: /blogs/pad$

Disallow: /bus/orders*
Disallow: /bus/api/*

Disallow: /catalog/?text=
Disallow: /chat
Disallow: /cgi-bin/
Disallow: /cgi/
Disallow: /chisla.html
Disallow: /clck

Disallow: /collections/feed
Disallow: /collections/search/
Disallow: /collections/*/search/*
Disallow: /collections/iznanka/
Disallow: /collections/*/_followers*
Disallow: /collections/*/_followings*
Disallow: /collections/share
Disallow: /collections/favorites
Disallow: /collections/embed
Disallow: /collections/picture/

Disallow: /company/*.rss
Disallow: /company/search

Disallow: /comments/*

Disallow: /courier

Disallow: /conflagexp
Disallow: /cy
Disallow: /cycounter
Disallow: /dzen
Disallow: /edu/ping
Disallow: /edu/tasks
Disallow: /edu/teachers
Disallow: /edu/test
Disallow: /experiments.xml
Disallow: /formfeedback
Disallow: /fresh
Disallow: /goto_issue/
Disallow: /goto_rubric/
Disallow: /i/
Disallow: /images-data
Disallow: /images.html
Disallow: /images/*
Allow: /images/$
Allow: /images/smart/$
Allow: /images/touch/$
Allow: /images/touch/?
Allow: /images/search?text=*&source=morda*
Allow: /images/search?rpt=imageview
Allow: /images/touch/search?text=*&source=morda*
Allow: /images/touch/search?rpt=imageview
Allow: /images/pad/search?text=*&source=morda*
Allow: /images/pad/search?rpt=imageview


Disallow: /index_m
Disallow: /infected
Disallow: /iznanka/
Allow: /health/
Disallow: /keyboard_qwerty.html
Disallow: /logotypes

Disallow: /local/

Disallow: /more_samples
Disallow: /msearch
Disallow: /msearchpart
Disallow: /map-constructor/loader*
Disallow: /maps?
Disallow: /maps/*?
Disallow: /maps/-/*
Disallow: /maps/print/*
Allow: /maps/*?ll=*
Allow: /maps/*?lang=ru$
Allow: /maps/*?lang=uk$
Allow: /maps/org/
Disallow: /nmaps/*?
Disallow: /mapeditor/*?

Disallow: /metro/*?from

Disallow: /norobot
Disallow: /opensearch.xml
Disallow: /padsearch
Disallow: /people/*
Allow: /people$
Allow: /people/$
Allow: /people/pad/$
Allow: /people/pad$
Disallow: /person
Disallow: /podpiska/login.pl
Disallow: /pogoda/search
Disallow: /pogoda/404
Disallow: /pogoda/*?*lat=*&*lon=*
Disallow: /pogoda/*?*lon=*&*lat=*

Disallow: /polling
Disallow: /poll/
Disallow: /promo/*goodbye*
Disallow: /promo/diskelement
Disallow: /promo/launcher/mgoodbye/*
Disallow: /promo/skype*?*
Disallow: /promo/skype/*/*
Disallow: /promo/*welcome*
Disallow: /promo/yobject/changelog*

Disallow: /q/profile/*/answers
Disallow: /q/profile/*/questions
Disallow: /q/profile/*/verifies
Disallow: /q/profile/*/articles
Disallow: /q/profile/*/subscribers
Disallow: /q/profile/*/org_answers
Disallow: /q/user/*/answers
Disallow: /q/user/*/questions
Disallow: /q/user/*/verifies
Disallow: /q/user/*/articles
Disallow: /q/user/*/subscribers
Disallow: /q/user/*/org_answers

Disallow: /soft/bm/goodbye
Disallow: /soft/chrome/ext-install/*
Disallow: /soft/chrome/searchline-install/*
Disallow: /soft/*goodbye*
Disallow: /soft/punto/mac/uninstall/*
Disallow: /soft/punto/win/uninstall/*
Disallow: /soft/*welcome*
Disallow: /soft/win/?*
Disallow: /quotes
Disallow: /redir
Disallow: /region_map
Disallow: /regions_list.xml
Disallow: /regions.html?
Disallow: /rubric2sport
Disallow: /s/
Disallow: /save
Disallow: /safety/?*
Disallow: /search
Allow: /search/entity/touch/
Disallow: /setup
Disallow: /showcaptcha
Disallow: /sitesearch
Disallow: /skazki
Disallow: /sl/*.html
Disallow: /soft/extensions/goodbye
Disallow: /sportagent
Disallow: /storeclick
Disallow: /storerequest
Disallow: /subscribe/confirm.pl
Disallow: /subscribe/view.pl

Allow: /support/
Disallow: /support/direct-images
Disallow: /support/direct-tooltips
Disallow: /support/distr
Disallow: /support/dsp
Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
Disallow: /support/maps-beta
Disallow: /support/market-images
Disallow: /support/security
Disallow: /support/webmaster-images
Disallow: /support/*zout_
Disallow: /support/search-results/
Disallow: /support/praktikum/flow.html

Disallow: /talk/create
Disallow: /talk/api
Disallow: /talk/user/*/article
Allow: /talk
Allow: /talk/user
Disallow: /telsearch
Disallow: /themes
Disallow: /toggle-experiment
Disallow: /touchsearch
Disallow: /tune*retpath=

Allow: /tutor
Disallow: /tutor/admin
Sitemap: https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml

Allow: /ugcpub/
Disallow: /ugcpub/cabinet

Disallow: /v$
Disallow: /viewconfig$
Disallow: /video/v$
Disallow: /video/viewconfig$
Disallow: /images/v$
Disallow: /images/viewconfig$

Disallow: /uslugi/*
Disallow: /uslugi/cab
Disallow: /uslugi/*/category/doctors/

Disallow: /versions
Disallow: /video/*
Disallow: /video/*filmId=*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/*text=
Allow: /video/$
Allow: /video/?
Allow: /video/sitemap
Allow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/
Allow: /video/dizi-izle/
Allow: /video/dizi-izle/?
Allow: /video/yerli-dizi-izle/
Allow: /video/yabanci-dizi-izle/
Allow: /video/touch/
Allow: /video/pad/
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%B2%D0%BD%D0%B5-%D0%B8%D0%B3%D1%80%D1%8B*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%B4%D0%BE%D0%BC%D0%B0%D1%88%D0%BD%D0%B8%D0%B9-%D0%B0%D1%80%D0%B5%D1%81%D1%82*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%BC%D0%B8%D1%81%D1%82%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%B8%D0%B5-%D0%B8%D1%81%D1%82%D0%BE%D1%80%D0%B8%D0%B8*
Disallow: /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/%D1%81%D0%B5%D1%80%D0%B8%D0%B0%D0%BB/%D0%BE%D1%81%D1%82%D0%BE%D1%80%D0%BE%D0%B6%D0%BD%D0%BE-%D0%B7%D0%B5%D0%BC%D0%BB%D1%8F%D0%BD%D0%B5*
Disallow: /xmlsearch

Disallow: /yaca
Allow: /yaca/$
Allow: /yaca/m/$
Allow: /yaca/m/yca/cat/*/$
Allow: /yaca/*.xml$
Allow: /yaca/cat/*/$
Disallow: /yaca/result.xml
Disallow: /yaca/*/tungrp/
Disallow: /yaca/*/time/
Disallow: /yaca/*/geo/
Disallow: /yaca/cat/*/geo/*
Disallow: /yaca/*/synt2/
Disallow: /yandsearch
Disallow: /yca/cy

Allow: /yac2014
Disallow: /soft/distribution
Disallow: /soft/?*
Disallow: /promo/launcher/?*
Disallow: /opera/?*
Disallow: /firefox/?*
Disallow: /soft/bm/?*
Disallow: /soft/browsers/?*
Disallow: /soft/punto/?*
Disallow: /ie/?*
Disallow: /element/?*
Disallow: /element/*goodbye*
Disallow: /soft/*goodbye*
Disallow: /adult

Clean-Param: ncrnd&redircnt&clid&_&win /
Clean-Param: utm_source&utm_medium&utm_campaign&utm_term&utm_content&utm_nooverride&utm_expid&gclid&_openstat&yclid&gsaid&_gs_rmark&_gs_ref&_gs_cttl&iframe /health/
Clean-Param: p&msp&occupationId&specId&serviceId&rubric&afterWorkerPage&clarifier&create_order&workerId&categoryId&specializationId&title&onlyForInvited&price&priceMeasure&isPromotion&from&source&region&max_reactions_count&adbody&adurl&backpath&query&saas_webreqid&action&displayid&promoAction&ref&orderId&utm&ig_source&creative&campaignid&adgroupid&worker_id&order_access_key&push_id&intent&family&status&t&tss&utm_campa&utm_left&utm_sup_project&utm_sup_source&utm_sup_type&yhid /uslugi/*
Clean-Param: view&lonlat&span&baobab_event_id&etext&q&wizextra&utm_source&utm_medium&utm_campaign&utm_content&yclid&utm_term&clid&wprid&yaclid&id&noreask&retflag&type&completely_moderated&address_type&yandex_ad_order_id&acton&yandex_ad_client_id&idkey&city&geoname_exact&phone&repeatOrderId&call_center&retpath&exp_boxes&gref&referrer&cc&keyword&fyandex&state&code&description&template&s&lr&region_id&onboardingStep&bathroom&room&amp&createCleaningStep&selfieType&address&customerName /uslugi/*
Clean-Param: afterRegistration&gclid&selfieStep&whenGoDatetime&form_source&utm_from&queryReason&complainOrderId&cleaningCustomFormStep&review&customerEmail&disableHeader&detectParams&sort_by&fn&showCustomerPhone&sort_order&am_social&utm_sourc&distr_type&i&vid&fp&name&z&mclid&n&tkn&ut&pp&utm_so&fromQrCode&searchable&puid&utm_cgid&collectionId&go&m&redircnt&surname&useAddress&_aid&ard&c&cardId&cbir_page&cliff&language&list&cbird&ts&utm_m&w&country&Brow&banerid&eea&o&plc&utm_campaig /uslugi/*
Clean-Param: index&is_copy_url&utm_med&is_from_webapp&ncrnd&rpt&smartleads_src&url&utm_me&_prevcmd&cmbck&dedica&gbraid&lc&smartleads_pid&utm_&displayId /uslugi/*
Clean-Param: print=1 /tutor/
Clean-Param: w&w_question_id /q/question/*
Clean-Param: &appsearch_header=1&comments=1 /news/story/
Clean-Param: random_cgi&sign /turbo*
Clean-Param: app-id&game-id&div-rtx-reqid&lang&platform&header&from /games/

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of yandex.ru is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/yandex.ru