mts.ru: what it tells AI crawlers

On 28 October 2026, mts.ru's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-29 03:59 UTC (daily run of 2026-10-28). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://moskva.mts.ru/robotstxt
unchanged since 2026-10-26 · sha256 46a6e3c31f4f92c1… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-28

Other signals

robots.txt as recorded sha256 46a6e3c31f4f92c1…

User-agent: * 
Disallow: /*?*
Disallow: /*.axd$ 
Disallow: /business/sber* 
Disallow: /business/new* 
Disallow: /free_internet_business* 
Disallow: /*91018* 
Disallow: /mmk* 
Disallow: /personal/izmenenie-parametrov-opcij-domashnij-paket-rossiya-domashnij-paket-rossiya* 
Disallow: /*biznes-bezlimit-i-gotoviy-ofis* 
Disallow: /*izmeneniya-na-tarifah-040319* 
Disallow: /*05-08/informacionnoe-soobshhenie-pao-mts* 
Disallow: /*2021-02-18/izmenenie-parametrov-ryada* 
Disallow: /*05-17/izmenenie-odnogo-iz-parametrov-na-tarifah-h-moj-bezlimitishhe-linejkah-smart* 
Disallow: /*01-18/informa* 
Disallow: /*0-19/informa* 
Disallow: /*tarifishhe-i-v-ramkah-opcii* 
Disallow: /*0-26/informa* 
Disallow: /*er2Q* 
Disallow: /*rttr* 
Disallow: /*v_ver* 
Disallow: /*salon_krasoty* 
Disallow: /*stomatolog* 
Disallow: /*smartavto* 
Disallow: /*ap-mus* 
Disallow: /*tinder-gold-t* 
Disallow: /*na-ryade-tarifov-menyaetsya-stoimost-mezhdugorodnej-svyazi-v-poezdkah-po-rossii* 
Disallow: /*izmenenie-cenovyh-parametrov-ryada-uslug-fiksirovannoj-svyazi-dlya-korporativnyh-klientov* 
Disallow: /personal/vse-akcii/usloviya-akcii-podari-kion-poluchi-keshbek 
Disallow: /*katalog-uslug-fiksirovannoy-svyazi123* 
Disallow: /*tariff_so_skidkoy_30* 
Disallow: /*ves-mts-podpiska-ivi* 
Disallow: /*ves-mts-podpiska-mult* 
Disallow: /*ves-mts-eset-nod32-internet-security* 
Disallow: /*vygodnoe-kombo-dilery* 
Disallow: /*vygodnoe-kombo-telefon* 
Disallow: /*podklyuchaj-paket-super-plus-na-sakvoyazh* 
Disallow: /*godovaya-podpiska-super-na-mts-tv-v-programme-loyalnosti-banka-vtb-multibonus* 
Disallow: /*marketingovaya-akciya-s-ooo-narodnaya-karta*
Disallow: /*usloviya-akcii-podpiska-super-v-1s-softklab* 
Disallow: /*podpiska-super-za-1-rubl* 
Disallow: /*podklyuchi-podpisku-super-za-1rubl-na-1mesyac*
Disallow: /*godovaya-podpiska-super-v-onlajnkinoteatre-mts-tv-za-1-rubl* 
Disallow: /*perevozka* 
Disallow: /*gkh* 
Disallow: /closetp* 
Disallow: /personal/closetp* 
Disallow: /*zabugorishhe1* 
Disallow: /*zabugorishhe2* 
Disallow: /*zabugorishhe3* 
Disallow: /*zabugorishhe4* 
Disallow: /business/*o-iot-dlya* 
Disallow: /personal/*presentation* 
Disallow: /*friend* 
Disallow: /*budte-spokojny-za-roditelej* 
Disallow: /*pomogi-rebenku-stat* 
Disallow: *?fromgt=* 
Disallow: *q= 
Disallow: /*_openstat= 
Disallow: /*_ga= 
Disallow: /*yclid= 
Disallow: /*ppc= 
Disallow: //static.mts.ru/mts_rf/images/zayavleniye_clienta_soho.docx 
Disallow: /malyi-business/trebovaniya-k-dokumentam* 
Disallow: /*podklyuchi-podpisku-super-na-2-mesyaca-za-1rubmes* 
Disallow: */mts_stream/ 
Disallow: *malyi-business 
Disallow: /personal/mobilnaya-svyaz/uslugi/mobilnaya-svyaz/dostup-k-facebook-bez-nalichiya-internet-trafika* 
Disallow: /personal/investicii* 
Disallow: /personal/dengi/bankovskie-karti* 
Disallow: /personal/mobilnaya-svyaz/tarifi/vse-tarifi/fit_internet_500_mbit* 
Disallow: /personal/vse-akcii/30_gb_k_tarifu_mts_bolshe
Disallow: /personal/esim-new*
Allow: /*gclid= 
Allow: /malyi-business$ 
Allow: *.css 
Allow: *.js 

User-agent: Yandex 
Disallow: /?*
Disallow: /*& 
Disallow: /*.axd$ 
Disallow: /business/sber* 
Disallow: /business/new* 
Disallow: /free_internet_business* 
Disallow: /*91018* 
Disallow: /mmk* 
Disallow: /personal/izmenenie-parametrov-opcij-domashnij-paket-rossiya-domashnij-paket-rossiya* 
Disallow: /*biznes-bezlimit-i-gotoviy-ofis* 
Disallow: /*izmeneniya-na-tarifah-040319* 
Disallow: /*05-08/informacionnoe-soobshhenie-pao-mts* 
Disallow: /*2021-02-18/izmenenie-parametrov-ryada* 
Disallow: /*05-17/izmenenie-odnogo-iz-parametrov-na-tarifah-h-moj-bezlimitishhe-linejkah-smart* 
Disallow: /*01-18/informa* 
Disallow: /*0-19/informa* 
Disallow: /*tarifishhe-i-v-ramkah-opcii* 
Disallow: /*0-26/informa* 
Disallow: /*er2Q* 
Disallow: /*rttr* 
Disallow: /*v_ver* 
Disallow: /*salon_krasoty* 
Disallow: /*stomatolog* 
Disallow: /*smartavto* 
Disallow: /*ap-mus* 
Disallow: /*tinder-gold-t* 
Disallow: /*na-ryade-tarifov-menyaetsya-stoimost-mezhdugorodnej-svyazi-v-poezdkah-po-rossii* 
Disallow: /*izmenenie-cenovyh-parametrov-ryada-uslug-fiksirovannoj-svyazi-dlya-korporativnyh-klientov* 
Disallow: /personal/vse-akcii/usloviya-akcii-podari-kion-poluchi-keshbek  
Disallow: /*katalog-uslug-fiksirovannoy-svyazi123* 
Disallow: /*tariff_so_skidkoy_30* 
Disallow: /*ves-mts-podpiska-ivi* 
Disallow: /*ves-mts-podpiska-mult* 
Disallow: /*ves-mts-eset-nod32-internet-security* 
Disallow: /*vygodnoe-kombo-dilery* 
Disallow: /*vygodnoe-kombo-telefon* 
Disallow: /*podklyuchaj-paket-super-plus-na-sakvoyazh* 
Disallow: /*godovaya-podpiska-super-na-mts-tv-v-programme-loyalnosti-banka-vtb-multibonus* 
Disallow: /*marketingovaya-akciya-s-ooo-narodnaya-karta* 
Disallow: /*usloviya-akcii-podpiska-super-v-1s-softklab* 
Disallow: /*podpiska-super-za-1-rubl* 
Disallow: /*podklyuchi-podpisku-super-za-1rubl-na-1mesyac* 
Disallow: /*godovaya-podpiska-super-v-onlajnkinoteatre-mts-tv-za-1-rubl* 
Disallow: /*perevozka* 
Disallow: /*gkh* 
Disallow: /closetp* 
Disallow: /personal/closetp* 
Disallow: /*zabugorishhe1* 
Disallow: /*zabugorishhe2* 
Disallow: /*zabugorishhe3* 
Disallow: /*zabugorishhe4* 
Disallow: /business/*o-iot-dlya* 
Disallow: /personal/*presentation* 
Disallow: /*friend* 
Disallow: /*budte-spokojny-za-roditelej* 
Disallow: /*pomogi-rebenku-stat* 
Disallow: *?fromgt=* 
Disallow: *q= 
Disallow: /*_openstat= 
Disallow: /*_ga= 
Disallow: /*yclid= 
Disallow: /*ppc= 
Disallow: /*&d= 
Disallow: //static.mts.ru/mts_rf/images/zayavleniye_clienta_soho.docx 
Disallow: /malyi-business/trebovaniya-k-dokumentam* 
Disallow: /*podklyuchi-podpisku-super-na-2-mesyaca-za-1rubmes* 
Disallow: */mts_stream/ 
Disallow: *malyi-business 
Disallow: /print* 
Disallow: /personal/mobilnaya-svyaz/uslugi/mobilnaya-svyaz/dostup-k-facebook-bez-nalichiya-internet-trafika* 
Disallow: /personal/mobilnaya-svyaz/tarifi/vse-tarifi/fit_internet_500_mbit* 
Disallow: /tic  
Disallow: /personal/vse-akcii/30_gb_k_tarifu_mts_bolshe
Disallow: /personal/esim-new*
Allow: /*gclid= 
Allow: /malyi-business$ 
Allow: *.css 
Allow: *.js 

# 1) Маркетинг/рефералы/клики
Clean-param: utm_source&utm_medium&utm_campaign&utm_content&utm_term&utm_referrer&utm_referer&utm_startpage&utm_orderpage&yclid&gclid&fbclid&openstat&from&from_pda&referrer&clickid&adrclid&erid&utm_erid&regionid&host&subcategory&oid&trk&+utm_source&utm_te+rm /

# 2) Appsflyer / диплинки
Clean-param: shortlink&c&pid&source_caller&deep_link_value&af_js_web&af_ss_ver&af_ss_ui /

# 3) UI/переключатели 
Clean-param: theme&brws&mymts_brws&on&tconnect&pageType&tabId&tabid /

# 4) Служебные/внутренние
Clean-param: _ma&is_retargeting&related-product-details&service_request_id&agent_login&link&source_alias&fromapp&report&f&bid&dy_cross-links&option-connect-flow&amp&erid /

Sitemap: https://moskva.mts.ru/sitemap.xml

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of mts.ru is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-28: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973640)).

API: https://infrarabbit.com/crawlers/api/v1/policy/mts.ru