vtb.ru: what it tells AI crawlers

On 26 October 2026, vtb.ru's robots.txt fully blocked GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-26 21:13 UTC (daily run of 2026-10-26). Proof for that day.

Panel

top 10k (Tranco)

robots.txt

ok (HTTP 200) · https://xn--90ab2c.xn--p1ai/robots.txt
unchanged since 2026-10-26 · sha256 6856255165e0c5f2… · view as recorded

The * group

blocks applies to every agent without its own group

Per AI bot, 2026-10-26

Other signals

robots.txt as recorded sha256 7e9b3710358cb37a…

User-Agent: *
#parametry
Disallow: /*?
Disallow: /*ssl

#razdely
Disallow: */-/ #zapret-vsego-krome-paris
Disallow: */media/Files/ #zapret-vseh-failov-v-papke
Disallow: */promo/
Disallow: /help
Disallow: /npb
 
#stranicy
Disallow: /delo/short/
Disallow: /ir/sustainability/
Disallow: /landing/nachnem-s-luchshego-net/
Disallow: /malyj-biznes/fos30/test/
Disallow: /malyj-biznes/kdelu/
Disallow: /malyj-biznes/kredity-i-garantii/sovmestnaya-programma-stimulirovaniya-i-lgotnogo-kreditovaniya/
Disallow: /malyj-biznes/smb-partners
Disallow: /malyj-biznes/tarify-i-komissii/paket-uslug/
Disallow: /malyj-biznes/tarify-i-komissii/rko/
Disallow: /malyj-biznes/zarplatniy-proekt-new/
Disallow: /personal/ipoteka/informacija-dlja-zaemshhikov/arenda-kvartiry/
Disallow: /personal/ipoteka/informacija-dlja-zaemshhikov/prodazha-kvartiry-iz-pod-zaloga/
Disallow: /personal/ipoteka/informacija-dlja-zaemshhikov/zamena-zaloga/$
Disallow: /personal/karty/help/personal/vklady-i-scheta/chastie-voprosy/
Disallow: /about/press/news/
Disallow: /about/press/ved-news/
Disallow: /personal/vklady-i-scheta/rncb/maksimalnyi/
Disallow: /personal/vklady-i-scheta/rncb/prime/
Disallow: /personal/vklady-i-scheta/rncb/upravlyaemyi/
Disallow: /personal/vklady-i-scheta/rncb/
Disallow: /personal/kreditnye-kanikuly/rncb/
Disallow: /personal/kreditnye-kanikuly/rncb/kreditnye-kanikuly-dlya-voennosluzhashih/
Disallow: /personal/kreditnye-kanikuly/rncb/restructuring/
Disallow: /personal/kreditnye-kanikuly/rncb/kreditnye-kanikuly-dlya-fl/
 
#starye kartinki
Disallow: */media/paris/personal/karty/info-dlya-dezhateley-kart/archive/debit/Auto_Gold_debit_1x.png
Disallow: */media/paris/personal/karty/info-dlya-dezhateley-kart/archive/debit/Auto_Gold_debit_2x.png
Disallow: */media/paris/personal/karty/info-dlya-dezhateley-kart/archive/debit/Auto_Platinum_debit_1x.png
Disallow: */media/paris/personal/karty/info-dlya-dezhateley-kart/archive/debit/Auto_Platinum_debit_2x.png

#zapret-vseh-doc-v-ostalnyh-stranicah
Disallow: *.doc$
Disallow: *.DOC$
Disallow: *.docx$
Disallow: *.DOCX$
Disallow: *.pdf$
Disallow: *.PDF$
Disallow: *.ppt$
Disallow: *.PPT$
Disallow: *.pptx$
Disallow: *.PPTX$
Disallow: *.rtf$
Disallow: *.RTF$
Disallow: *.XLS$
Disallow: *.xls$
Disallow: *.XLSX$
Disallow: *.xlsx$
 
 #vazhnye-stranicy
Allow: /personal/ipoteka/?$
Allow: /personal/karty/debetovye/multikarta/?&$
Allow: /promo/pens-vtb-schet/
Allow: /promo/pens-3000/
Allow: /promo/ozon2000/
Allow: /promo/vtbplus/
Allow: /promo/avtopopolnenie/
Allow: /promo/nsoc/
Allow: /promo/dop-keshbek/
Allow: /promo/itzp/
Allow: /promo/edp/
Allow: /promo/pb-plus2000/
Allow: /promo/mechtai/
Allow: /promo/zplegko/
Allow: /promo/zpmln/
Allow: /promo/milpens-5000/
Allow: /promo/kk-million/
Allow: /promo/zpmed/
Allow: /promo/zpdinamo/
Allow: /promo/friendszp/
  
#js-css
Allow: *.css
Allow: *.js
Allow: */media/Files/*.css
Allow: */media/Files/*.js
Allow: /scripts/*.js
Allow: /styles/*.css
Allow: /api/sitepages/?url=
  
 #kartinki
Allow: *.jpeg
Allow: *.jpg
Allow: *.JPG
Allow: *.png
Allow: *.svg
Allow: *.webp
 
 #clean-param-dlya-yandex
Clean-param: code&utmsource&device_type&region_name&banner_id&source&coef_goal_context_id&YEAR&MONTH&AID&SHOW_ALL_POINTS&F_REGION_ID&F_STATE_ID&FSTATE_ID&F_CITY_ID&giActiveIndex&giActiveSection&logout&type&ID&goto&GID&main_filter_group&main_filter_subgroup&giActiveSection&giActiveIndex&filter-date&cp&code&ADDTOMB&utm_erid&id&feed&officeId&clientTypeId&utm_c&utm_branch&pid&l&id_office&hhtmFrom&from&erid&phrase_id&lang&F_REGION__&ysclid
 
Sitemap: https://www.vtb.ru/media-files/vtb.ru/sitemap.xml

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of vtb.ru is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-26: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973294)).

API: https://infrarabbit.com/crawlers/api/v1/policy/vtb.ru