vtb.ru: what it tells AI crawlers

On 27 October 2026, vtb.ru's robots.txt fully blocked GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 10k (Tranco)

robots.txt

ok (HTTP 200) · https://xn--90ab2c.xn--p1ai/robots.txt
unchanged since 2026-10-26 · sha256 6856255165e0c5f2… · view as recorded

The * group

blocks applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

robots.txt as recorded sha256 989eedcbd593b951…

User-Agent: *
#parametry
Disallow: /*?
Disallow: /*ssl

#razdely
Disallow: */-/ #zapret-vsego-krome-paris
Disallow: */media/Files/ #zapret-vseh-failov-v-papke
Disallow: */promo/
Disallow: /help
Disallow: /npb

#stranicy
Disallow: /delo/short/
Disallow: /ir/sustainability/
Disallow: /landing/nachnem-s-luchshego-net/
Disallow: /malyj-biznes/fos30/test/
Disallow: /malyj-biznes/kdelu/
Disallow: /malyj-biznes/kredity-i-garantii/sovmestnaya-programma-stimulirovaniya-i-lgotnogo-kreditovaniya/
Disallow: /malyj-biznes/smb-partners
Disallow: /malyj-biznes/tarify-i-komissii/paket-uslug/
Disallow: /malyj-biznes/tarify-i-komissii/rko/
Disallow: /malyj-biznes/zarplatniy-proekt-new/
Disallow: /personal/ipoteka/informacija-dlja-zaemshhikov/arenda-kvartiry/
Disallow: /personal/ipoteka/informacija-dlja-zaemshhikov/prodazha-kvartiry-iz-pod-zaloga/
Disallow: /personal/ipoteka/informacija-dlja-zaemshhikov/zamena-zaloga/$
Disallow: /personal/karty/help/personal/vklady-i-scheta/chastie-voprosy/

#zapret-vseh-doc-v-ostalnyh-stranicah
Disallow: *.doc$
Disallow: *.DOC$
Disallow: *.docx$
Disallow: *.DOCX$
Disallow: *.pdf$
Disallow: *.PDF$
Disallow: *.ppt$
Disallow: *.PPT$
Disallow: *.pptx$
Disallow: *.PPTX$
Disallow: *.rtf$
Disallow: *.RTF$
Disallow: *.XLS$
Disallow: *.xls$
Disallow: *.XLSX$
Disallow: *.xlsx$

 #vazhnye-stranicy
Allow: /personal/ipoteka/?$
Allow: /personal/karty/debetovye/multikarta/?&$
Allow: /promo/pens-vtb-schet/
Allow: /promo/pens-3000/

#js-css
Allow: *.css
Allow: *.js
Allow: */media/Files/*.css
Allow: */media/Files/*.js
Allow: /scripts/*.js
Allow: /styles/*.css

 #kartinki
Allow: *.jpeg
Allow: *.jpg
Allow: *.JPG
Allow: *.png
Allow: *.svg
Allow: *.webp

 #clean-param-dlya-yandex
Clean-param: code&utmsource&device_type&region_name&banner_id&source&coef_goal_context_id&YEAR&MONTH&AID&SHOW_ALL_POINTS&F_REGION_ID&F_STATE_ID&FSTATE_ID&F_CITY_ID&giActiveIndex&giActiveSection&logout&type&ID&goto&GID&main_filter_group&main_filter_subgroup&giActiveSection&giActiveIndex&filter-date&cp&code&ADDTOMB&utm_erid&id&feed&officeId&clientTypeId&utm_c&utm_branch&pid&l&id_office&hhtmFrom&from&erid&phrase_id&lang&F_REGION__&ysclid

Sitemap: https://www.vtb.ru/media-files/vtb.ru/sitemap.xml

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of vtb.ru is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/vtb.ru