kaspersky.com: what it tells AI crawlers

On 28 October 2026, kaspersky.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot; it also published llms.txt.

Last verified 2026-10-29 03:59 UTC (daily run of 2026-10-28). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.kaspersky.com/robots.txt
unchanged since 2026-10-26 · sha256 9efe9b0f74014e7b… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-28

Other signals

llms.txt: "Kaspersky | Global Cybersecurity & Digital Privacy Solutions", 44,633 bytes, 101 links.

robots.txt as recorded sha256 0ddf18e703e02fce…

#
# robots.txt
#
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
#
# This file will be ignored unless it is at the root of your host:
# Used:    http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
#
#
# robots.txt
#
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
#
# This file will be ignored unless it is at the root of your host:
# Used:    http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/wc/robots.html
#
# For syntax checking, see:
# http://www.sxw.org.uk/computing/robots/check.html

User-agent: *
Crawl-delay: 10

# Requested by Jake M
Disallow: /support/
Disallow: /technews?id=
Disallow: /viruswatchlite?search_virus=
Disallow: /viruswatchlite?page=
Disallow: /viruswatchlite?hour_offset=
Disallow: /downloads_home_user_legacy?chapter=
Disallow: /news.asp?tnews=0&nview=1&id=
Disallow: /reading_room?chapter=
Disallow: /kav_latest_versions?downlink=
Disallow: /kav_previous_versions?downlink=
Disallow: /businessoptimal?chapter=
Disallow: /corporatesolutions?chapter=
Disallow: /buyonline.html?chapter=
Disallow: /beta.html?product=
Disallow: /kis6?chapter=
Disallow: /kaspersky_anti-virus_file_server?chapter=
Disallow: /kis_for_ultra_portables_download?downlink=
Disallow: /profitable-partners?chapter=
Disallow: /affiliate?chapter=
Disallow: /oemsuccess?chapter=
Disallow: /about/news/eventi?time=
Disallow: /about/news/events?time=
Disallow: /sorry2seeugo
Disallow: /products/home/kss/
Disallow: /ru-paypal
Disallow: /de-paypal
Disallow: /fr-paypal
Disallow: /acq/
Disallow: /acq/catalogue
Disallow: /acq/kss
Disallow: /vip
Disallow: /secure-connection-upgrade
#End of robots file

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of kaspersky.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-28: audit path (JSON), day root and OpenTimestamps proof (pending (4 calendars)).

API: https://infrarabbit.com/crawlers/api/v1/policy/kaspersky.com