2gis.com: what it tells AI crawlers

On 28 October 2026, 2gis.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-29 03:59 UTC (daily run of 2026-10-28). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://2gis.ae/robots.txt
unchanged since 2026-10-26 · sha256 1edc20e35d86d2c1… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-28

Other signals

robots.txt as recorded sha256 1edc20e35d86d2c1…

User-agent: *
Host: https://2gis.ae
Sitemap: https://2gis.ae/sitemap.xml

Disallow: /_/*
Disallow: /maps_action

Disallow: /*printmode=
Disallow: /*login_token=
Disallow: /*reference=
Disallow: /*stat=

Disallow: */my$
Disallow: */my?*
Disallow: */my/*

Disallow: */user*
Disallow: */geolocation*
Disallow: *?refHash*

Disallow: /geo/70030076128110973

# Yandex-only
Clean-param: m
Clean-param: ruler
Clean-param: my
Clean-param: mapview
Clean-param: addOrg
Clean-param: feedback
Clean-param: floor
Clean-param: stat
Clean-param: writeReview

Clean-param: utm_medium&utm_campaign&utm_source&utm_content&utm_term&utm_from
Clean-param: queryState
Clean-param: reference
Clean-param: gclid
Clean-param: refHash
Clean-param: utm_referrer
Clean-param: fa821dba_ipp_key
Clean-param: fa821dba_ipp_uid
Clean-param: fa821dba_ipp_uid2
Clean-param: fa821dba_ipp_uid1
Clean-param: fa821dba_ipp_uid_tst
Clean-param: fa821dba_static_key
Clean-param: sa&ved
Clean-param: af_xp
Clean-param: rating
Clean-param: pmv
Clean-param: clckid
Clean-param: immersive
Clean-param: rel_scan

User-agent: Yandex
Disallow: /search/%D0%A0/rubricId

User-agent: Mail.Ru
Crawl-delay: 0.2

User-agent: GoogleOther
Disallow: /

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of 2gis.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-28: audit path (JSON), day root and OpenTimestamps proof (pending (4 calendars)).

API: https://infrarabbit.com/crawlers/api/v1/policy/2gis.com