leboncoin.fr: what it tells AI crawlers

On 27 October 2026, leboncoin.fr's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 10k (Tranco)

robots.txt

ok (HTTP 200) · https://www.leboncoin.fr/robots.txt
unchanged since 2026-10-26 · sha256 bac2f1bf88edc5f0… · view as recorded

Per AI bot, 2026-10-27

Other signals

robots.txt as recorded sha256 cf5542353e61d0db…

## It's forbidden to use search robots or other automatic methods to access Leboncoin.fr.
## Access is only permitted with special permission from Leboncoin.fr.

## Google
User-agent: Googlebot
# friendly exceptions
# www2 only
Allow: /livres
Allow: /linge_de_maison
Disallow: /ai
Disallow: /cp
Disallow: /support
Disallow: /account
# Adviews
Disallow: /annonce/
Disallow: /li
# Bloquage des Demandes
Disallow: /*/demandes/
# all
Disallow: /*th=0
Disallow: /aw
Disallow: /st
Disallow: /maintenance.html
# Blocage des /Recherche (Rav)
Disallow: /recherche
Disallow: /boutique/*/*print=0
Disallow: /boutique/*.htm?*ca=*_k&*
#on autorise boutiques (.htm)
Allow: /boutique*
#on autorise les html
Allow: /*/*.html
#on bloque les annonces avec et sans parametres
Disallow: /*/*.htm
Disallow: /*/bonnes_affaires/
Allow: /*

User-agent: Mediapartners-Google
# friendly exceptions
# www2 only
Allow: /livres
Allow: /linge_de_maison
Disallow: /ai
Disallow: /cp
Disallow: /support
Disallow: /account
# Adviews
Disallow: /annonce/
Disallow: /li
# Bloquage des Demandes
Disallow: /*/demandes/
# all
Disallow: /*th=0
Disallow: /aw
Disallow: /st
Disallow: /maintenance.html
# Blocage des /Recherche (Rav)
Disallow: /recherche
Disallow: /boutique/*/*print=0
Allow: /*

## Yahoo
User-agent: slurp
# friendly exceptions
# www2 only
Allow: /livres
Allow: /linge_de_maison
Disallow: /ai
Disallow: /cp
Disallow: /support
Disallow: /account
# Adviews
Disallow: /annonce/
Disallow: /li
# Bloquage des Demandes
Disallow: /*/demandes/
# all
Disallow: /*th=0
Disallow: /aw
Disallow: /st
Disallow: /maintenance.html
# Blocage des /Recherche (Rav)
Disallow: /recherche
Disallow: /boutique/*/*print=0
Allow: /*

# Googlebot Mobile
User-agent: Googlebot-Mobile
# Bloquage des Demandes
Disallow: /*/demandes/
# www2 only
Allow: /livres
Allow: /linge_de_maison
Disallow: /ai
Disallow: /cp
Disallow: /support
Disallow: /account
# Adviews
Disallow: /annonce/
Disallow: /li
# Bloquage des Demandes
Disallow: /*/demandes/
# all
Disallow: /*th=0
Disallow: /aw
Disallow: /st
Disallow: /maintenance.html
# Blocage des /Recherche (Rav)
Disallow: /recherche
Disallow: /boutique/*/*print=0
Disallow: /boutique/*.htm?*ca=*_k&*
#on autorise boutiques (.htm)
Allow: /boutique*
#on autorise les html
Allow: /*/*.html
#on bloque les annonces avec et sans parametres
Disallow: /*/*.htm
Disallow: /*/bonnes_affaires/
Allow: /*

User-agent: msnbot
# www2 only
Allow: /livres
Allow: /linge_de_maison
Disallow: /ai
Disallow: /cp
Disallow: /support
Disallow: /account
# Adviews
Disallow: /annonce/
Disallow: /li
# Bloquage des Demandes
Disallow: /*/demandes/
# all
Disallow: /*th=0
Disallow: /aw
Disallow: /st
Disallow: /maintenance.html
# Blocage des /Recherche (Rav)
Disallow: /recherche
Disallow: /boutique/*/*print=0
Allow: /*

# allow archive.org to screenshot all our pages
User-agent: ia_archiver
Disallow:

# Allow proximic to access all our pages
User-agent: proximic
Disallow:

User-agent: Speobot
Disallow: /

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of leboncoin.fr is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/leboncoin.fr