leboncoin.fr: what it tells AI crawlers

On 27 October 2026, leboncoin.fr's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel
top 10k (Tranco)
robots.txt
ok (HTTP 200) · https://www.leboncoin.fr/robots.txt
unchanged since 2026-10-26 · sha256 bac2f1bf88edc5f0… · view as recorded

Per AI bot, 2026-10-27

User agentVerdictHow
GPTBotallowsnamed in its own group
OAI-SearchBotallowsnamed in its own group
ChatGPT-Userallowsnamed in its own group
ClaudeBotallowsnamed in its own group
Claude-SearchBotallowsnamed in its own group
Claude-Userallowsnamed in its own group
PerplexityBotallowsnamed in its own group
Perplexity-Userallowsnamed in its own group
Googlebotallowsnamed in its own group
Google-Extendedallowsnamed in its own group
Applebot-Extendedallowsnamed in its own group
CCBotallowsnamed in its own group
Bytespiderblocksnamed in its own group
Meta-ExternalAgentallowsno applicable rules
Amazonbotallowsno applicable rules
anthropic-aiallowsnamed in its own group
Applebotallowsnamed in its own group
DuckAssistBotallowsnamed in its own group
facebookexternalhitblocksnamed in its own group
MistralAI-Indexallowsnamed in its own group
MistralAI-Userallowsnamed in its own group

Other signals

Publishes /llms.txtnot observed
Publishes /ai.txtnot observed
Publishes /.well-known/tdmrep.jsonnot observed
Reserves TDM rights (TDMRep file, header or meta)not observed
Declares Content Signals (robots.txt or header)not observed
Says ai-train=no in a Content Signalnot observed
Points to an RSL licence (robots.txt License line or Link header)not observed
Answers with an x402 payment offer (lower bound: only the homepage is probed)not observed
Answers HTTP 402 Payment Required (lower bound: only the homepage is probed)not observed
Sends noai / noimageai directivesnot observed
Refused our fetcher (403 / challenge)no

robots.txt as recorded sha256 bac2f1bf88edc5f0…

## It's forbidden to use search robots or other automatic methods to access Leboncoin.fr.
## Access is only permitted with special permission from Leboncoin.fr.
## Bots friendly
User-agent: Googlebot
User-agent: Googlebot-Mobile
User-agent: Yahoo! Slurp
User-agent: Slurp
User-agent: slurp
User-agent: msnbot
User-agent: bingbot
User-agent: ia_archiver
Disallow: /ai
Disallow: /cp
Disallow: /support
Disallow: /account
Disallow: /api/*
Disallow: /account/index.html
Disallow: /dc/decisions_de_justice
Disallow: /dc/accessibilite
# Pages
Disallow: /*souscrire*
Disallow: /*recherche?*
Disallow: /*reply*
Disallow: /*payment*
Disallow: /*recommandation*
Disallow: /*consumer-goods*
Disallow: /*prolonger?*
Disallow: /*paiement?*
Disallow: /*direct_purchase*
Disallow: /annonce*
Disallow: /compte*
Disallow: /account*
# Paramètres d'URL
Disallow: /*?_gl=*
Disallow: /*&_gl=
Disallow: /*?_rsc=*
Disallow: /*&_rsc=
Disallow: /*?_sm_vck=*
Disallow: /*&_sm_vck=
Disallow: /*?a4XSp=*
Disallow: /*&a4XSp=
Disallow: /*?ac=*
Disallow: /*&ac=
Disallow: /*?accommodation_type=*
Disallow: /*&accommodation_type=
Disallow: /*?action=*
Disallow: /*&action=
Disallow: /*?adCategory=*
Disallow: /*&adCategory=
Disallow: /*?adId=*
Disallow: /*&adId=
Disallow: /*?adOwnerType=*
Disallow: /*&adOwnerType=
Disallow: /*?am=*
Disallow: /*&am=
Disallow: /*?ancienneAnnonceAvendrealouer=*
Disallow: /*&ancienneAnnonceAvendrealouer=
Disallow: /*?anioffnat=*
Disallow: /*&anioffnat=
Disallow: /*?anit=*
Disallow: /*&anit=
Disallow: /*?applySource=*
Disallow: /*&applySource=
Disallow: /*?at_campaign=*
Disallow: /*&at_campaign=
Disallow: /*?at_medium=*
Disallow: /*&at_medium=
Disallow: /*?bage=*
Disallow: /*&bage=
Disallow: /*?bedrooms=*
Disallow: /*&bedrooms=
Disallow: /*?bookable=*
Disallow: /*&bookable=
Disallow: /*?brand=*
Disallow: /*&brand=
Disallow: /*?brid=*
Disallow: /*&brid=
Disallow: /*?capacity=*
Disallow: /*&capacity=
Disallow: /*?car-listing=*
Disallow: /*&car-listing=
Disallow: /*?cat=*
Disallow: /*&cat=
Disallow: /*?category=*
Disallow: /*&category=
Disallow: /*?catid=*
Disallow: /*&catid=
Disallow: /*?carte=*
Disallow: /*&carte=
Disallow: /*?city=*
Disallow: /*&city=
Disallow: /*?compte=*
Disallow: /*&compte=
Disallow: /*?contact_type=*
Disallow: /*&contact_type=
Disallow: /*?cs=*
Disallow: /*&cs=
Disallow: /*?ct=*
Disallow: /*&ct=
Disallow: /*?ctaSelection=*
Disallow: /*&ctaSelection=
Disallow: /*?cto_pld=*
Disallow: /*&cto_pld=
Disallow: /*?date=*
Disallow: /*&date=
Disallow: /*?de=*
Disallow: /*&de=
Disallow: /*?de_datepicker=*
Disallow: /*&de_datepicker=
Disallow: /*?deal=*
Disallow: /*&deal=
Disallow: /*?defaultRadius=*
Disallow: /*&defaultRadius=
Disallow: /*?department=*
Disallow: /*&department=
Disallow: /*?district=*
Disallow: /*&district=
Disallow: /*?dn=*
Disallow: /*&dn=
Disallow: /*?down_payment=*
Disallow: /*&down_payment=
Disallow: /*?ds=*
Disallow: /*&ds=
Disallow: /*?ds_datepicker=*
Disallow: /*&ds_datepicker=
Disallow: /*?east=*
Disallow: /*&east=
Disallow: /*?editer=*
Disallow: /*&editer=
Disallow: /*?elevator=*
Disallow: /*&elevator=
Disallow: /*?energy_rate=*
Disallow: /*&energy_rate=
Disallow: /*?entry_point=*
Disallow: /*&entry_point=
Disallow: /*?entryPoint=*
Disallow: /*&entryPoint=
Disallow: /*?email=*
Disallow: /*&email=
Disallow: /*?event=*
Disallow: /*&event=
Disallow: /*?fb_comment_id=*
Disallow: /*&fb_comment_id=
Disallow: /*?fbclid=*
Disallow: /*&fbclid=
Disallow: /*?floor_property=*
Disallow: /*&floor_property=
Disallow: /*?from=*
Disallow: /*&from=
Disallow: /*?fromUrl=*
Disallow: /*&fromUrl=
Disallow: /*?furn=*
Disallow: /*&furn=
Disallow: /*?furnished=*
Disallow: /*&furnished=
Disallow: /*?fw=*
Disallow: /*&fw=
Disallow: /*?gad_campaignid=*
Disallow: /*&gad_campaignid=
Disallow: /*?gad_source=*
Disallow: /*&gad_source=
Disallow: /*?gbraid=*
Disallow: /*&gbraid=
Disallow: /*?gclid=*
Disallow: /*&gclid=
Disallow: /*?global_condition=*
Disallow: /*&global_condition=
Disallow: /*?gref=*
Disallow: /*&gref=
Disallow: /*?gtm_latency=*
Disallow: /*&gtm_latency=
Disallow: /*?hasPaymentMethods=*
Disallow: /*&hasPaymentMethods=
Disallow: /*?hl=*
Disallow: /*&hl=
Disallow: /*?holidays_real_estate_type=*
Disallow: /*&holidays_real_estate_type=
Disallow: /*?id=*
Disallow: /*&id=
Disallow: /*?immo_sell_type=*
Disallow: /*&immo_sell_type=
Disallow: /*?itemid=*
Disallow: /*&itemid=
Disallow: /*?Itemid=*
Disallow: /*&Itemid=
Disallow: /*?itemtype=*
Disallow: /*&itemtype=
Disallow: /*?jobc=*
Disallow: /*&jobc=
Disallow: /*?jobd=*
Disallow: /*&jobd=
Disallow: /*?jobe=*
Disallow: /*&jobe=
Disallow: /*?jobf=*
Disallow: /*&jobf=
Disallow: /*?jobs=*
Disallow: /*&jobs=
Disallow: /*?jobt=*
Disallow: /*&jobt=
Disallow: /*?ka=*
Disallow: /*&ka=
Disallow: /*?kp=*
Disallow: /*&kp=
Disallow: /*?kst=*
Disallow: /*&kst=
Disallow: /*?land_plot_surface=*
Disallow: /*&land_plot_surface=
Disallow: /*?lat=*
Disallow: /*&lat=
Disallow: /*?ldv_equipment=*
Disallow: /*&ldv_equipment=
Disallow: /*?ldv_outside_equipment=*
Disallow: /*&ldv_outside_equipment=
Disallow: /*?ldv_service=*
Disallow: /*&ldv_service=
Disallow: /*?lease_type=*
Disallow: /*&lease_type=
Disallow: /*?listId=*
Disallow: /*&listId=
Disallow: /*?lng=*
Disallow: /*&lng=
Disallow: /*?locationType=*
Disallow: /*&locationType=
Disallow: /*?manufacturer=*
Disallow: /*&manufacturer=
Disallow: /*?media_type=*
Disallow: /*&media_type=
Disallow: /*?model=*
Disallow: /*&model=
Disallow: /*?north=*
Disallow: /*&north=
Disallow: /*?openForm=*
Disallow: /*&openForm=
Disallow: /*?openModal=*
Disallow: /*&openModal=
Disallow: /*?opt=*
Disallow: /*&opt=
Disallow: /*?option=*
Disallow: /*&option=
Disallow: /*?order=*
Disallow: /*&order=
Disallow: /*?orientation=*
Disallow: /*&orientation=
Disallow: /*?outside_access=*
Disallow: /*&outside_access=
Disallow: /*?owner_type=*
Disallow: /*&owner_type=
Disallow: /*?p=*
Disallow: /*&p=
Disallow: /*?page_id=*
Disallow: /*&page_id=
Disallow: /*?pi=*
Disallow: /*&pi=
Disallow: /*?place=*
Disallow: /*&place=
Disallow: /*?polygon=*
Disallow: /*&polygon=
Disallow: /*?pp=*
Disallow: /*&pp=
Disallow: /*?preview=*
Disallow: /*&preview=
Disallow: /*?price=*
Disallow: /*&price=
Disallow: /*?probe=*
Disallow: /*&probe=
Disallow: /*?purchaseId=*
Disallow: /*&purchaseId=
Disallow: /*?quick_form=*
Disallow: /*&quick_form=
Disallow: /*?radius=*
Disallow: /*&radius=
Disallow: /*?real_estate_type=*
Disallow: /*&real_estate_type=
Disallow: /*?ref=*
Disallow: /*&ref=
Disallow: /*?ref_id=*
Disallow: /*&ref_id=
Disallow: /*?referrer=*
Disallow: /*&referrer=
Disallow: /*?region=*
Disallow: /*&region=
Disallow: /*?request_state=*
Disallow: /*&request_state=
Disallow: /*?rnd=*
Disallow: /*&rnd=
Disallow: /*?rooms=*
Disallow: /*&rooms=
Disallow: /*?rtbhc=*
Disallow: /*&rtbhc=
Disallow: /*?s=*
Disallow: /*&s=
Disallow: /*?sa=*
Disallow: /*&sa=
Disallow: /*?saved_id_view=*
Disallow: /*&saved_id_view=
Disallow: /*?sc=*
Disallow: /*&sc=
Disallow: /*?selectedWarranty=*
Disallow: /*&selectedWarranty=
Disallow: /*?seoSlug=*
Disallow: /*&seoSlug=
Disallow: /*?sfnsn=*
Disallow: /*&sfnsn=
Disallow: /*?shippable=*
Disallow: /*&shippable=
Disallow: /*?shippable_auto=*
Disallow: /*&shippable_auto=
Disallow: /*?shipping_type=*
Disallow: /*&shipping_type=
Disallow: /*?shoes=*
Disallow: /*&shoes=
Disallow: /*?shoet=*
Disallow: /*&shoet=
Disallow: /*?slug=*
Disallow: /*&slug=
Disallow: /*?sort=*
Disallow: /*&sort=
Disallow: /*?source=*
Disallow: /*&source=
Disallow: /*?south=*
Disallow: /*&south=
Disallow: /*?specificities=*
Disallow: /*&specificities=
Disallow: /*?square=*
Disallow: /*&square=
Disallow: /*?srsltid=*
Disallow: /*&srsltid=
Disallow: /*?st=*
Disallow: /*&st=
Disallow: /*?stateFilter=*
Disallow: /*&stateFilter=
Disallow: /*?step=*
Disallow: /*&step=
Disallow: /*?success=*
Disallow: /*&success=
Disallow: /*?swp=*
Disallow: /*&swp=
Disallow: /*?t=*
Disallow: /*&t=
Disallow: /*?tab=*
Disallow: /*&tab=
Disallow: /*?target=*
Disallow: /*&target=
Disallow: /*?task=*
Disallow: /*&task=
Disallow: /*?tblci=*
Disallow: /*&tblci=
Disallow: /*?tca=*
Disallow: /*&tca=
Disallow: /*?text=*
Disallow: /*&text=
Disallow: /*?thribee_click_id=*
Disallow: /*&thribee_click_id=
Disallow: /*?tm_medium=*
Disallow: /*&tm_medium=
Disallow: /*?tpclid=*
Disallow: /*&tpclid=
Disallow: /*?trk=*
Disallow: /*&trk=
Disallow: /*?type=*
Disallow: /*&type=
Disallow: /*?ur=*
Disallow: /*&ur=
Disallow: /*?user_type=*
Disallow: /*&user_type=
Disallow: /*?usg=*
Disallow: /*&usg=
Disallow: /*?utm_campaign=*
Disallow: /*&utm_campaign=
Disallow: /*?utm_content=*
Disallow: /*&utm_content=
Disallow: /*?utm_medium=*
Disallow: /*&utm_medium=
Disallow: /*?utm_source=*
Disallow: /*&utm_source=
Disallow: /*?utm_term=*
Disallow: /*&utm_term=
Disallow: /*?v=*
Disallow: /*&v=
Disallow: /*?ved=*
Disallow: /*&ved=
Disallow: /*?vertical=*
Disallow: /*&vertical=
Disallow: /*?view=*
Disallow: /*&view=
Disallow: /*?west=*
Disallow: /*&west=
Disallow: /*?xtor=*
Disallow: /*&xtor=
Disallow: /*?zipcode=*
Disallow: /*&zipcode=
Disallow: /*?zipCode=*
Disallow: /*&zipCode=
# Adviews
Disallow: /classified/latest/
Disallow: /vi/*
Disallow: /li
Disallow: /*/*.htm
Disallow: /ad/animaux/*
Disallow: /ad/animaux_perdus/*
Disallow: /ad/autres/*
# Holidays calendar pages
Disallow: /*/vacancier/
# Bloquage des Demandes
Disallow: /*/demandes
# all
Disallow: /*th=0
Disallow: /aw
Disallow: /st
Disallow: /maintenance.html
Disallow: /pub
Disallow: /report-abuse
Disallow: /profile/
Disallow: /oauth2callback
Disallow: /discovery/*
# Blocage des /Recherche (Rav)
Disallow: /recherche
Disallow: /visual_similar_ads/*
Disallow: /annonces_similaires/*
Disallow: /ad/*/lp/*
Disallow: /boutique/*/*print=0
Disallow: /boutique/*.htm?*ca=*_k&*
Disallow: /popup_siege_social.htm
Disallow: /dc/popup_siege_social
Disallow: /*_mediametrie
#on autorise boutiques (.htm)
Allow: /boutique*
#on autorise les html
Allow: /*/*.html
Disallow: /*/bonnes_affaires
#Partners
Disallow: /partners/*
Allow: /partners/sofinco*
#Messaging
Disallow: /messages/*
Allow: /*

## AdsBot-Google and AdsBot-Google-Mobile
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
# friendly exceptions
Allow: /recherche?category=2&*
Allow: /recherche?category=9&*
Allow: /recherche?category=10&*
Allow: /recherche?category=11&*
Allow: /recherche?category=13&*
Allow: /aide.htm
Allow: /aide_pro.htm
# www2 only
Allow: /livres
Allow: /linge_de_maison
Disallow: /ai
Disallow: /cp
Disallow: /support
Disallow: /account
Disallow: /account/index.html
Disallow: /dc/decisions_de_justice
Disallow: /dc/accessibilite
# Adviews
Disallow: /annonce
Disallow: /classified/latest/
Allow: /annonces
Disallow: /vi/*.htm
Disallow: /li
# Holidays calendar pages
Disallow: /*/vacancier/
# Bloquage des Demandes
Disallow: /*/demandes
# all
Disallow: /*th=0
Disallow: /aw
Disallow: /st
Disallow: /maintenance.html
Disallow: /pub
Disallow: /report-abuse
Disallow: /profile/
Disallow: /oauth2callback
Disallow: /boutique/*/*print=0
Disallow: /boutique/*.htm?*ca=*_k&*
Disallow: /popup_siege_social.htm
Disallow: /dc/popup_siege_social
Disallow: /*_mediametrie
Disallow: /discovery/*
#on autorise boutiques (.htm)
Allow: /boutique*
#on autorise les html
Allow: /*/*.html
#on bloque les annonces avec et sans parametres
Disallow: /*/*.htm
Disallow: /*/bonnes_affaires/
Disallow: /f/*
Allow: /*

# Allow specific Ads Googlebot to access all our pages
User-agent: Mediapartners-Google
Allow: /*

# Allow proximic to access all our pages
User-agent: proximic
Disallow:

# LLMs / AI SEARCH / RETRIEVAL bots
User-agent: OAI-SearchBot
User-agent: PerplexityBot
User-agent: Claude-SearchBot
User-agent: Applebot
User-agent: DuckAssistBot
User-agent: MistralAI-Index
User-agent: ChatGPT-User
User-agent: Perplexity-User
User-agent: Claude-User
User-agent: MistralAI-User
Disallow: /account
Disallow: /messages/
Disallow: /profile/
Disallow: /oauth2callback
Disallow: /support
Disallow: /report-abuse
Disallow: /pub
Disallow: /partners/
Disallow: /discovery/
Disallow: /recherche
Disallow: /*/demandes
Disallow: /*/vacancier/
Disallow: /ad/*/lp/
Disallow: /ad/animaux/
Disallow: /ad/animaux_perdus/
Disallow: /ad/autres/
Allow: /ad/voitures/
Disallow: /ad/
Allow: /

# LLMs / AI TRAINING
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: anthropic-ai
User-agent: CCBot
User-agent: Google-Extended
User-agent: Applebot-Extended
Disallow: /account
Disallow: /messages/
Disallow: /profile/
Disallow: /oauth2callback
Disallow: /support
Disallow: /report-abuse
Disallow: /pub
Disallow: /partners/
Disallow: /discovery/
Disallow: /recherche
Disallow: /ad/
Allow: /

User-agent: Bytespider
Disallow: /

# Link to the sitemap index file
Sitemap: https://www.leboncoin.fr/auto-main.xml

# Allow Meta's crawler for Instagram feature
User-agent: facebookexternalhit
Allow: /dc/cookies
Disallow: /*

robots.txt versions

FromThroughStateVersion
2026-10-262026-10-27ok 200bac2f1bf88ed

Timeline of changes

DateWhat changed
No changes since the first observation (2026-10-26).

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

CrawlHostStateGPTBotOAI-SearchBotChatGPT-UserClaudeBotClaude-SearchBotClaude-UserPerplexityBot
2026-09-21 CC-MAIN-2026-39www.leboncoin.frok viewallowsallowsunknownallowsallowsunknownallows
2025-09-15 CC-MAIN-2025-38www.leboncoin.frok viewallowsallowsunknownallowsallowsunknownallows
2024-09-16 CC-MAIN-2024-38www.leboncoin.frok viewallowsallowsunknownallowsallowsunknownallows
2023-10-02 CC-MAIN-2023-40www.leboncoin.frok viewallowsallowsunknownallowsallowsunknownallows
2022-10-03 CC-MAIN-2022-40www2.leboncoin.frredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2021-09-27 CC-MAIN-2021-39www2.leboncoin.frok viewallowsallowsunknownallowsallowsunknownallows
2020-09-28 CC-MAIN-2020-40www2.leboncoin.frok viewallowsallowsunknownallowsallowsunknownallows
2019-09-23 CC-MAIN-2019-39www2.leboncoin.frok viewallowsallowsunknownallowsallowsunknownallows
2018-09-24 CC-MAIN-2018-39www2.leboncoin.frok viewallowsallowsunknownallowsallowsunknownallows
2017-09-25 CC-MAIN-2017-39www2.leboncoin.frok viewblocksblocksunknownblocksblocksunknownblocks
2017-07-24 CC-MAIN-2017-30www2.leboncoin.frok viewblocksblocksunknownblocksblocksunknownblocks
2017-04-24 CC-MAIN-2017-17leboncoin.frredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2017-01-23 CC-MAIN-2017-04www2.leboncoin.frok viewblocksblocksunknownblocksblocksunknownblocks
2016-10-03 CC-MAIN-2016-40leboncoin.frredirect-onlyunknownunknownunknownunknownunknownunknownunknown
2016-09-05 CC-MAIN-2016-36leboncoin.frredirect-onlyunknownunknownunknownunknownunknownunknownunknown

Evidence

Every daily observation of leboncoin.fr is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/leboncoin.fr