leboncoin.fr: what it tells AI crawlers
On 27 October 2026, leboncoin.fr's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.
Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.
- Panel
- top 10k (Tranco)
- robots.txt
- ok (HTTP 200) · https://www.leboncoin.fr/robots.txt
unchanged since 2026-10-26 · sha256bac2f1bf88edc5f0…· view as recorded
Per AI bot, 2026-10-27
| User agent | Verdict | How |
|---|---|---|
| GPTBot | allows | named in its own group |
| OAI-SearchBot | allows | named in its own group |
| ChatGPT-User | allows | named in its own group |
| ClaudeBot | allows | named in its own group |
| Claude-SearchBot | allows | named in its own group |
| Claude-User | allows | named in its own group |
| PerplexityBot | allows | named in its own group |
| Perplexity-User | allows | named in its own group |
| Googlebot | allows | named in its own group |
| Google-Extended | allows | named in its own group |
| Applebot-Extended | allows | named in its own group |
| CCBot | allows | named in its own group |
| Bytespider | blocks | named in its own group |
| Meta-ExternalAgent | allows | no applicable rules |
| Amazonbot | allows | no applicable rules |
| anthropic-ai | allows | named in its own group |
| Applebot | allows | named in its own group |
| DuckAssistBot | allows | named in its own group |
| facebookexternalhit | blocks | named in its own group |
| MistralAI-Index | allows | named in its own group |
| MistralAI-User | allows | named in its own group |
Other signals
| Publishes /llms.txt | not observed |
| Publishes /ai.txt | not observed |
| Publishes /.well-known/tdmrep.json | not observed |
| Reserves TDM rights (TDMRep file, header or meta) | not observed |
| Declares Content Signals (robots.txt or header) | not observed |
| Says ai-train=no in a Content Signal | not observed |
| Points to an RSL licence (robots.txt License line or Link header) | not observed |
| Answers with an x402 payment offer (lower bound: only the homepage is probed) | not observed |
| Answers HTTP 402 Payment Required (lower bound: only the homepage is probed) | not observed |
| Sends noai / noimageai directives | not observed |
| Refused our fetcher (403 / challenge) | no |
robots.txt as recorded sha256 bac2f1bf88edc5f0…
## It's forbidden to use search robots or other automatic methods to access Leboncoin.fr. ## Access is only permitted with special permission from Leboncoin.fr. ## Bots friendly User-agent: Googlebot User-agent: Googlebot-Mobile User-agent: Yahoo! Slurp User-agent: Slurp User-agent: slurp User-agent: msnbot User-agent: bingbot User-agent: ia_archiver Disallow: /ai Disallow: /cp Disallow: /support Disallow: /account Disallow: /api/* Disallow: /account/index.html Disallow: /dc/decisions_de_justice Disallow: /dc/accessibilite # Pages Disallow: /*souscrire* Disallow: /*recherche?* Disallow: /*reply* Disallow: /*payment* Disallow: /*recommandation* Disallow: /*consumer-goods* Disallow: /*prolonger?* Disallow: /*paiement?* Disallow: /*direct_purchase* Disallow: /annonce* Disallow: /compte* Disallow: /account* # Paramètres d'URL Disallow: /*?_gl=* Disallow: /*&_gl= Disallow: /*?_rsc=* Disallow: /*&_rsc= Disallow: /*?_sm_vck=* Disallow: /*&_sm_vck= Disallow: /*?a4XSp=* Disallow: /*&a4XSp= Disallow: /*?ac=* Disallow: /*&ac= Disallow: /*?accommodation_type=* Disallow: /*&accommodation_type= Disallow: /*?action=* Disallow: /*&action= Disallow: /*?adCategory=* Disallow: /*&adCategory= Disallow: /*?adId=* Disallow: /*&adId= Disallow: /*?adOwnerType=* Disallow: /*&adOwnerType= Disallow: /*?am=* Disallow: /*&am= Disallow: /*?ancienneAnnonceAvendrealouer=* Disallow: /*&ancienneAnnonceAvendrealouer= Disallow: /*?anioffnat=* Disallow: /*&anioffnat= Disallow: /*?anit=* Disallow: /*&anit= Disallow: /*?applySource=* Disallow: /*&applySource= Disallow: /*?at_campaign=* Disallow: /*&at_campaign= Disallow: /*?at_medium=* Disallow: /*&at_medium= Disallow: /*?bage=* Disallow: /*&bage= Disallow: /*?bedrooms=* Disallow: /*&bedrooms= Disallow: /*?bookable=* Disallow: /*&bookable= Disallow: /*?brand=* Disallow: /*&brand= Disallow: /*?brid=* Disallow: /*&brid= Disallow: /*?capacity=* Disallow: /*&capacity= Disallow: /*?car-listing=* Disallow: /*&car-listing= Disallow: /*?cat=* Disallow: /*&cat= Disallow: /*?category=* Disallow: /*&category= Disallow: /*?catid=* Disallow: /*&catid= Disallow: /*?carte=* Disallow: /*&carte= Disallow: /*?city=* Disallow: /*&city= Disallow: /*?compte=* Disallow: /*&compte= Disallow: /*?contact_type=* Disallow: /*&contact_type= Disallow: /*?cs=* Disallow: /*&cs= Disallow: /*?ct=* Disallow: /*&ct= Disallow: /*?ctaSelection=* Disallow: /*&ctaSelection= Disallow: /*?cto_pld=* Disallow: /*&cto_pld= Disallow: /*?date=* Disallow: /*&date= Disallow: /*?de=* Disallow: /*&de= Disallow: /*?de_datepicker=* Disallow: /*&de_datepicker= Disallow: /*?deal=* Disallow: /*&deal= Disallow: /*?defaultRadius=* Disallow: /*&defaultRadius= Disallow: /*?department=* Disallow: /*&department= Disallow: /*?district=* Disallow: /*&district= Disallow: /*?dn=* Disallow: /*&dn= Disallow: /*?down_payment=* Disallow: /*&down_payment= Disallow: /*?ds=* Disallow: /*&ds= Disallow: /*?ds_datepicker=* Disallow: /*&ds_datepicker= Disallow: /*?east=* Disallow: /*&east= Disallow: /*?editer=* Disallow: /*&editer= Disallow: /*?elevator=* Disallow: /*&elevator= Disallow: /*?energy_rate=* Disallow: /*&energy_rate= Disallow: /*?entry_point=* Disallow: /*&entry_point= Disallow: /*?entryPoint=* Disallow: /*&entryPoint= Disallow: /*?email=* Disallow: /*&email= Disallow: /*?event=* Disallow: /*&event= Disallow: /*?fb_comment_id=* Disallow: /*&fb_comment_id= Disallow: /*?fbclid=* Disallow: /*&fbclid= Disallow: /*?floor_property=* Disallow: /*&floor_property= Disallow: /*?from=* Disallow: /*&from= Disallow: /*?fromUrl=* Disallow: /*&fromUrl= Disallow: /*?furn=* Disallow: /*&furn= Disallow: /*?furnished=* Disallow: /*&furnished= Disallow: /*?fw=* Disallow: /*&fw= Disallow: /*?gad_campaignid=* Disallow: /*&gad_campaignid= Disallow: /*?gad_source=* Disallow: /*&gad_source= Disallow: /*?gbraid=* Disallow: /*&gbraid= Disallow: /*?gclid=* Disallow: /*&gclid= Disallow: /*?global_condition=* Disallow: /*&global_condition= Disallow: /*?gref=* Disallow: /*&gref= Disallow: /*?gtm_latency=* Disallow: /*>m_latency= Disallow: /*?hasPaymentMethods=* Disallow: /*&hasPaymentMethods= Disallow: /*?hl=* Disallow: /*&hl= Disallow: /*?holidays_real_estate_type=* Disallow: /*&holidays_real_estate_type= Disallow: /*?id=* Disallow: /*&id= Disallow: /*?immo_sell_type=* Disallow: /*&immo_sell_type= Disallow: /*?itemid=* Disallow: /*&itemid= Disallow: /*?Itemid=* Disallow: /*&Itemid= Disallow: /*?itemtype=* Disallow: /*&itemtype= Disallow: /*?jobc=* Disallow: /*&jobc= Disallow: /*?jobd=* Disallow: /*&jobd= Disallow: /*?jobe=* Disallow: /*&jobe= Disallow: /*?jobf=* Disallow: /*&jobf= Disallow: /*?jobs=* Disallow: /*&jobs= Disallow: /*?jobt=* Disallow: /*&jobt= Disallow: /*?ka=* Disallow: /*&ka= Disallow: /*?kp=* Disallow: /*&kp= Disallow: /*?kst=* Disallow: /*&kst= Disallow: /*?land_plot_surface=* Disallow: /*&land_plot_surface= Disallow: /*?lat=* Disallow: /*&lat= Disallow: /*?ldv_equipment=* Disallow: /*&ldv_equipment= Disallow: /*?ldv_outside_equipment=* Disallow: /*&ldv_outside_equipment= Disallow: /*?ldv_service=* Disallow: /*&ldv_service= Disallow: /*?lease_type=* Disallow: /*&lease_type= Disallow: /*?listId=* Disallow: /*&listId= Disallow: /*?lng=* Disallow: /*&lng= Disallow: /*?locationType=* Disallow: /*&locationType= Disallow: /*?manufacturer=* Disallow: /*&manufacturer= Disallow: /*?media_type=* Disallow: /*&media_type= Disallow: /*?model=* Disallow: /*&model= Disallow: /*?north=* Disallow: /*&north= Disallow: /*?openForm=* Disallow: /*&openForm= Disallow: /*?openModal=* Disallow: /*&openModal= Disallow: /*?opt=* Disallow: /*&opt= Disallow: /*?option=* Disallow: /*&option= Disallow: /*?order=* Disallow: /*&order= Disallow: /*?orientation=* Disallow: /*&orientation= Disallow: /*?outside_access=* Disallow: /*&outside_access= Disallow: /*?owner_type=* Disallow: /*&owner_type= Disallow: /*?p=* Disallow: /*&p= Disallow: /*?page_id=* Disallow: /*&page_id= Disallow: /*?pi=* Disallow: /*&pi= Disallow: /*?place=* Disallow: /*&place= Disallow: /*?polygon=* Disallow: /*&polygon= Disallow: /*?pp=* Disallow: /*&pp= Disallow: /*?preview=* Disallow: /*&preview= Disallow: /*?price=* Disallow: /*&price= Disallow: /*?probe=* Disallow: /*&probe= Disallow: /*?purchaseId=* Disallow: /*&purchaseId= Disallow: /*?quick_form=* Disallow: /*&quick_form= Disallow: /*?radius=* Disallow: /*&radius= Disallow: /*?real_estate_type=* Disallow: /*&real_estate_type= Disallow: /*?ref=* Disallow: /*&ref= Disallow: /*?ref_id=* Disallow: /*&ref_id= Disallow: /*?referrer=* Disallow: /*&referrer= Disallow: /*?region=* Disallow: /*®ion= Disallow: /*?request_state=* Disallow: /*&request_state= Disallow: /*?rnd=* Disallow: /*&rnd= Disallow: /*?rooms=* Disallow: /*&rooms= Disallow: /*?rtbhc=* Disallow: /*&rtbhc= Disallow: /*?s=* Disallow: /*&s= Disallow: /*?sa=* Disallow: /*&sa= Disallow: /*?saved_id_view=* Disallow: /*&saved_id_view= Disallow: /*?sc=* Disallow: /*&sc= Disallow: /*?selectedWarranty=* Disallow: /*&selectedWarranty= Disallow: /*?seoSlug=* Disallow: /*&seoSlug= Disallow: /*?sfnsn=* Disallow: /*&sfnsn= Disallow: /*?shippable=* Disallow: /*&shippable= Disallow: /*?shippable_auto=* Disallow: /*&shippable_auto= Disallow: /*?shipping_type=* Disallow: /*&shipping_type= Disallow: /*?shoes=* Disallow: /*&shoes= Disallow: /*?shoet=* Disallow: /*&shoet= Disallow: /*?slug=* Disallow: /*&slug= Disallow: /*?sort=* Disallow: /*&sort= Disallow: /*?source=* Disallow: /*&source= Disallow: /*?south=* Disallow: /*&south= Disallow: /*?specificities=* Disallow: /*&specificities= Disallow: /*?square=* Disallow: /*&square= Disallow: /*?srsltid=* Disallow: /*&srsltid= Disallow: /*?st=* Disallow: /*&st= Disallow: /*?stateFilter=* Disallow: /*&stateFilter= Disallow: /*?step=* Disallow: /*&step= Disallow: /*?success=* Disallow: /*&success= Disallow: /*?swp=* Disallow: /*&swp= Disallow: /*?t=* Disallow: /*&t= Disallow: /*?tab=* Disallow: /*&tab= Disallow: /*?target=* Disallow: /*&target= Disallow: /*?task=* Disallow: /*&task= Disallow: /*?tblci=* Disallow: /*&tblci= Disallow: /*?tca=* Disallow: /*&tca= Disallow: /*?text=* Disallow: /*&text= Disallow: /*?thribee_click_id=* Disallow: /*&thribee_click_id= Disallow: /*?tm_medium=* Disallow: /*&tm_medium= Disallow: /*?tpclid=* Disallow: /*&tpclid= Disallow: /*?trk=* Disallow: /*&trk= Disallow: /*?type=* Disallow: /*&type= Disallow: /*?ur=* Disallow: /*&ur= Disallow: /*?user_type=* Disallow: /*&user_type= Disallow: /*?usg=* Disallow: /*&usg= Disallow: /*?utm_campaign=* Disallow: /*&utm_campaign= Disallow: /*?utm_content=* Disallow: /*&utm_content= Disallow: /*?utm_medium=* Disallow: /*&utm_medium= Disallow: /*?utm_source=* Disallow: /*&utm_source= Disallow: /*?utm_term=* Disallow: /*&utm_term= Disallow: /*?v=* Disallow: /*&v= Disallow: /*?ved=* Disallow: /*&ved= Disallow: /*?vertical=* Disallow: /*&vertical= Disallow: /*?view=* Disallow: /*&view= Disallow: /*?west=* Disallow: /*&west= Disallow: /*?xtor=* Disallow: /*&xtor= Disallow: /*?zipcode=* Disallow: /*&zipcode= Disallow: /*?zipCode=* Disallow: /*&zipCode= # Adviews Disallow: /classified/latest/ Disallow: /vi/* Disallow: /li Disallow: /*/*.htm Disallow: /ad/animaux/* Disallow: /ad/animaux_perdus/* Disallow: /ad/autres/* # Holidays calendar pages Disallow: /*/vacancier/ # Bloquage des Demandes Disallow: /*/demandes # all Disallow: /*th=0 Disallow: /aw Disallow: /st Disallow: /maintenance.html Disallow: /pub Disallow: /report-abuse Disallow: /profile/ Disallow: /oauth2callback Disallow: /discovery/* # Blocage des /Recherche (Rav) Disallow: /recherche Disallow: /visual_similar_ads/* Disallow: /annonces_similaires/* Disallow: /ad/*/lp/* Disallow: /boutique/*/*print=0 Disallow: /boutique/*.htm?*ca=*_k&* Disallow: /popup_siege_social.htm Disallow: /dc/popup_siege_social Disallow: /*_mediametrie #on autorise boutiques (.htm) Allow: /boutique* #on autorise les html Allow: /*/*.html Disallow: /*/bonnes_affaires #Partners Disallow: /partners/* Allow: /partners/sofinco* #Messaging Disallow: /messages/* Allow: /* ## AdsBot-Google and AdsBot-Google-Mobile User-agent: AdsBot-Google User-agent: AdsBot-Google-Mobile # friendly exceptions Allow: /recherche?category=2&* Allow: /recherche?category=9&* Allow: /recherche?category=10&* Allow: /recherche?category=11&* Allow: /recherche?category=13&* Allow: /aide.htm Allow: /aide_pro.htm # www2 only Allow: /livres Allow: /linge_de_maison Disallow: /ai Disallow: /cp Disallow: /support Disallow: /account Disallow: /account/index.html Disallow: /dc/decisions_de_justice Disallow: /dc/accessibilite # Adviews Disallow: /annonce Disallow: /classified/latest/ Allow: /annonces Disallow: /vi/*.htm Disallow: /li # Holidays calendar pages Disallow: /*/vacancier/ # Bloquage des Demandes Disallow: /*/demandes # all Disallow: /*th=0 Disallow: /aw Disallow: /st Disallow: /maintenance.html Disallow: /pub Disallow: /report-abuse Disallow: /profile/ Disallow: /oauth2callback Disallow: /boutique/*/*print=0 Disallow: /boutique/*.htm?*ca=*_k&* Disallow: /popup_siege_social.htm Disallow: /dc/popup_siege_social Disallow: /*_mediametrie Disallow: /discovery/* #on autorise boutiques (.htm) Allow: /boutique* #on autorise les html Allow: /*/*.html #on bloque les annonces avec et sans parametres Disallow: /*/*.htm Disallow: /*/bonnes_affaires/ Disallow: /f/* Allow: /* # Allow specific Ads Googlebot to access all our pages User-agent: Mediapartners-Google Allow: /* # Allow proximic to access all our pages User-agent: proximic Disallow: # LLMs / AI SEARCH / RETRIEVAL bots User-agent: OAI-SearchBot User-agent: PerplexityBot User-agent: Claude-SearchBot User-agent: Applebot User-agent: DuckAssistBot User-agent: MistralAI-Index User-agent: ChatGPT-User User-agent: Perplexity-User User-agent: Claude-User User-agent: MistralAI-User Disallow: /account Disallow: /messages/ Disallow: /profile/ Disallow: /oauth2callback Disallow: /support Disallow: /report-abuse Disallow: /pub Disallow: /partners/ Disallow: /discovery/ Disallow: /recherche Disallow: /*/demandes Disallow: /*/vacancier/ Disallow: /ad/*/lp/ Disallow: /ad/animaux/ Disallow: /ad/animaux_perdus/ Disallow: /ad/autres/ Allow: /ad/voitures/ Disallow: /ad/ Allow: / # LLMs / AI TRAINING User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended Disallow: /account Disallow: /messages/ Disallow: /profile/ Disallow: /oauth2callback Disallow: /support Disallow: /report-abuse Disallow: /pub Disallow: /partners/ Disallow: /discovery/ Disallow: /recherche Disallow: /ad/ Allow: / User-agent: Bytespider Disallow: / # Link to the sitemap index file Sitemap: https://www.leboncoin.fr/auto-main.xml # Allow Meta's crawler for Instagram feature User-agent: facebookexternalhit Allow: /dc/cookies Disallow: /*
robots.txt versions
| From | Through | State | Version | |
|---|---|---|---|---|
| 2026-10-26 | 2026-10-27 | ok 200 | bac2f1bf88ed |
Timeline of changes
| Date | What changed |
|---|---|
| No changes since the first observation (2026-10-26). | |
Reconstructed history (Common Crawl)
From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.
| Crawl | Host | State | GPTBot | OAI-SearchBot | ChatGPT-User | ClaudeBot | Claude-SearchBot | Claude-User | PerplexityBot |
|---|---|---|---|---|---|---|---|---|---|
| 2026-09-21 CC-MAIN-2026-39 | www.leboncoin.fr | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2025-09-15 CC-MAIN-2025-38 | www.leboncoin.fr | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2024-09-16 CC-MAIN-2024-38 | www.leboncoin.fr | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2023-10-02 CC-MAIN-2023-40 | www.leboncoin.fr | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2022-10-03 CC-MAIN-2022-40 | www2.leboncoin.fr | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2021-09-27 CC-MAIN-2021-39 | www2.leboncoin.fr | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2020-09-28 CC-MAIN-2020-40 | www2.leboncoin.fr | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2019-09-23 CC-MAIN-2019-39 | www2.leboncoin.fr | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2018-09-24 CC-MAIN-2018-39 | www2.leboncoin.fr | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2017-09-25 CC-MAIN-2017-39 | www2.leboncoin.fr | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2017-07-24 CC-MAIN-2017-30 | www2.leboncoin.fr | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2017-04-24 CC-MAIN-2017-17 | leboncoin.fr | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2017-01-23 CC-MAIN-2017-04 | www2.leboncoin.fr | ok view | blocks | blocks | unknown | blocks | blocks | unknown | blocks |
| 2016-10-03 CC-MAIN-2016-40 | leboncoin.fr | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2016-09-05 CC-MAIN-2016-36 | leboncoin.fr | redirect-only | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
Evidence
Every daily observation of leboncoin.fr is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).
API: https://infrarabbit.com/crawlers/api/v1/policy/leboncoin.fr