lg.com: what it tells AI crawlers

On 27 October 2026, lg.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot; it also published llms.txt.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.lg.com:443/robots.txt
unchanged since 2026-10-26 · sha256 46035ac91b468df4… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

llms.txt: "LG Electronics (lg.com) – Official Content Guide for AI (Global Hub)", 2,253 bytes, 11 links.

robots.txt as recorded sha256 46035ac91b468df4…

# LG.com robots.txt
# Crawl policy is managed in the User-agent: * group.

User-agent: *
Allow: /
Disallow: *?bvstate=pg*
Disallow: /*nf-ec*
Disallow: /*f-ec*
Disallow: /*/search*?*
Disallow: /*/*.ldwf*
Disallow: /*/support/product-help/doc*
Disallow: /*/support/error-pages
Disallow: /error
Disallow: /common/bug
Disallow: /common/content_*
Disallow: /common/error
Disallow: /common/search/
Disallow: /common/support
Disallow: /templatedata
Disallow: /war
Disallow: /download/support/contactus
Disallow: /download/support
Disallow: /*.ajax$
Disallow: /us/about-lg/investor-relations/
Disallow: /*gclid
Disallow: /us/includes/
Disallow: /us/cms-templates/
Disallow: /us/common/
Disallow: /us/compare/
Disallow: /us/sys/
Disallow: /us/application-data
Disallow: /us/secure
Disallow: /us/*/*?bvdata=*
Disallow: /us/*/*?bvroute*
Disallow: /us/*/*?bvstate*
Disallow: /us/campaign/*
Disallow: /*/products/wtb*
Disallow: /compare.lg?*
Disallow: /*/*.swf$
Disallow: */mylg/
Disallow: /flash/
Disallow: /*/*/reviews/product/*
Disallow: /lgecs.downloadFile.ldwf?*
Disallow: /es/HEProductExperiencePage
Disallow: /es/HEProductExperiencePage/
Disallow: /es/HEProductExperiencePage/tv/main
Disallow: /*/srch*
Disallow: /*?search=*
Disallow: /*?bvrrp=*
Disallow: /*_escaped_fragment*
Disallow: /*?lgeurl=*
Disallow: /*/response/*
Disallow: /*/popup/*
Disallow: /*/search.lg*
Disallow: /au/pdfs/*
Disallow: /nz/pdfs/*
Disallow: /*.jsp?subCatId
Disallow: /*.jsp?value
Disallow: /*.jsp?contextPath
Disallow: /*.jsp?ref_no
Disallow: /*.jsp?s_kwcid
Disallow: /*.jsp?cmpid
Disallow: /jp/support/repair-warranty/locate-repair-center-detail/*
Disallow: /jp/mobile-phones/download-page/*
Disallow: /it/convenzioni-aziendali/corporate-benefit*
Disallow: /de/edustore
Disallow: /de/edustore/*
Disallow: /de/partnerstore
Disallow: /de/partnerstore/*
Disallow: /au/partners
Disallow: /au/partners/*
Disallow: /au/small-medium-business
Disallow: /au/small-medium-business/*
Disallow: /br/partners
Disallow: /br/partners/*
Disallow: /br/small-medium-business
Disallow: /br/small-medium-business/*
Disallow: /ca_en/partners
Disallow: /ca_en/partners/*
Disallow: /ca_en/small-medium-business
Disallow: /ca_en/small-medium-business/*
Disallow: /ca_fr/partners
Disallow: /ca_fr/partners/*
Disallow: /ca_fr/small-medium-business
Disallow: /ca_fr/small-medium-business/*
Disallow: /in/partners
Disallow: /in/partners/*
Disallow: /in/small-medium-business
Disallow: /in/small-medium-business/*
Disallow: /it/partners
Disallow: /it/partners/*
Disallow: /it/small-medium-business
Disallow: /it/small-medium-business/*
Disallow: /mx/partners
Disallow: /mx/partners/*
Disallow: /mx/small-medium-business
Disallow: /mx/small-medium-business/*
Disallow: /nl/partners
Disallow: /nl/partners/*
Disallow: /nl/small-medium-business
Disallow: /nl/small-medium-business/*
Disallow: /pe/partners
Disallow: /pe/partners/*
Disallow: /pe/small-medium-business
Disallow: /pe/small-medium-business/*
Disallow: /pl/partners
Disallow: /pl/partners/*
Disallow: /pl/small-medium-business
Disallow: /pl/small-medium-business/*
Disallow: /sa_en/partners
Disallow: /sa_en/partners/*
Disallow: /sa_en/small-medium-business
Disallow: /sa_en/small-medium-business/*
Disallow: /th/partners
Disallow: /th/partners/*
Disallow: /th/small-medium-business
Disallow: /th/small-medium-business/*
Disallow: /tw/partners
Disallow: /tw/partners/*
Disallow: /tw/small-medium-business
Disallow: /tw/small-medium-business/*
Disallow: /uk/partners
Disallow: /uk/partners/*
Disallow: /uk/small-medium-business
Disallow: /uk/small-medium-business/*
Disallow: /vn/partners
Disallow: /vn/partners/*
Disallow: /vn/small-medium-business
Disallow: /vn/small-medium-business/*
Disallow: /portal/*
Disallow: /lg5-common-gp/capcha/botdetectcaptcha
Disallow: /WEB-INF/jsp/common/error/error404.jsp
Disallow: /*?from=*
Disallow: /*?awc=*
Disallow: /*?category=*
Disallow: /*?amp=*
Disallow: /*?code=*
Disallow: /*?cmpid=*
Disallow: /*?sub_
Disallow: /*?sa=*
Disallow: /*?element=*
Disallow: /*?model=*
Disallow: /*?bizType=*
Disallow: /*?cjevent=*
Disallow: /*?csSalesCode=*
Disallow: /*?emptyModel=*
Disallow: /*?modelNumber=*
Disallow: /tw/*?bannerLinkUrl=*
Disallow: /ru/*web-survey
Disallow: /ru/products/*.page
Disallow: /*jcr:content
Disallow: /*_jcr_content
Disallow: /*jcr%3Acontent
Disallow: /*/search*
Disallow: /*/wtb?modelName=*
Disallow: /*/my-support
Disallow: /*/mylg-login
Disallow: /*?cmpid
Disallow: /*/player?videoId=
Disallow: /*/embedded-player?videoId=
Disallow: /adm
Disallow: /Admin
Disallow: /*locate-repair-center-detail/
Disallow: /search-all?*

User-agent: Mediapartners-Google
Allow: /*.jsp?cmpid

User-agent: AdsBot-Google
Allow: /*.jsp?cmpid

User-agent: AdsBot-Google-Mobile
Allow: /*.jsp?cmpid

Sitemap: https://www.lg.com/sitemap.xml

# LLM-friendly content guide for GEO/AEO (Hub file)
LLM: https://www.lg.com/llms.txt

# Yandex 
Host: www.lg.com
Clean-param: utm_source&utm_medium&utm_term&utm_campaign&utm_content /
Clean-param: gclid /
Clean-param: countryCd /*.jsp
Clean-param: subCatId /*.jsp
Clean-param: value /*.jsp
Clean-param: contextPath /*.jsp
Clean-param: ref_no /*.jspA
Clean-param: s_kwcid /*.jsp
Clean-param: cmpid /*.jsp
Clean-param: element&model&bizType&cjevent&csSalesCode
Clean-param: modelid&ref&code&amp&awc&from&category&cmpid&emptyModel&id /
Clean-param: elqat
Clean-param: _gl
Clean-param: _lang
Clean-param: action
Clean-param: adobeSearchType
Clean-param: bannerLinkUrl
Clean-param: bannerOmniture
Clean-param: blogger
Clean-param: bvdata
Clean-param: bvroute
Clean-param: bvstate
Clean-param: c
Clean-param: categoryId
Clean-param: categoryName
Clean-param: componentID
Clean-param: countryCode
Clean-param: countryName
Clean-param: csB2bFlag
Clean-param: customerModelCode
Clean-param: disableGlobalInfoCollect
Clean-param: downTime
Clean-param: ds_rl
Clean-param: elqah
Clean-param: elqaid
Clean-param: elqTrackId
Clean-param: emptyModel
Clean-param: etext
Clean-param: feed
Clean-param: fromApp
Clean-param: gbraid
Clean-param: gclsrc
Clean-param: gtm_debug
Clean-param: hashTag
Clean-param: headerTitle
Clean-param: hl
Clean-param: initialTab
Clean-param: keyword
Clean-param: lgcom_source
Clean-param: limit
Clean-param: linkId
Clean-param: m
Clean-param: menu
Clean-param: modelCode
Clean-param: modelName
Clean-param: modelNum
Clean-param: modelNumber
Clean-param: msclkid
Clean-param: name
Clean-param: nm
Clean-param: nofire
Clean-param: nx
Clean-param: obsBuynowFlag
Clean-param: obsOnly
Clean-param: oldTerm
Clean-param: omniture
Clean-param: ort
Clean-param: p
Clean-param: q
Clean-param: quickMenuSuperCategoryId
Clean-param: r
Clean-param: realSearch
Clean-param: rearr-factors
Clean-param: receiptNumber
Clean-param: redirectCheckUrl
Clean-param: reSearch
Clean-param: returnFlag
Clean-param: rev
Clean-param: s
Clean-param: salesModel
Clean-param: search
Clean-param: searchChck
Clean-param: searchResultFlag
Clean-param: selectItem
Clean-param: sid
Clean-param: siteType
Clean-param: sort
Clean-param: source
Clean-param: spm
Clean-param: subcategory
Clean-param: subCateId
Clean-param: submit
Clean-param: superCategoryId
Clean-param: superCateId
Clean-param: surveyPageChangeYn
Clean-param: target
Clean-param: tpclid
Clean-param: twclid
Clean-param: type
Clean-param: u
Clean-param: url
Clean-param: viewSalesCode
Clean-param: visit_id
Clean-param: wbraid
Clean-param: yandex_ad_client_id
Clean-param: tabType&clickref&currentPage&sku&sub_id
Clean-param: n_source&n_campaign&n_medium&n_content&success&social&sa&ved&DOC_ID&what&fromSystem&fileId&ORIGINAL_NAME_b1_a1&sqi&back&utm_channel&ranMID&ranEAID&ranSiteID&LSNSUBSITE&2599630&3488388&sv1&frm&sv_campaign&ppi&ppa&qwe&sdf&rtp&v
Clean-param: sv_campaign_id&aku&elqak
Clean-param: room&product&interior&simulator&popup

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of lg.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/lg.com