dell.com: what it tells AI crawlers

On 28 October 2026, dell.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot; it also published llms.txt.

Last verified 2026-10-29 03:59 UTC (daily run of 2026-10-28). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.dell.com/robots.txt
unchanged since 2026-10-26 · sha256 66cd4b30830097a4… · view as recorded

The * group

partial applies to every agent without its own group

Per AI bot, 2026-10-28

Other signals

llms.txt: "Dell Technologies", 90,245 bytes, 284 links.

robots.txt as recorded sha256 5fb87e068a4a0e2b…

User-agent: *

Disallow: /koa/search
Disallow: /Search/
Disallow: /search/
Disallow: */learn/search*
Disallow: /support/search/
Disallow: /support/Search/
Disallow: /content/products/compare.aspx/cloudedge?c=us&l=en&s=biz
Disallow: */identity
Disallow: */survey.aspx
Disallow: */serviceselection
Disallow: */Identity
Disallow: */Serviceselection
Disallow: /en-ai
Disallow: /en-ap
Disallow: /en-dm
Disallow: /en-gy
Disallow: /fr-uk
Disallow: /fr-us
Disallow: /en-tw
Disallow: /sr-rs
Disallow: /sl-sl
Disallow: /rw-rw
Disallow: /ms-my
Disallow: /ie-ie
Disallow: /fr-lu
Disallow: /fr-af
Disallow: /es-xl
Disallow: /es-mx
Disallow: /es-co
Disallow: /es-cl
Disallow: /es-br
Disallow: /en-af
Disallow: /dk-dk
Disallow: /de-fr
Disallow: /ch-de
Disallow: /be-nl
Disallow: /be-fr
Disallow: /ar-sa
Allow: /*/compare.aspx*s=biz*
Allow: /*/compare.aspx*s=hied*
Allow: /*/compare.aspx*s=hea*
Allow: /*/compare.aspx*s=fed*
Allow: /*/compare.aspx*s=slg*
Allow: /*.js$
Allow: /*.css$
Allow: /*/compare.aspx*s=k12*
Disallow: */api/
Allow: /api/feeds.svc/rss/newsroom-press-releases/
Disallow: /*cs=45
Disallow: /*cs=04sp1
Disallow: /*cs=04sp2
Disallow: /*cs=04sp3
Disallow: /*cs=04sp4
Disallow: /*cs=04sp5
Disallow: /*cs=04sp6
Disallow: /*cs=04sp7
Disallow: /*cs=04sp8
Disallow: /*cs=04sp9
Disallow: /*cs=04sp10
Disallow: /*cs=04sp11
Disallow: /*cs=04sp12
Disallow: /*cs=04sp13
Disallow: /*cs=04sp14
Disallow: /*cs=04sp15
Disallow: /*cs=04sp16
Disallow: /*cs=04SP1
Disallow: /*cs=04SP2
Disallow: /*cs=04SP3
Disallow: /*cs=04SP4
Disallow: /*cs=04SP5
Disallow: /*cs=04SP6
Disallow: /*cs=04SP7
Disallow: /*cs=04SP8
Disallow: /*cs=04SP9
Disallow: /*cs=04SP10
Disallow: /*cs=04SP11
Disallow: /*cs=04SP12
Disallow: /*cs=04SP13
Disallow: /*cs=04SP14
Disallow: /*cs=04SP15
Disallow: /*cs=04SP16
Disallow: /*cs=OWR08
Disallow: /*cs=08
Disallow: /*cs=owr08
Disallow: /*~f=lg
Disallow: /support/home/cassette.axd/*
Disallow: /*/compare.aspx
Disallow: /*/menu.aspx
Disallow: /*/superview.aspx
Disallow: /*/productdetails.aspx*s=gen*
Disallow: /*/productdetail.aspx*s=gen*
Disallow: /*/pd.aspx*s=corp*
Disallow: /*/productdetails.aspx*s=corp*
Disallow: /*/productdetail.aspx*s=corp*
Disallow: /*/cp.aspx*s=corp*
Disallow: /*/ct.aspx*s=corp*
Disallow: /*/pd.aspx*s=gen*
Disallow: /*/cp.aspx*s=gen*
Disallow: /*/ct.aspx*s=gen*
Disallow: /*/pd.aspx*s=dfo*
Disallow: /*/productdetails.aspx*s=dfo*
Disallow: /*/productdetail.aspx*s=dfo*
Disallow: /*/cp.aspx*s=dfo*
Disallow: /*/ct.aspx*s=dfo*
Disallow: /*/category.aspx*s=dfo*
Disallow: /*/compare.aspx*s=dfo*
Disallow: /*/category.aspx*s=gen*
Disallow: /*/category.aspx*s=corp*
Disallow: /*/brand.aspx*s=corp*
Disallow: /*/brand.aspx*s=gen*
Disallow: /*/brand.aspx*s=dfo*
Disallow: /*/popproductdetails.aspx*s=gen*
Disallow: /*/popproductdetail.aspx*s=gen*
Disallow: /*/popproductdetails.aspx*s=corp*
Disallow: /*/popproductdetail.aspx*s=corp*
Disallow: /*/popproductdetails.aspx*s=dfo*
Disallow: /*/popproductdetail.aspx*s=dfo*
Disallow: /content/topics/segtopic.aspx/contact			
Disallow: /br/empresa/p/test_buddy_shopno_page_waterk
Disallow: /br/p/test_buddy_shopno_page_waterx
Disallow: /fr/p/inspiron-duo/pd
Disallow: /uk/business/p/*/fs$
Disallow: /uk/p/*/fs$
Disallow: /uk/p/shipsfast-deals?cs=ukdhs1		
Disallow: /nl/bedrijven/p/*/fs$
Disallow: /nl/p/*/fs$		
Disallow: /us/p/alienware-laptops
Disallow: /learn/*/*/*/mse-assets/navigation-diagnose
Disallow: /support/home/*/*/*/Diagnostics/*  
Disallow: /support/home/*/*/*/Drivers/DownloadList/* 
Disallow: /support/home/*/*/*/Drivers/DriversList/* 
Disallow: /support/home/*/*/*/Drivers/EmailSubscription/* 
Disallow: /support/home/*/*/*/Drivers/OneClick/*
Disallow: /learn/us/en/rc968571/
Disallow: /*/cart/*
Disallow: /*/buy/*
Disallow: */csbapi/
Disallow: /us/partner/*
Disallow: /us/*/chn/*
Disallow: /us/partners/*
Disallow: /us/en/partner/*
Disallow: /*/ed/*
Disallow: /*?c=ed*
Disallow: /*&c=ed*
Disallow: /*?*svcTag=5MGSLL1*
Disallow: /support/manuals/*/*/*/flyout/
Disallow: /support/csbapi/
Disallow: /*addScript$
Disallow: *t:cp=
Disallow: *t:ac=
Disallow: /support/clientconnection/
Disallow: /support/*/tab_mob/
Disallow: /ed/p/
Disallow: /ed/fr/p/
Disallow: /ed/business/p/*
Disallow: /ed/fr/entreprise/p/*
Disallow: /*?bvstate=
Disallow: /*appliedRefinements=
Disallow: /*appliedrefinements=
Disallow: /*styles/index.less
Disallow: /*quickview-template.html
Disallow: /*quickview
Disallow: /*updateProfile
Disallow: /*url$
Disallow: /*owl.less
Disallow: /*owlCustom.less
Disallow: /*/pdr/
Disallow: /community/forums/forumtopicprintpage
Disallow: /community/ideas/ideaprintpage
Disallow: /community/blogs/blogarticleprintpage
Disallow: /community/tkb/allarticlesprintpage
Disallow: /community/tkb/articleprintpage
Disallow: /community/help/faqpage
Disallow: /community/forums/usersonlinepage
Disallow: /community/forums/recentpostspage
Disallow: /community/util/componentrenderpage
Disallow: /community/tkb/articlehistorypage
Disallow: /community/forums/replypage
Disallow: /community/forums/postpage
Disallow: /community/notes/composepage
Disallow: /community/notes/privatenotespage/tab/compose
Disallow: /community/notes/v1_1/privatenotespage/tab/compose
Disallow: /community/notifications/notifymoderatorpage
Disallow: /community/vjauj58549/rss
Disallow: /community/*?t:ac=
Disallow: /community/*&t:ac=
Disallow: /community/*:lightboxrendercomponent?
Disallow: /community/*:lightboxrendercomponent&
Disallow: /community/*:lightboxrendercomponent/
Disallow: /community/*?ticket=
Disallow: /community/*&ticket=
Disallow: /community/*nobounce
Disallow: /community/auth/
Disallow: /community/plugins/common/feature/oauth/
Disallow: /community/plugins/common/feature/oauth2sso/
Disallow: /community/plugins/common/feature/saml/
Disallow: /community/plugins/common/feature/openidconnectsso/
Disallow: /community/plugins/common/feature/openidsso/
Disallow: /preferences/em/
Allow: /*/sr/*?appliedRefinements= 
Allow: /*/sr/*?appliedrefinements=
Disallow: /*/sr/*?appliedRefinements=*,*
Disallow: /*/sr/*?appliedrefinements=*,*
Allow: /*/ar/4009?appliedRefinements=2828
Allow: /py/p$
Allow: /py/en/$
Allow: /py/en/business/p$
Allow: /py/empresas/p$
Disallow: /py/p/
Disallow: /py/en/
Disallow: /py/en/business/*
Disallow: /py/empresas/*
Disallow: /py/es/
Disallow: /*/py/*
Disallow: /*?c=py*
Disallow: /*&c=py
Allow: /gt/p$
Allow: /gt/en/p$
Allow: /gt/en/business/p$
Allow: /gt/empresas/p$
Disallow: /gt/p/
Disallow: /gt/en/
Disallow: /gt/en/business/*
Disallow: /gt/es/empresas/*
Disallow: /gt/empresas/*
Disallow: /gt/es/
Disallow: /*/gt/*
Disallow: /*?c=gt*
Disallow: /*&c=gt
Disallow: */hk-dell-outlet
Disallow: /storagehelp/ 
Disallow: /en-au/outlet/shop/*/*/
Disallow: /en-au/outlet/work/shop/*/*/
Disallow: /en-au/outlet/*?
Disallow: /*/member/*mpn-sitemap
Disallow: /*-*/home/
Disallow: /support/coveo-dell/*
Disallow: /support/components/*
Disallow: /support/article{lwp}/*
Disallow: /en-ca.$
Disallow: */en-cg
Disallow: */en-lu
Disallow: */en-ga
Disallow: */en-gr
Disallow: */en-ar
Disallow: */en-cl
Disallow: */en-co
Disallow: */en-de
Disallow: */en-pe
Disallow: */en-ve
Disallow: */en-fi
Disallow: */en-hu
Disallow: */en-it
Disallow: */en-pt
Disallow: */en-ro
Disallow: */en-rs
Disallow: */en-ua
Disallow: */en-tr
Disallow: */en-ch
Disallow: */en-jp
Disallow: */en-kr
Disallow: */en-br
Disallow: */en-fr
Disallow: */en-dk
Disallow: */en-es
Disallow: */en-cn
Disallow: */en-be
Disallow: */en-cd
Disallow: */en-mx
Disallow: */en-nl
Disallow: */en-pl
Disallow: */es-us
Disallow: */en-se
Disallow: */en-no
Disallow: */en-cz
Disallow: */en-at
Allow: */home/*/product-support/servicetag/*/configuration*
Disallow: /qrl/
Disallow: /QRL/
Disallow: /support/kbdoc/*/printview/
Disallow: /learn/jp/ja/jpbsd1/campaigns/coupon-promo-sb-af
Disallow: */Search/*
Disallow: */search/*
Disallow: /support/*/servicetag/*
Disallow: /support/*/ServiceTag/*
Disallow: /support/Diagnostics/*
Disallow: /support/diagnostics/*
Disallow: */kbdoc/*/000183218/*
Disallow: */kbdoc/*/000183220/*
Disallow: */kbdoc/*/000183222/*
Disallow: */kbdoc/*/000183223/*
Disallow: */kbdoc/*/000183273/*
Disallow: */kbdoc/*/000183274/*
Disallow: */kbdoc/*/000183276/*
Disallow: */kbdoc/*/000183277/*
Disallow: */kbdoc/*/000183278/*
Disallow: /zh-cn/outlet/shop/*/*/
Disallow: /zh-cn/outlet/work/shop/*/*/
Disallow: /zh-cn/outlet/*?
Disallow: /community/*autocomplete$
Disallow: /support/*/chat/*
Disallow: /de-de/outlet/shop/*/*/
Disallow: /de-de/outlet/work/shop/*/*/
Disallow: /de-de/outlet/*?
Allow: /*/ar/*?appliedRefinements= 
Allow: /*/ar/*?appliedrefinements=
Disallow: /*/ar/*?appliedRefinements=*,*
Disallow: /*/ar/*?appliedrefinements=*,*
Disallow: */gaming/performance/
Disallow: /en-pk/
Disallow: /en-ph/
Disallow: /en-id/
Disallow: /en-vn/
Disallow: /en-th/
Disallow: /en-al/
Disallow: /en-ba/
Disallow: /en-bg/
Disallow: /en-hr/
Disallow: /en-ee/
Disallow: /en-gh/
Disallow: /en-is/
Disallow: /en-lv/
Disallow: /en-ly/
Disallow: /en-lt/
Disallow: /en-mk/
Disallow: /en-ng/
Disallow: /en-yu/
Disallow: /en-si/
Disallow: /en-nz/*/accessories$
Disallow: /en-nz/*/accessories?*
Disallow: /en-nz/*/apd/
Disallow: /en-nz/*/ar/
Disallow: /en-nz/*/ecat/
Disallow: /en-nz/gaming
Disallow: /en-nz/learn/
Disallow: /en-nz/*/lp/
Disallow: /en-nz/*/povw/
Disallow: /en-nz/*/productdetailstxn/
Disallow: /en-nz/*/sc/
Disallow: /en-nz/*shop$
Disallow: /en-nz/*shop?*
Disallow: /en-nz/*/spd/
Disallow: /en-nz/*/sr/
Disallow: /en-nz/*/ar/*?appliedRefinements=
Disallow: /en-nz/*/sr/*?appliedRefinements=
Disallow: /en-nz/lp/
Disallow: /en-nz/*/deals
Disallow: /en-nz/*/ab/dell-offers$
Disallow: /en-nz/*/ab/dell-offers?
Disallow: /en-nz/*/sf/rugged-tablets
Disallow: /en-nz/*/sf/g-series-desktops
Disallow: /en-nz/*/cp/customerupdate
Disallow: /en-nz/*/cp/price-match-guarantee-anz
Disallow: /en-nz/*/cp/dell-advantage-reward-anz

User-agent: Baiduspider
Disallow: /
Disallow: /zh-cn/cart
Disallow: /zh-cn/*/cart
Disallow: /zh-cn/buy
Disallow: /zh-cn/*/buy
Disallow: /zh-cn/*/compare
Disallow: /zh-cn/*/serviceselection/*
Disallow: /zh-cn/*/rec/*
Disallow: /zh-cn/outlet/*?
Allow: /zh-cn/
Allow: /cn/
Allow: /tw/
Allow: /support/*/cn/zh/
Allow: /support/*/tw/zh/
Allow: /support/*/hk/zh/
Allow: /learn/hk/zh/
Allow: /learn/tw/zh/
Allow: /*&c=cn&*
Allow: /*?c=cn&*
Allow: /*&c=tw&*
Allow: /*?c=tw&*
Allow: /*&c=hk&*
Allow: /*?c=hk&*
Allow: /support/*/zh-cn/
Allow: /support/*/zh-tw/
Allow: /support/*/zh-hk/
Allow: /support/*/en-hk/

User-agent: Sogou web spider
Disallow: /
Allow: /zh-cn/
Allow: /cn/
Allow: /tw/
Allow: /support/*/cn/zh/
Allow: /support/*/tw/zh/
Allow: /support/*/hk/zh/
Allow: /learn/hk/zh/
Allow: /learn/tw/zh/
Allow: /*&c=cn&*
Allow: /*?c=cn&*
Allow: /*&c=tw&*
Allow: /*?c=tw&*
Allow: /*&c=hk&*
Allow: /*?c=hk&
Allow: /support/*/zh-cn/
Allow: /support/*/zh-tw/
Allow: /support/*/zh-hk/
Allow: /support/*/en-hk/
Disallow: /zh-cn/outlet/*?

User-agent: Sogou inst spider
Disallow: /
Allow: /zh-cn/
Allow: /cn/
Allow: /tw/
Allow: /support/*/cn/zh/
Allow: /support/*/tw/zh/
Allow: /support/*/hk/zh/
Allow: /learn/hk/zh/
Allow: /learn/tw/zh/
Allow: /*&c=cn&*
Allow: /*?c=cn&*
Allow: /*&c=tw&*
Allow: /*?c=tw&*
Allow: /*&c=hk&*
Allow: /*?c=hk&
Allow: /support/*/zh-cn/
Allow: /support/*/zh-tw/
Allow: /support/*/zh-hk/
Allow: /support/*/en-hk/
Disallow: /zh-cn/outlet/*?

User-agent: Sogou spider2
Disallow: /
Allow: /zh-cn/
Allow: /cn/
Allow: /tw/
Allow: /support/*/cn/zh/
Allow: /support/*/tw/zh/
Allow: /support/*/hk/zh/
Allow: /learn/hk/zh/
Allow: /learn/tw/zh/
Allow: /*&c=cn&*
Allow: /*?c=cn&*
Allow: /*&c=tw&*
Allow: /*?c=tw&*
Allow: /*&c=hk&*
Allow: /*?c=hk&
Allow: /support/*/zh-cn/
Allow: /support/*/zh-tw/
Allow: /support/*/zh-hk/
Allow: /support/*/en-hk/
Disallow: /zh-cn/outlet/*?

User-agent: HaoSouSpider
Disallow: /
Allow: /zh-cn/
Allow: /cn/
Allow: /tw/
Allow: /support/*/cn/zh/
Allow: /support/*/tw/zh/
Allow: /support/*/hk/zh/
Allow: /learn/hk/zh/
Allow: /learn/tw/zh/
Allow: /*&c=cn&*
Allow: /*?c=cn&*
Allow: /*&c=tw&*
Allow: /*?c=tw&*
Allow: /*&c=hk&*
Allow: /*?c=hk&
Allow: /support/*/zh-cn/
Allow: /support/*/zh-tw/
Allow: /support/*/zh-hk/
Allow: /support/*/en-hk/
Disallow: /zh-cn/outlet/*?
User-agent: Bytespider
Disallow: /community/*=es
Disallow: /community/*=de
Disallow: /community/*=pt
Disallow: /community/*=fr
Disallow: /community/*=ko
Disallow: /community/*=ja
Disallow: /community/*-es
Disallow: /community/*-de
Disallow: /community/*-pt
Disallow: /community/*-fr
Disallow: /community/*-ko
Disallow: /community/*-ja

User-agent: AmazonAdBot
Disallow: /community/*

User-agent: 360Spider
Disallow: /
Allow: /zh-cn/
Allow: /cn/
Allow: /tw/
Allow: /support/*/cn/zh/
Allow: /support/*/tw/zh/
Allow: /support/*/hk/zh/
Allow: /learn/hk/zh/
Allow: /learn/tw/zh/
Allow: /*&c=cn&*
Allow: /*?c=cn&*
Allow: /*&c=tw&*
Allow: /*?c=tw&*
Allow: /*&c=hk&*
Allow: /*?c=hk&
Allow: /support/*/zh-cn/
Allow: /support/*/zh-tw/
Allow: /support/*/zh-hk/
Allow: /support/*/en-hk/
Disallow: /zh-cn/outlet/*?

Sitemap: https://www.dell.com/index-sr-sitemap.xml.gz
Sitemap: https://www.dell.com/index-deals-dell-sitemap.xml.gz
Sitemap: https://www.dell.com/index-content-href-sitemap.xml.gz
Sitemap: https://www.dell.com/index-deals-href-sitemap.xml.gz
Sitemap: https://www.dell.com/index-product-pages-hreflang-sitemap.xml.gz 
Sitemap: https://www.dell.com/index-sitemap.xml.gz
Sitemap: https://www.dell.com/index-snp-apj-sitemap.xml.gz
Sitemap: https://www.dell.com/index-support-href-sitemap.xml.gz
Sitemap: https://www.dell.com/index-video-xml-sitemap.xml.gz
Sitemap: https://www.dell.com/index-downloads-dell-pdfs-sitemap.xml.gz
Sitemap: https://www.dell.com/index-images-sitemap.xml.gz



# Last Modified on 23rd Sept 2021

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of dell.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-28: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973640)).

API: https://infrarabbit.com/crawlers/api/v1/policy/dell.com