intuit.com: what it tells AI crawlers

On 27 October 2026, intuit.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot; it also published llms.txt.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.intuit.com/robots.txt
unchanged since 2026-10-26 · sha256 99f9354d3dc7685b… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

llms.txt: "Intuit", 5,786 bytes, 47 links.

robots.txt as recorded sha256 9f60153f87a4ae57…

User-agent: Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
Disallow: /
#YisouSpider  China
User-agent: YisouSpider
Disallow: /
 
User-agent: Baiduspider
Disallow: /
 
User-agent: Baiduspider+
Disallow: /
 
User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm)
Disallow: /
 
User-agent: Baiduspider/2.0;+http://www.baidu.com/search/spider.html
Disallow: /
 
User-agent: Baiduspider/2.0
Disallow: /
 
User-agent: +Baiduspider
Disallow: /
 
User-agent: +Baiduspider/2.0
Disallow: /
 
User-agent: +Baiduspider/2.0;++http://www.baidu.com/search/spider.html
Disallow: /
 
User-agent: Mozilla/5.0(compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Disallow: /
 
User-agent: Baiduspider-image+(+http://www.baidu.com/search/spider.htm)
Disallow: /
 
User-agent: Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)
Disallow: /
 
User-agent: Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)
Disallow: /

User-agent: Twitterbot
Allow: /oicms/

User-agent: *
Disallow: /oicms/
Disallow: /ca/oicms/
Disallow: /fr-ca/oicms/
Disallow: /in/oicms/
Disallow: /content/intuit_com/
Disallow: /company/press-room/press-releases/1998
Disallow: /company/press-room/press-releases/1999
Disallow: /company/press-room/press-releases/2000
Disallow: /company/press-room/press-releases/2001
Disallow: /company/press-room/press-releases/2002
Disallow: /company/press-room/press-releases/2003
Disallow: /company/press-room/press-releases/2004
Disallow: /company/press-room/press-releases/2005
Disallow: /company/press-room/press-releases/2006
Disallow: /company/press-room/press-releases/2007
Disallow: /company/press-room/press-releases/2008
Disallow: /company/press-room/press-releases/2009
Disallow: /company/press-room/press-releases/2010
Disallow: /company/press-room/press-releases/2011
Disallow: /company/press-room/press-releases/2012
Disallow: /commerce/

Sitemap: https://www.intuit.com/sitemap.xml
Sitemap: https://www.intuit.com/ca/sitemap.xml
Sitemap: https://www.intuit.com/fr-ca/sitemap.xml
Sitemap: https://www.intuit.com/in/sitemap.xml
Sitemap: https://www.intuit.com/blog/sitemap.xml

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of intuit.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/intuit.com