marriott.com: what it tells AI crawlers

On 27 October 2026, marriott.com's robots.txt allowed all of GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Google-Extended, PerplexityBot and CCBot.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 1k (Tranco)

robots.txt

ok (HTTP 200) · https://www.marriott.com/robots.txt
unchanged since 2026-10-26 · sha256 3fde12219521507a… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

robots.txt as recorded sha256 025bd2490b316741…

# Robots.txt file for Marriott.com
# Bans ALL robots from the accessing the following paths
#
# December 15, 2011
# Added:
# /search/refineHotelDirectorySearchResults.mi
# /einterface
#
# March 22, 2012
# Added:
# /hotels/hotel-deals.mi?offerInfo=*&marshaCode=*$
#
# December 11, 2012
# Added:
# /hotels/quickView.mi
#
# January 31, 2013
# Added:
# /marriott/quickgroup_group_samsung.mi
# /marriott/quickgroup_group_exxon_mobil.mi
#
# July 18, 2013
# Removed:
# /marriott-rewards/super-summer-rates.mi
# /marriott-rewards/free-internet-offer.mi
#
# July 11, 2013
# Added:
# /propertypage/
#
# July 23, 2013
# Removed:
# /careers
# /marriott.mi?page=couponwinner
# /marriott.mi?page=couponcabin
# /marriott.mi?page=mhrdrivenmobile
# /marriott.mi?page=couponcactus
# /marriott/quickgroup_group_samsung.mi
# /marriott/quickgroup_group_exxon_mobil.mi
#
# July 31, 2013
# Added:
# Sitemap /sitemap-index-us.xml
#
# October 15, 2013
# Removed:
# /green-brazilian-rainforest.mi
#
# December 4, 2013
# Added:
# /File_Blocks/
#
# June 5, 2014
# Added:
# User-agent: google-hoteladsverifier 
# Disallow:
#
# August 12, 2014
# Added:
# /hotelwebsites/
# 
# April 9, 2015
# Added:
# /travel-inspiration.mi
#
# July 1, 2015
# Added:
# /city-guide/
#
# April, 26 2016
# Added:
# /File_Blocks/seo/santa-monica.html
# /File_Blocks/seo/indianapolis.html
# /File_Blocks/seo/bogota.html
# 
Sitemap: http://www.marriott.com/sitemap-index-us.xml
User-agent: google-hoteladsverifier 
Disallow:
User-agent: *
Disallow: /travel-inspiration.mi
Disallow: /travel-inspiration/
Disallow: /hotelwebsites/
Disallow: /propertypage/
Disallow: /Channels/
Disallow: /reservation/
Disallow: /search/findHotels.mi
Disallow: /search/refineSearch.mi
Disallow: /careers.marriott.com
Disallow: /vstest/
Disallow: /marriott.mi?page=AAA
Disallow: /*printerFriendly=Y$
Disallow: /city-guide/city-insider.mi?cityId=*&marshaCode=*$
Disallow: /holidays/
Disallow: /hotels/einterface/
Disallow: /hotels/pure/
Disallow: /error.mi
Disallow: /hotels/error.mi
Disallow: /sessionTimedOut.mi
Disallow: /SignOutServlet?
Disallow: /search/refineHotelDirectorySearchResults.mi
Disallow: /einterface/
Disallow: /hotels/hotel-deals.mi?offerInfo=*&marshaCode=*$
Disallow: /hotels/above-property-message-detail.mi?
Disallow: /File_Blocks/
Disallow: /city-guide/
Disallow: /File_Blocks/seo/santa-monica.html
Disallow: /File_Blocks/seo/indianapolis.html
Disallow: /File_Blocks/seo/bogota.html

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of marriott.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/marriott.com