tripadvisor.com: what it tells AI crawlers
On 27 October 2026, tripadvisor.com's robots.txt fully blocked GPTBot, ClaudeBot, Google-Extended and CCBot.
Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.
- Panel
- top 1k (Tranco)
- robots.txt
- ok (HTTP 200) · https://www.tripadvisor.com/robots.txt
unchanged since 2026-10-26 · sha2567ee0a97c21ec3bc9…· view as recorded - The * group
- allows applies to every agent without its own group
Per AI bot, 2026-10-27
| User agent | Verdict | How |
|---|---|---|
| GPTBot | blocks | named in its own group |
| OAI-SearchBot | allows | named in its own group |
| ChatGPT-User | allows | named in its own group |
| ClaudeBot | blocks | named in its own group |
| Claude-SearchBot | allows | through the * group |
| Claude-User | allows | through the * group |
| PerplexityBot | allows | named in its own group |
| Perplexity-User | allows | through the * group |
| Googlebot | allows | through the * group |
| Google-Extended | blocks | named in its own group |
| Applebot-Extended | blocks | named in its own group |
| CCBot | blocks | named in its own group |
| Bytespider | blocks | named in its own group |
| Meta-ExternalAgent | blocks | named in its own group |
| Amazonbot | blocks | named in its own group |
| Applebot | allows | named in its own group |
| cohere-ai | blocks | named in its own group |
| Gemini-Deep-Research | allows | named in its own group |
| Google-CloudVertexBot | blocks | named in its own group |
| PanguBot | blocks | named in its own group |
| PetalBot | blocks | named in its own group |
| YouBot | blocks | named in its own group |
Other signals
| Publishes /llms.txt | not observed |
| Publishes /ai.txt | not observed |
| Publishes /.well-known/tdmrep.json | not observed |
| Reserves TDM rights (TDMRep file, header or meta) | not observed |
| Declares Content Signals (robots.txt or header) | not observed |
| Says ai-train=no in a Content Signal | not observed |
| Points to an RSL licence (robots.txt License line or Link header) | not observed |
| Answers with an x402 payment offer (lower bound: only the homepage is probed) | not observed |
| Answers HTTP 402 Payment Required (lower bound: only the homepage is probed) | not observed |
| Sends noai / noimageai directives | not observed |
| Refused our fetcher (403 / challenge) | no |
robots.txt as recorded sha256 7ee0a97c21ec3bc9…
# Hi there, # # If you're sniffing around this file, and you're not a robot, we're looking to meet curious folks such as yourself. # # Think you have what it takes to join the best white-hat SEO growth hackers on the planet? # # Run - don't crawl - to apply to join Tripadvisor's elite SEO team # # Email seoRockstar@tripadvisor.com # # Or visit https://careers.tripadvisor.com/search-results?keywords=seo # # Sitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_index.xml Sitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_location_photo_direct_link_index.xml Sitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_show_user_reviews_index.xml Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attractions_index.xml Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attraction_review_index.xml Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attraction_product_review_index.xml Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attractions_near_index.xml Sitemap: https://www.tripadvisor.com/business/sitemap.xml User-Agent: Amazonbot User-Agent: Applebot-Extended User-Agent: Bytespider User-Agent: CCBot User-Agent: ClaudeBot User-Agent: Cohere-ai User-Agent: GPTBot User-Agent: Google-CloudVertexBot User-Agent: Img2dataset User-Agent: PanguBot User-Agent: PetalBot User-Agent: SentiBot User-Agent: YouBot User-Agent: magpie-crawler User-Agent: meta-externalagent Disallow: / User-Agent: * User-Agent: ChatGPT-User User-Agent: ChatGPT-User/2.0 User-Agent: Gemini-Deep-Research User-Agent: OAI-SearchBot User-Agent: Google-Extended User-Agent: applebot User-Agent: PerplexityBot User-Agent: bingbot User-Agent: Baiduspider Disallow: /5349 Disallow: /AccommodationTips Disallow: /AccountMerge Disallow: /Achievements Disallow: /ActionRecord Disallow: /AddForumUser Disallow: /AddListing Disallow: /AdRequestEventLogApi Disallow: /AdsManager Disallow: /adsoverview Disallow: /AirlineRegistration Disallow: /AirlineTips Disallow: /AITripBuilder Disallow: /AllReviews Disallow: /analytics Disallow: /AnalyticsSuite Disallow: /AnswersAjax Disallow: /api Disallow: /APIAccessSupport Disallow: /AppDetail Disallow: /AppleMapsAction Disallow: /apps Disallow: /AppSwipeRecommendations Disallow: /AppTravelModeExplore Disallow: /AppUploadAPhoto Disallow: /AppUserReview Disallow: /ArticlesV2 Disallow: /Attraction_Products Disallow: /AttractionAmendTravelDate Disallow: /AttractionBookingApi Disallow: /AttractionBookingDetails Disallow: /AttractionCancelBooking Disallow: /AttractionCommerce Disallow: /AttractionPartnerRedirect Disallow: /AttractionProductDetail Disallow: /AttractionProductHighlight Disallow: /AuthCheck Disallow: /AuthorTool Disallow: /avis Disallow: /B2BClickTracking Disallow: /BAEmailConfirmation Disallow: /BALinkImpressionTracking Disallow: /BATools Disallow: /BeachSweeps Disallow: /bewerten Disallow: /billing Disallow: /BLImpRecord Disallow: /blog/wp-admin/ Disallow: /BlPromoOptOut Disallow: /BookingConfirmationShare Disallow: /BookingConfirmationSMSResponse Disallow: /Bookings Disallow: /BrandSpotlight Disallow: /businessinfo Disallow: /BusinessListingsAjax Disallow: /bzzagent Disallow: /CampaignConfigAjax Disallow: /CampaignConfiguration Disallow: /CampaignManagement Disallow: /CancelBooking Disallow: /CarsComparePartners Disallow: /CauseTeaserPopup Disallow: /cds/media Disallow: /CDSimp Disallow: /CertificateOfExcellenceRequestSupport Disallow: /Civ Disallow: /Claim Disallow: /claimrewards Disallow: /ClientLink Disallow: /CMSImp Disallow: /cmsimp Disallow: /Collections Disallow: /Commerce Disallow: /CommLCT Disallow: /CommPT Disallow: /ConnectivityPartnerFAQ Disallow: /ConnectivityPartnerInfo Disallow: /Consent Disallow: /Content Disallow: /CookiePingback Disallow: /CoralEditor Disallow: /CostPerClick Disallow: /CountryAjax Disallow: /CruisesCommerce Disallow: /CruisesPartnerHandoff Disallow: /CurationTool Disallow: /data Disallow: /DeleteNotify Disallow: /DemandLoadAjax Disallow: /DestinationGuideWidget Disallow: /DestinationReview Disallow: /DevMediaRedirector Disallow: /DhtmlPopup Disallow: /DisplayMap Disallow: /DynamicPlacementAjax Disallow: /EmailHotel Disallow: /EmailMap Disallow: /EmailMemberRegistration Disallow: /EmailSpellCheckJson Disallow: /ErrorPage Disallow: /EventDates Disallow: /ExpandedUserReviews Disallow: /ExperiencesCommerce Disallow: /ExperiencesInsights/?s Disallow: /ExternalLinkInterstitial Disallow: /FacebookConnect Disallow: /FindRestaurants Disallow: /FinishAppInstall Disallow: /Flights? Disallow: /ForgotPassword Disallow: /ForumFAQ Disallow: /ForumPostPreview Disallow: /ForumRedirect Disallow: /ForumSetSortCookie Disallow: /ForumSignIn Disallow: /forumTeaser Disallow: /ForumVote Disallow: /FreeTools Disallow: /FullRedirect Disallow: /Games Disallow: /GARecord Disallow: /GeneralSupport Disallow: /GermanwingsPromo Disallow: /GermanwingsRegistration Disallow: /GetListedAjaxGeneral Disallow: /GetListedLightbox Disallow: /GetListedUpdateAttraction Disallow: /GetListedUpdateEatery Disallow: /GetMobileApp Disallow: /GMapsLocationController Disallow: /GOffer Disallow: /GOWidget Disallow: /Gpits Disallow: /GPointCampaign Disallow: /GroupHomeApi Disallow: /GroupManagementCenter Disallow: /GSSAjax Disallow: /GuideAjax Disallow: /GuideEditor Disallow: /GuideRatingAjax Disallow: /GuideRequested Disallow: /GuideRequestor Disallow: /HandleHotelSuperPortal Disallow: /HelpProxy Disallow: /Home- Disallow: /Hotel_ReviewHAC Disallow: /HotelGMCApi Disallow: /HotelHighlight Disallow: /HotelsManagementCenter Disallow: /HotelWatchAjax Disallow: /HowTheSiteWorks Disallow: /ImpressionRecord Disallow: /ImproveListing Disallow: /Inbox Disallow: /InformationCenter Disallow: /InitializeSession Disallow: /InlineReviewerCta Disallow: /InterstitialsWidget Disallow: /InvoicePayment Disallow: /IpadInterstitial Disallow: /JoinPlus Disallow: /js/ Disallow: /js2/ Disallow: /js3/ Disallow: /JSErrorRecord Disallow: /JsonServiceController Disallow: /JustForYouGuide Disallow: /LanderLogger Disallow: /LandingPage Disallow: /Leaderboard Disallow: /LightSubscriptionCenter Disallow: /LikeButtonClicked Disallow: /LinkGenerator Disallow: /ListingQuestionsAjax Disallow: /LithiumEmptyPage Disallow: /LithiumPageNotFound Disallow: /LNAjax Disallow: /LocationPhotoAlbum Disallow: /LocationPhotosInline Disallow: /LocationPhotosLightbox Disallow: /LocationPhotosSearch Disallow: /LocationTab Disallow: /LocationWidget Disallow: /LogMediaClick Disallow: /MachineTranslation Disallow: /ManageListingApi Disallow: /ManagementCenter Disallow: /ManageOwnersTopReasonsApi Disallow: /ManagePhotos Disallow: /ManageShopListingApi Disallow: /ManageStoryboard Disallow: /MapEmbed Disallow: /media/0000 Disallow: /media/advertorials Disallow: /media/attractions-splice-test-spp Disallow: /media/bl-video Disallow: /media/BookingThumbnails Disallow: /media/careers Disallow: /media/daodao/photo-f Disallow: /media/daodao/photo-l Disallow: /media/daodao/photo-t Disallow: /media/daodao/video-t Disallow: /media/daodao/video-v Disallow: /media/fbavatar Disallow: /media/forums Disallow: /media/ja-content-thumbs Disallow: /media/jwplayer Disallow: /media/mktg Disallow: /media/mobile Disallow: /media/oyster Disallow: /media/photo-a Disallow: /media/photo-f Disallow: /media/photo-g Disallow: /media/photo-l Disallow: /media/photo-o Disallow: /media/photo-t Disallow: /media/photo-w Disallow: /media/ProviderThumbnails Disallow: /media/solutions Disallow: /media/string Disallow: /media/t4b Disallow: /media/ta Disallow: /media/TALSO.swf Disallow: /media/test Disallow: /media/thirdpartyflash Disallow: /media/tmp Disallow: /media/tourism-content Disallow: /media/travelpod-roll.flv Disallow: /media/TUIThumbnails Disallow: /media/unesco Disallow: /media/vr-geo-photo-j Disallow: /media/vr-geo-photo-l Disallow: /media/vr-geo-photo-m Disallow: /media/vr-geo-photo-s Disallow: /media/vr-ha-splice Disallow: /media/vr-nifty-headers Disallow: /media/vr-photo-j Disallow: /media/vr-photo-l Disallow: /media/vr-photo-m Disallow: /media/vr-photo-o Disallow: /media/vr-photo-q Disallow: /media/vr-photo-s Disallow: /media/vr-photo-test-j Disallow: /media/vr-photo-test-l Disallow: /media/vr-photo-test-m Disallow: /media/vr-photo-test-o Disallow: /media/vr-photo-test-q Disallow: /media/vr-photo-test-s Disallow: /media/vr-photos Disallow: /media/vr-splice-m Disallow: /media/vr-splice-s Disallow: /media/vr-splice-test-j Disallow: /media/vr-splice-test-l Disallow: /media/vr-splice-test-m Disallow: /media/vr-splice-test-s Disallow: /MediaBadgeResponse Disallow: /MediaKit Disallow: /MediaVoting Disallow: /MemberAuditLogger Disallow: /MemberBenefitsPopup Disallow: /MemberOverlay Disallow: /MemberPassportStamps Disallow: /MemberPhotos Disallow: /MemberProfile Disallow: /MemberResetPassword Disallow: /members Disallow: /MemberSubscribe Disallow: /MemberSubscriptionsController Disallow: /MemberTagsAjax Disallow: /MemberTravelMap Disallow: /menu Disallow: /Messages Disallow: /MessagingOptions Disallow: /MetaBestPriceCrossSellAjax Disallow: /MetaCheckRatesAjax Disallow: /MetaJsonAjax Disallow: /MetaPlacementAjax Disallow: /MicroMetaAjax Disallow: /MiniMetaCRAjax Disallow: /missingpage Disallow: /mobile Disallow: /MobileAddPoi Disallow: /MobileAddressLookupAjax Disallow: /MobileAdsManager Disallow: /MobileAirlineDeals Disallow: /MobileAirlines Disallow: /MobileAirlineTips Disallow: /MobileApps Disallow: /MobileAttractionsNear Disallow: /MobileBookingConfirmationShare Disallow: /MobileBookingConfirmationSMSResponse Disallow: /MobileBookings Disallow: /MobileCancelBooking Disallow: /MobileCheapFlightsHome Disallow: /MobileCiv Disallow: /MobileCookie Disallow: /MobileEventRecord Disallow: /MobileFAQ Disallow: /MobileFilters Disallow: /MobileFlights Disallow: /MobileFooter Disallow: /MobileForgotPassword Disallow: /MobileForumRedirect Disallow: /MobileForumSetSortCookie Disallow: /MobileGetMobileApp Disallow: /MobileGuide Disallow: /MobileHeaderCss Disallow: /MobileHotelBookingAuthorization Disallow: /MobileHotelBookingRecordThreatIdAjax Disallow: /MobileHotelCancellationPolicy Disallow: /MobileImpressionRecord Disallow: /MobileImproveThisListing Disallow: /MobileJSErrorRecord Disallow: /MobileJson Disallow: /MobileJustForYouGuide Disallow: /MobileListForums Disallow: /MobileLocationPhotoDirectLink Disallow: /MobileLocationPhotos Disallow: /MobileManagementCenter Disallow: /MobileManagePhotos Disallow: /MobileMemberProfile Disallow: /MobileMemberResetPassword Disallow: /Mobilemembers Disallow: /MobileMyBookingsDetail Disallow: /MobileMyBookingsVoucher Disallow: /MobileNativeCountrySettings Disallow: /MobileNativeCurrencySettings Disallow: /MobileNativeSettings Disallow: /MobileNearbyAttractions Disallow: /MobileNearbyHotels Disallow: /MobileNearbyLander Disallow: /MobileNearbyRestaurants Disallow: /MobileNewsletterSignOut Disallow: /MobileNewTopic Disallow: /MobileNokiaLauncher Disallow: /MobileOlaCabsEstimateAjax Disallow: /MobileOwnerVerifyLocation Disallow: /MobilePageviewRecord Disallow: /MobilePasswordReset Disallow: /MobilePhotoUpload Disallow: /MobilePOITagging Disallow: /MobilePostPhoto Disallow: /MobilePostReply Disallow: /MobilePromotionDetail Disallow: /MobileQueryBBox Disallow: /MobileRecent Disallow: /MobileRedirector Disallow: /MobileRegistration Disallow: /MobileReportLocation Disallow: /MobileReviewCollect Disallow: /MobileSaves Disallow: /MobileSearchForums Disallow: /MobileShowForum Disallow: /MobileShowSpecialOffer Disallow: /MobileShowTopic Disallow: /MobileShowUserReviews Disallow: /MobileStreetView Disallow: /MobileTaggingAjax Disallow: /MobileTools Disallow: /MobileTravel_Guide Disallow: /MobileUberEstimateAjax Disallow: /MobileUpdateListing Disallow: /MobileUserReviewSearchAjax Disallow: /MobileVacation_Packages Disallow: /MobileWidgetEmbed Disallow: /MobileWinphoneLauncher Disallow: /ModalRegistrationController Disallow: /ModuleAjax Disallow: /ModuleBootstrap Disallow: /MptUrl Disallow: /MsnForumFeedServlet Disallow: /MultiOwners Disallow: /MultiPartAjax Disallow: /MyAchievements Disallow: /MyBookingsDetail Disallow: /MyBookingsVoucher Disallow: /NativeAds Disallow: /NetPromoterPopup Disallow: /NewMessage Disallow: /NewOwners Disallow: /NewsletterNews Disallow: /NewsLetterPlus Disallow: /NewsletterPopupBudgetRomanticFamilyPopup Disallow: /NewsletterPopupNewsletterPopup1 Disallow: /NewsletterSendPassword Disallow: /NewsletterSignIn Disallow: /NewsletterSignOut Disallow: /NewsletterSignupWidget Disallow: /NewsPlus Disallow: /NewTopic Disallow: /notifications Disallow: /nova Disallow: /OAuthRegistration Disallow: /OfferAnnouncementManagement Disallow: /OpenGraphLander Disallow: /OpeningHours Disallow: /OverlayWidgetAjax Disallow: /overview Disallow: /Owners- Disallow: /OwnersDM Disallow: /OwnersNew Disallow: /OwnersTermsAndConditions Disallow: /OwnerSupport Disallow: /OwnerVerifyLocation Disallow: /PacMan Disallow: /pages/rss_terms.html Disallow: /PageviewRecord Disallow: /PanoramaXml Disallow: /PasswordReset Disallow: /PaymentFormV2 Disallow: /PaymentMethodManagement Disallow: /PaymentOptions Disallow: /pdfs/advertorials/ Disallow: /pdfs/crm/ Disallow: /pdfs/email/ Disallow: /pdfs/tca/ Disallow: /PersonalizedOnboarding Disallow: /PhoneTrackingOptOuts Disallow: /photosandvideos Disallow: /PhotoUpload Disallow: /Pin_Lander Disallow: /PlusCommerce Disallow: /PoiArea Disallow: /PoiDetails Disallow: /PoiRecommendationDashboard Disallow: /PoiRecommendationEditor Disallow: /PoiRecommendationList Disallow: /PoiReviewDetail Disallow: /PoiTipDashboard Disallow: /PostPhotosHAC Disallow: /PostReply Disallow: /PostVideo Disallow: /Premium- Disallow: /PreviewImage Disallow: /PrintGuide Disallow: /ProductCancellationLogApi Disallow: /ProductCart Disallow: /ProductError Disallow: /ProductPaymentUpdate Disallow: /ProductPayNowNewMethod Disallow: /Profile Disallow: /promotionaltools Disallow: /ProxyToolsCustomerSupportForm Disallow: /ProxyToolsDiscountCode Disallow: /ProxyToolsMemberEditor Disallow: /ProxyToolsT4BToolsAccessDenied Disallow: /PVLog Disallow: /QueryJson Disallow: /QuickReview Disallow: /Rateit Disallow: /RateUserReview Disallow: /RatingAjax Disallow: /RatingPagingAjax Disallow: /RCPCrossSell Disallow: /Recaptcha Disallow: /recensioni Disallow: /Recent Disallow: /Redirect Disallow: /RegActivation Disallow: /RegistrationController Disallow: /RegistrationInterceptPopup Disallow: /RemindMe Disallow: /RentalCarsRedirect Disallow: /ReportIAP Disallow: /ReportPost Disallow: /ResponsibleDisclosure Disallow: /RestaurantEnterpriseManagement Disallow: /ReviewCollect Disallow: /reviewit Disallow: /reviews Disallow: /RewardsHelp Disallow: /RewardsWallet Disallow: /RexSpamFilterAjax Disallow: /RMReviewCollect Disallow: /RsPartnerApi Disallow: /rss Disallow: /RT Disallow: /RuleBasedPopup Disallow: /SameGeoActivity Disallow: /SavedPhotos Disallow: /Saves Disallow: /screensaver/ Disallow: /ScreensaverShade Disallow: /Search Disallow: /SelfServeAdvertising Disallow: /SendToFriend Disallow: /SentConfirmationEmail Disallow: /ServiceWorker Disallow: /SetCookieOverrides Disallow: /SetLangFilter Disallow: /SetReviewFilter Disallow: /Settings Disallow: /SetTranslationOption Disallow: /ShareWithFriends Disallow: /ShoppingCart Disallow: /ShortlinkResolver Disallow: /ShortSurvey Disallow: /ShowSpecialOffer Disallow: /ShowTopicWindowShade Disallow: /ShowUrl Disallow: /ShowUserReviews_Cruises_Responsive Disallow: /ShowUserReviewsAirlines Disallow: /ShowUserReviewsAttractions Disallow: /ShowUserReviewsCruises Disallow: /ShowUserReviewsGEO Disallow: /ShowUserReviewsHAC Disallow: /ShowUserReviewsHotels Disallow: /ShowUserReviewsRestaurants Disallow: /SingleClickOptOut Disallow: /SingleClickSignUp Disallow: /SmartDealsHomeAjax Disallow: /SocialIapReporting Disallow: /SolutionsDisplay Disallow: /SortAttractions Disallow: /SortEateries Disallow: /SortHotels Disallow: /SortReviews Disallow: /SPCommerceInternal Disallow: /specialoffers Disallow: /SPOCK Disallow: /SponsoredListingCommerce Disallow: /SPRedirect Disallow: /SpTracking Disallow: /static/decodeKey.txt Disallow: /StaticPage Disallow: /StaticVelocityPage Disallow: /StaticVelocityXmlPage Disallow: /SubscriptionLander Disallow: /SubscriptionPopup Disallow: /Summer06Widget Disallow: /summerbzz Disallow: /SurveyPanelPopup Disallow: /SyndicatedPhotos Disallow: /Tablet Disallow: /tacms Disallow: /TADemo Disallow: /TaggingAjax Disallow: /TagsJSONServlet Disallow: /TAMGFooterAjax Disallow: /TAMGSubLander Disallow: /TAMGSubOffers Disallow: /TAOffer Disallow: /TAScreenSaver Disallow: /TCDestinationsWidget Disallow: /TemporarilyClosedNoticeApi Disallow: /TestEmptyPage Disallow: /TestingTravelMaps Disallow: /ThirdPartyRedirect Disallow: /ThorHammer Disallow: /trapdir Disallow: /TravelAdvice Disallow: /TravelerInterestNotificationEndpoint Disallow: /TravelersChoice? Disallow: /TravelersChoiceHome Disallow: /TravelersChoicePreview Disallow: /TravelersChoiceWidget Disallow: /TravellersChoice? Disallow: /TravelMap- Disallow: /TravelMap? Disallow: /TravelMapHome Disallow: /TravelMode Disallow: /TripBarometer Disallow: /TripBuilder Disallow: /TripCashGiveaway Disallow: /TripConnectAccommodations Disallow: /TripConnectBadge Disallow: /TripConnectPartner Disallow: /TripConnectPaymentFormV2 Disallow: /TripConnectPlus Disallow: /TripConnectPremium Disallow: /TripDetails Disallow: /Trips? Disallow: /Trips/ Disallow: /TripsNative Disallow: /TripWatchPromoAjax Disallow: /TripX Disallow: /tucritica Disallow: /TypeAheadJson Disallow: /Unsubscribe Disallow: /UpdateCM Disallow: /UpdateListing Disallow: /UpdateSessionDatesAjax Disallow: /UploadMedia Disallow: /UserInteractionRecord Disallow: /UsernameValidation Disallow: /UserPage Disallow: /UserReviewController Disallow: /UserReviewEdit Disallow: /UserReviewHAC Disallow: /UserReviewSticker Disallow: /UserReviewSupport Disallow: /UserReviewThanks Disallow: /users Disallow: /UserTip Disallow: /UserTrackingRecord Disallow: /VacationRentalsBlog/?s Disallow: /ValidateJson Disallow: /VerifyReview Disallow: /VideoController Disallow: /VideoGallery Disallow: /VideoHome? Disallow: /ViewMandate Disallow: /virtualsupportassistant Disallow: /VKRegistration Disallow: /VolunteerTranslations Disallow: /WatchTopic Disallow: /WatermarkPhoto Disallow: /WeatherAjax Disallow: /WeatherUnderground Disallow: /weimg Disallow: /WhatsNearby Disallow: /WidgetBrowserExtension Disallow: /WidgetEmbed Disallow: /Widgets- Disallow: /WidgetsAjax Disallow: /WindowsApp Disallow: /wm Disallow: /WriteReviewShade Disallow: /ZendeskRedirector Disallow: /ZendeskSSO Disallow: /ZipCodeLookupAjax Allow: /api/internal/*/location Allow: /api/partner_select/*/price_query Allow: /CheapFlightsHome Allow: /InfoCenter-a_ctr.april_en Allow: /js3/ta-mobile Allow: /js3/vr-shared Allow: /data/*/crosssellaccommodations Allow: /data/1.0/bundle User-Agent: applebot Allow: /media/photo-f Allow: /media/daodao Allow: /media/photo-l Allow: /media/photo-o User-Agent: PerplexityBot Disallow: /ForumHome Disallow: /ListForums Disallow: /ShowForum Disallow: /ShowTopic User-Agent: bingbot Disallow: /LocationPhotoDirectLink User-Agent: Baiduspider Disallow: /LocationPhotoDirectLink Disallow: /ShowUserReviews User-Agent: ChatGPT-User User-Agent: ChatGPT-User/2.0 User-Agent: Gemini-Deep-Research User-Agent: OAI-SearchBot Disallow: /*-g1875* Disallow: /*-g188* User-Agent: Google-Extended Disallow: / Allow: /Restaurants-g55711-Dallas_Texas.html # # ==+*##%%%%%%%%%%%%##*+= # =+##%%%%%%%%%%%%%%%%%%%%%%%%%%%%%##+= # =*%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+ # =*%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%*= # =#%%%%%%%%%%%%%%%%%%#*+= =+*##%%%%%%%%%%%%%%%%%#= # *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+= =+#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%# # #%%%%%%%%%%%%%%%%%%%%%%%%%%%*= +%%%%%%%%%%%%%%%%%%%%%%%%%%%#= # =%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+ =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+ # +%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%# *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%* # =%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#= *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+ # *%%%%%%%%%%%%%*= =+#%%%%%%%%%%%%* *%%%%%%%%%%%%%*= =+*%%%%%%%%%%%%# # =%%%%%%%%%%%%%%%%%%%* =*%%%%%%%%%%= =#%%%%%%%%%%%%%%%%%%* =+%%%%%%%%%%+ # +%%%%%%%%%%%%%%%%%%%%%%= =%%%%%%%%%+ =%%%%%%%%%%%%%%%%%%%%%%+ =#%%%%%%%%* # =%%%%%%%%%%%%%%%%%%%%%%%%= +%%%%%%%%+ =%%%%%%%%%%%%%%%%%%%%%%%%+ +%%%%%%%%+ # =%%%%%%%%+%%%%%%%%%%%%%%%%# =%%%%%%%% %%%%%%%%+#%%%%%%%%%%%%%%%# =#%%%%%%%= # #%%%%%%%+ %%%%%%%%%%%%%%%%# =%%%%%%%# *%%%%%%%+ #%%%%%%%%%%%%%%%# =%%%%%%%# # =%%%%%%%* *%%%%%%%%%%%%%%%= *%%%%%%%*#%%%%%%% =%%%%%%%%%%%%%%%+ +%%%%%%%+ # +%%%%%%%= *%%%%%%%%%%%%%= %%%%%%%%%%%%%%%= +%%%%%%%%%%%%%+ %%%%%%%* # +%%%%%%% #%%%%%%%%%* %%%%%%%%%%%%%%% *%%%%%%%%%* #%%%%%%* # +%%%%%%% ++++= %%%%%%%%%%%%%%% +++++ #%%%%%%* # +%%%%%%%= =%%%%%%%%%%%%%%%+ =%%%%%%%+ # =#%%%%%%# #%%%%%%%%%%%%%%%% #%%%%%%%= # *%%%%%%%* *%%%%%%%%%%%%%%%%%# +%%%%%%%* # #%%%%%%%* *%%%%%%%%%%%%%%%%%%%# +%%%%%%%% # #%%%%%%%%= =%%%%%%%%%%%%%%%%%%%%%%%+ =%%%%%%%%%= # #%%%%%%%%#= =#%%%%%%%%%%%%%%%%%%%%%%%%%#= =*%%%%%%%%%= # *%%%%%%%%%%#= =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+ =#%%%%%%%%%%# # =#%%%%%%%%%%%%%%####%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#####%%%%%%%%%%%%%#= # =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%#==#%%%%%%%%%%%%+ *%%%%%%%%%%%%%%%%%%%%%%%%%%%%#= # +#%%%%%%%%%%%%%%%%%%%%%%#+ +%%%%%%%%%* +#%%%%%%%%%%%%%%%%%%%%%%#* # =+#%%%%%%%%%%%%%%%*= *%%%%%# =+#%%%%%%%%%%%%%%%*= # ===+== =#%%= ===+===
robots.txt versions
| From | Through | State | Version | |
|---|---|---|---|---|
| 2026-10-28 | 2026-10-28 | ok 200 | cd0f1ac65647 | diff with previous |
| 2026-10-26 | 2026-10-27 | ok 200 | 7ee0a97c21ec |
Timeline of changes
| Date | What changed |
|---|---|
| 2026-10-28 | robots.txt changed |
Reconstructed history (Common Crawl)
From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.
| Crawl | Host | State | GPTBot | OAI-SearchBot | ChatGPT-User | ClaudeBot | Claude-SearchBot | Claude-User | PerplexityBot |
|---|---|---|---|---|---|---|---|---|---|
| 2026-09-21 CC-MAIN-2026-39 | www.tripadvisor.com | ok view | blocks | allows | unknown | blocks | allows | unknown | allows |
| 2025-09-15 CC-MAIN-2025-38 | www.tripadvisor.com | ok view | allows | allows | unknown | blocks | allows | unknown | allows |
| 2024-09-16 CC-MAIN-2024-38 | www.tripadvisor.com | ok view | allows | allows | unknown | blocks | allows | unknown | allows |
| 2023-10-02 CC-MAIN-2023-40 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2022-10-03 CC-MAIN-2022-40 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2021-09-27 CC-MAIN-2021-39 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2020-09-28 CC-MAIN-2020-40 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2019-09-23 CC-MAIN-2019-39 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2018-09-24 CC-MAIN-2018-39 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2018-01-29 CC-MAIN-2018-05 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2017-10-23 CC-MAIN-2017-43 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2017-09-25 CC-MAIN-2017-39 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2017-07-24 CC-MAIN-2017-30 | www.tripadvisor.com | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2017-04-24 CC-MAIN-2017-17 | tripadvisor.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2017-01-23 CC-MAIN-2017-04 | tripadvisor.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2016-10-03 CC-MAIN-2016-40 | tripadvisor.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
| 2016-09-05 CC-MAIN-2016-36 | tripadvisor.com | ok view | partial | partial | unknown | partial | partial | unknown | partial |
Evidence
Every daily observation of tripadvisor.com is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).
API: https://infrarabbit.com/crawlers/api/v1/policy/tripadvisor.com