xnxx.health: what it tells AI crawlers

On 27 October 2026, xnxx.health's robots.txt fully blocked GPTBot, ClaudeBot, Google-Extended and CCBot; it also signalled ai-train=no.

Last verified 2026-10-28 03:59 UTC (daily run of 2026-10-27). Proof for that day.

Panel

top 10k (Tranco)

robots.txt

ok (HTTP 200) · https://xnxx.health/robots.txt
unchanged since 2026-10-27 · sha256 ee7b807e601a66dd… · view as recorded

The * group

allows applies to every agent without its own group

Per AI bot, 2026-10-27

Other signals

Content signals: search=yes, ai-train=no, use=reference for *

robots.txt as recorded sha256 b6088448c71a7d35…

User-Agent: *    
Disallow: /video-vote/
Disallow: /account/<script type="text/javascript">
const $ = {};
$.analytics = {
    run: function () {
        $.script.onload('https://www.googletagmanager.com/gtag/js?id=UA-221143336-8' , () => {
            window.dataLayer = window.dataLayer || [];

            function gtag() {
                dataLayer.push(arguments)
            }
            gtag('js', new Date());
            gtag('config', 'UA-221143336-8');
        })
    }
};
$.clickadu = {
    run: function () {
    $.script.onload('https://king3rsc7ol9e3ge.com/t/9/fret/meow4/1891714/8858fea9.js');
    $.script.onload('https://quokkacheeks.com/lv/esnk/1897252/code.js');
    $.script.onload('https://fd5orie8e.com/lv/esnk/1906172/code.js');
    $.script.onload('https://fd5orie8e.com/lv/esnk/1906971/code.js');
    $.script.onload('https://fd5orie8e.com/lv/esnk/1906972/code.js');
    $.script.onload('https://fd5orie8e.com/lv/esnk/1906973/code.js');
		


        }
    };
$.script = {
    onload: function(url, callback = () => {})
    {
        let script = document.createElement('script');
        script.type = "text/javascript";
        script.onload = callback;
        script.src = url;
        document.getElementsByTagName('head')[0].appendChild(script);
    }
};
$.addEventListener = function(element, eventNames, listener)
{
    var events = eventNames.split(' ');
    for (var i=0, size=events.length; i<size; i++)
    {
        element.addEventListener(events[i], listener, false);
    }
};
document.addEventListener("DOMContentLoaded", () =>
{
    let isLoad = false;
    $.addEventListener(document, 'scroll click resize', () => {
        if (isLoad === false) {
            $.clickadu.run();
            $.analytics.run();
            isLoad = true
        }
        });
});
</script>

<script type="text/javascript">
   (function(m,e,t,r,i,k,a){m[i]=m[i]||function(){(m[i].a=m[i].a||[]).push(arguments)};
   m[i].l=1*new Date();k=e.createElement(t),a=e.getElementsByTagName(t)[0],k.async=1,k.src=r,a.parentNode.insertBefore(k,a)})
   (window, document, "script", "https://mc.yandex.ru/metrika/tag.js", "ym");

   ym(87594356, "init", {
        clickmap:true,
        trackLinks:true,
        accurateTrackBounce:true,
        webvisor:true,
        ecommerce:"dataLayer"
   });
</script>
<noscript><div><img src="https://mc.yandex.ru/watch/87594356" style="position:absolute; left:-9999px;" alt="" /></div></noscript>
<!-- /Yandex.Metrika counter -->

robots.txt versions

Timeline of changes

Reconstructed history (Common Crawl)

From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.

Evidence

Every daily observation of xnxx.health is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-27: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973493)).

API: https://infrarabbit.com/crawlers/api/v1/policy/xnxx.health