unesco.org: what it tells AI crawlers
On 26 October 2026, unesco.org's robots.txt fully blocked GPTBot, ClaudeBot and CCBot; it also published llms.txt, reserved TDM rights, signalled ai-train=no and referenced an RSL licence.
Last verified 2026-10-26 21:13 UTC (daily run of 2026-10-26). Proof for that day.
- Panel
- top 1k (Tranco)
- robots.txt
- ok (HTTP 200) · https://www.unesco.org/robots.txt
unchanged since 2026-10-26 · sha256f5afb304fb7fb882…· view as recorded - The * group
- allows applies to every agent without its own group
Per AI bot, 2026-10-26
| User agent | Verdict | How |
|---|---|---|
| GPTBot | blocks | named in its own group |
| OAI-SearchBot | allows | through the * group |
| ChatGPT-User | allows | through the * group |
| ClaudeBot | blocks | named in its own group |
| Claude-SearchBot | allows | through the * group |
| Claude-User | allows | through the * group |
| PerplexityBot | allows | through the * group |
| Perplexity-User | allows | through the * group |
| Googlebot | allows | through the * group |
| Google-Extended | allows | through the * group |
| Applebot-Extended | blocks | named in its own group |
| CCBot | blocks | named in its own group |
| Bytespider | blocks | named in its own group |
| Meta-ExternalAgent | blocks | named in its own group |
| Amazonbot | blocks | named in its own group |
| ChatGLM-Spider | blocks | named in its own group |
| cohere-training-data-crawler | blocks | named in its own group |
| DeepSeekBot | blocks | named in its own group |
| DoubaoBot | blocks | named in its own group |
| ERNIEBot | blocks | named in its own group |
| FacebookBot | blocks | named in its own group |
| MistralAI-Training | blocks | named in its own group |
| omgili | blocks | named in its own group |
| omgilibot | blocks | named in its own group |
Other signals
| Publishes /llms.txt | yes |
| Publishes /ai.txt | no |
| Publishes /.well-known/tdmrep.json | no |
| Reserves TDM rights (TDMRep file, header or meta) | yes |
| Declares Content Signals (robots.txt or header) | yes |
| Says ai-train=no in a Content Signal | yes |
| Points to an RSL licence (robots.txt License line or Link header) | yes |
| Answers with an x402 payment offer (lower bound: only the homepage is probed) | no |
| Answers HTTP 402 Payment Required (lower bound: only the homepage is probed) | no |
| Sends noai / noimageai directives | no |
| Refused our fetcher (403 / challenge) | no |
Content signals: search=yes, ai-input=yes, ai-train=no, use=reference for *
RSL licence: https://www.unesco.org/en/terms-use
llms.txt: "UNESCO", 10,568 bytes, 53 links.
robots.txt as recorded sha256 b1a12326fb7d0d90…
# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # Used: http://example.com/robots.txt # Ignored: http://example.com/site/robots.txt # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html User-agent: * # CSS, JS, Images Allow: /core/*.css$ Allow: /core/*.css? Allow: /core/*.js$ Allow: /core/*.js? Allow: /core/*.gif Allow: /core/*.jpg Allow: /core/*.jpeg Allow: /core/*.png Allow: /core/*.svg Allow: /profiles/*.css$ Allow: /profiles/*.css? Allow: /profiles/*.js$ Allow: /profiles/*.js? Allow: /profiles/*.gif Allow: /profiles/*.jpg Allow: /profiles/*.jpeg Allow: /profiles/*.png Allow: /profiles/*.svg # Directories Disallow: /core/ Disallow: /profiles/ # Files Disallow: /README.txt Disallow: /web.config # Paths (clean URLs) Disallow: /admin/ Disallow: /comment/reply/ Disallow: /filter/tips Disallow: /node/add/ Disallow: /search/ Disallow: /user/register Disallow: /user/password Disallow: /user/login Disallow: /user/logout Disallow: /media/oembed Disallow: /*/media/oembed # Paths (no clean URLs) Disallow: /index.php/admin/ Disallow: /index.php/comment/reply/ Disallow: /index.php/filter/tips Disallow: /index.php/node/add/ Disallow: /index.php/search/ Disallow: /index.php/user/password Disallow: /index.php/user/register Disallow: /index.php/user/login Disallow: /index.php/user/logout Disallow: /index.php/media/oembed Disallow: /index.php/*/media/oembed # Search pages Disallow: /en/search Disallow: /en/search/* Disallow: /en/explore/* Disallow: /fr/search Disallow: /fr/search/* Disallow: /fr/explore/* Disallow: /es/search Disallow: /es/search/* Disallow: /es/explore/* Disallow: /ru/search Disallow: /ru/search/* Disallow: /ru/explore/* Disallow: /ar/search Disallow: /ar/search/* Disallow: /ar/explore/* Disallow: /zh/search Disallow: /zh/search/* Disallow: /zh/explore/* Disallow: /pt-pt/search Disallow: /pt-pt/search/* Disallow: /pt-pt/explore/* Disallow: /ja/search Disallow: /ja/search/* Disallow: /ja/explore/* Disallow: /uz/search Disallow: /uz/search/* Disallow: /uz/explore/* Disallow: /id/search Disallow: /id/search/* Disallow: /id/explore/* Disallow: /search Disallow: /en/search Disallow: /en/search/* Disallow: /en/explore/* Disallow: /fr/search Disallow: /fr/search/* Disallow: /fr/explore/* Disallow: /es/search Disallow: /es/search/* Disallow: /es/explore/* Disallow: /ru/search Disallow: /ru/search/* Disallow: /ru/explore/* Disallow: /ar/search Disallow: /ar/search/* Disallow: /ar/explore/* Disallow: /zh/search Disallow: /zh/search/* Disallow: /zh/explore/* Disallow: /pt-pt/search Disallow: /pt-pt/search/* Disallow: /pt-pt/explore/* Disallow: /ja/search Disallow: /ja/search/* Disallow: /ja/explore/* Disallow: /id/search Disallow: /id/search/* Disallow: /id/explore/* Disallow: /uk/search Disallow: /uk/search/* Disallow: /uk/explore/* Disallow: /uz/search Disallow: /uz/search/* Disallow: /uz/explore/* Disallow: /th/search Disallow: /th/search/* Disallow: /th/explore/* Disallow: /biennaleluanda/2021/search Disallow: /biennaleluanda/2021/en/search Disallow: /biennaleluanda/2021/en/search/* Disallow: /biennaleluanda/2021/en/explore/* Disallow: /biennaleluanda/2021/fr/search Disallow: /biennaleluanda/2021/fr/search/* Disallow: /biennaleluanda/2021/fr/explore/* Disallow: /biennaleluanda/2021/es/search Disallow: /biennaleluanda/2021/es/search/* Disallow: /biennaleluanda/2021/es/explore/* Disallow: /biennaleluanda/2021/ru/search Disallow: /biennaleluanda/2021/ru/search/* Disallow: /biennaleluanda/2021/ru/explore/* Disallow: /biennaleluanda/2021/ar/search Disallow: /biennaleluanda/2021/ar/search/* Disallow: /biennaleluanda/2021/ar/explore/* Disallow: /biennaleluanda/2021/zh/search Disallow: /biennaleluanda/2021/zh/search/* Disallow: /biennaleluanda/2021/zh/explore/* Disallow: /biennaleluanda/2021/pt-pt/search Disallow: /biennaleluanda/2021/pt-pt/search/* Disallow: /biennaleluanda/2021/pt-pt/explore/* Disallow: /biennaleluanda/2021/ja/search Disallow: /biennaleluanda/2021/ja/search/* Disallow: /biennaleluanda/2021/ja/explore/* Disallow: /biennaleluanda/2021/id/search Disallow: /biennaleluanda/2021/id/search/* Disallow: /biennaleluanda/2021/id/explore/* Disallow: /biennaleluanda/2021/uk/search Disallow: /biennaleluanda/2021/uk/search/* Disallow: /biennaleluanda/2021/uk/explore/* Disallow: /biennaleluanda/2021/uz/search Disallow: /biennaleluanda/2021/uz/search/* Disallow: /biennaleluanda/2021/uz/explore/* Disallow: /biennaleluanda/2021/th/search Disallow: /biennaleluanda/2021/th/search/* Disallow: /biennaleluanda/2021/th/explore/* Disallow: /creativity/search Disallow: /creativity/en/search Disallow: /creativity/en/search/* Disallow: /creativity/en/explore/* Disallow: /creativity/fr/search Disallow: /creativity/fr/search/* Disallow: /creativity/fr/explore/* Disallow: /creativity/es/search Disallow: /creativity/es/search/* Disallow: /creativity/es/explore/* Disallow: /creativity/ru/search Disallow: /creativity/ru/search/* Disallow: /creativity/ru/explore/* Disallow: /creativity/ar/search Disallow: /creativity/ar/search/* Disallow: /creativity/ar/explore/* Disallow: /creativity/zh/search Disallow: /creativity/zh/search/* Disallow: /creativity/zh/explore/* Disallow: /creativity/pt-pt/search Disallow: /creativity/pt-pt/search/* Disallow: /creativity/pt-pt/explore/* Disallow: /creativity/ja/search Disallow: /creativity/ja/search/* Disallow: /creativity/ja/explore/* Disallow: /creativity/id/search Disallow: /creativity/id/search/* Disallow: /creativity/id/explore/* Disallow: /creativity/uk/search Disallow: /creativity/uk/search/* Disallow: /creativity/uk/explore/* Disallow: /creativity/uz/search Disallow: /creativity/uz/search/* Disallow: /creativity/uz/explore/* Disallow: /creativity/th/search Disallow: /creativity/th/search/* Disallow: /creativity/th/explore/* Disallow: /interculturaldialogu/search Disallow: /interculturaldialogu/en/search Disallow: /interculturaldialogu/en/search/* Disallow: /interculturaldialogu/en/explore/* Disallow: /interculturaldialogu/fr/search Disallow: /interculturaldialogu/fr/search/* Disallow: /interculturaldialogu/fr/explore/* Disallow: /interculturaldialogu/es/search Disallow: /interculturaldialogu/es/search/* Disallow: /interculturaldialogu/es/explore/* Disallow: /interculturaldialogu/ru/search Disallow: /interculturaldialogu/ru/search/* Disallow: /interculturaldialogu/ru/explore/* Disallow: /interculturaldialogu/ar/search Disallow: /interculturaldialogu/ar/search/* Disallow: /interculturaldialogu/ar/explore/* Disallow: /interculturaldialogu/zh/search Disallow: /interculturaldialogu/zh/search/* Disallow: /interculturaldialogu/zh/explore/* Disallow: /interculturaldialogu/pt-pt/search Disallow: /interculturaldialogu/pt-pt/search/* Disallow: /interculturaldialogu/pt-pt/explore/* Disallow: /interculturaldialogu/ja/search Disallow: /interculturaldialogu/ja/search/* Disallow: /interculturaldialogu/ja/explore/* Disallow: /interculturaldialogu/id/search Disallow: /interculturaldialogu/id/search/* Disallow: /interculturaldialogu/id/explore/* Disallow: /interculturaldialogu/uk/search Disallow: /interculturaldialogu/uk/search/* Disallow: /interculturaldialogu/uk/explore/* Disallow: /interculturaldialogu/uz/search Disallow: /interculturaldialogu/uz/search/* Disallow: /interculturaldialogu/uz/explore/* Disallow: /interculturaldialogu/th/search Disallow: /interculturaldialogu/th/search/* Disallow: /interculturaldialogu/th/explore/* Disallow: /sdg4education2030/search Disallow: /sdg4education2030/en/search Disallow: /sdg4education2030/en/search/* Disallow: /sdg4education2030/en/explore/* Disallow: /sdg4education2030/fr/search Disallow: /sdg4education2030/fr/search/* Disallow: /sdg4education2030/fr/explore/* Disallow: /sdg4education2030/es/search Disallow: /sdg4education2030/es/search/* Disallow: /sdg4education2030/es/explore/* Disallow: /sdg4education2030/ru/search Disallow: /sdg4education2030/ru/search/* Disallow: /sdg4education2030/ru/explore/* Disallow: /sdg4education2030/ar/search Disallow: /sdg4education2030/ar/search/* Disallow: /sdg4education2030/ar/explore/* Disallow: /sdg4education2030/zh/search Disallow: /sdg4education2030/zh/search/* Disallow: /sdg4education2030/zh/explore/* Disallow: /sdg4education2030/pt-pt/search Disallow: /sdg4education2030/pt-pt/search/* Disallow: /sdg4education2030/pt-pt/explore/* Disallow: /sdg4education2030/ja/search Disallow: /sdg4education2030/ja/search/* Disallow: /sdg4education2030/ja/explore/* Disallow: /sdg4education2030/id/search Disallow: /sdg4education2030/id/search/* Disallow: /sdg4education2030/id/explore/* Disallow: /sdg4education2030/uk/search Disallow: /sdg4education2030/uk/search/* Disallow: /sdg4education2030/uk/explore/* Disallow: /sdg4education2030/uz/search Disallow: /sdg4education2030/uz/search/* Disallow: /sdg4education2030/uz/explore/* Disallow: /sdg4education2030/th/search Disallow: /sdg4education2030/th/search/* Disallow: /sdg4education2030/th/explore/* Disallow: /gem-report/search Disallow: /gem-report/en/search Disallow: /gem-report/en/search/* Disallow: /gem-report/en/explore/* Disallow: /gem-report/fr/search Disallow: /gem-report/fr/search/* Disallow: /gem-report/fr/explore/* Disallow: /gem-report/es/search Disallow: /gem-report/es/search/* Disallow: /gem-report/es/explore/* Disallow: /gem-report/ru/search Disallow: /gem-report/ru/search/* Disallow: /gem-report/ru/explore/* Disallow: /gem-report/ar/search Disallow: /gem-report/ar/search/* Disallow: /gem-report/ar/explore/* Disallow: /gem-report/zh/search Disallow: /gem-report/zh/search/* Disallow: /gem-report/zh/explore/* Disallow: /gem-report/pt-pt/search Disallow: /gem-report/pt-pt/search/* Disallow: /gem-report/pt-pt/explore/* Disallow: /gem-report/ja/search Disallow: /gem-report/ja/search/* Disallow: /gem-report/ja/explore/* Disallow: /gem-report/id/search Disallow: /gem-report/id/search/* Disallow: /gem-report/id/explore/* Disallow: /gem-report/uk/search Disallow: /gem-report/uk/search/* Disallow: /gem-report/uk/explore/* Disallow: /gem-report/uz/search Disallow: /gem-report/uz/search/* Disallow: /gem-report/uz/explore/* Disallow: /gem-report/th/search Disallow: /gem-report/th/search/* Disallow: /gem-report/th/explore/* Disallow: /mab/50anniversary/search Disallow: /mab/50anniversary/en/search Disallow: /mab/50anniversary/en/search/* Disallow: /mab/50anniversary/en/explore/* Disallow: /mab/50anniversary/fr/search Disallow: /mab/50anniversary/fr/search/* Disallow: /mab/50anniversary/fr/explore/* Disallow: /mab/50anniversary/es/search Disallow: /mab/50anniversary/es/search/* Disallow: /mab/50anniversary/es/explore/* Disallow: /mab/50anniversary/ru/search Disallow: /mab/50anniversary/ru/search/* Disallow: /mab/50anniversary/ru/explore/* Disallow: /mab/50anniversary/ar/search Disallow: /mab/50anniversary/ar/search/* Disallow: /mab/50anniversary/ar/explore/* Disallow: /mab/50anniversary/zh/search Disallow: /mab/50anniversary/zh/search/* Disallow: /mab/50anniversary/zh/explore/* Disallow: /mab/50anniversary/pt-pt/search Disallow: /mab/50anniversary/pt-pt/search/* Disallow: /mab/50anniversary/pt-pt/explore/* Disallow: /mab/50anniversary/ja/search Disallow: /mab/50anniversary/ja/search/* Disallow: /mab/50anniversary/ja/explore/* Disallow: /mab/50anniversary/id/search Disallow: /mab/50anniversary/id/search/* Disallow: /mab/50anniversary/id/explore/* Disallow: /mab/50anniversary/uk/search Disallow: /mab/50anniversary/uk/search/* Disallow: /mab/50anniversary/uk/explore/* Disallow: /mab/50anniversary/uz/search Disallow: /mab/50anniversary/uz/search/* Disallow: /mab/50anniversary/uz/explore/* Disallow: /mab/50anniversary/th/search Disallow: /mab/50anniversary/th/search/* Disallow: /mab/50anniversary/th/explore/* Disallow: /mil4teachers/search Disallow: /mil4teachers/en/search Disallow: /mil4teachers/en/search/* Disallow: /mil4teachers/en/explore/* Disallow: /mil4teachers/fr/search Disallow: /mil4teachers/fr/search/* Disallow: /mil4teachers/fr/explore/* Disallow: /mil4teachers/es/search Disallow: /mil4teachers/es/search/* Disallow: /mil4teachers/es/explore/* Disallow: /mil4teachers/ru/search Disallow: /mil4teachers/ru/search/* Disallow: /mil4teachers/ru/explore/* Disallow: /mil4teachers/ar/search Disallow: /mil4teachers/ar/search/* Disallow: /mil4teachers/ar/explore/* Disallow: /mil4teachers/zh/search Disallow: /mil4teachers/zh/search/* Disallow: /mil4teachers/zh/explore/* Disallow: /mil4teachers/pt-pt/search Disallow: /mil4teachers/pt-pt/search/* Disallow: /mil4teachers/pt-pt/explore/* Disallow: /mil4teachers/ja/search Disallow: /mil4teachers/ja/search/* Disallow: /mil4teachers/ja/explore/* Disallow: /mil4teachers/id/search Disallow: /mil4teachers/id/search/* Disallow: /mil4teachers/id/explore/* Disallow: /mil4teachers/uk/search Disallow: /mil4teachers/uk/search/* Disallow: /mil4teachers/uk/explore/* Disallow: /mil4teachers/uz/search Disallow: /mil4teachers/uz/search/* Disallow: /mil4teachers/uz/explore/* Disallow: /mil4teachers/th/search Disallow: /mil4teachers/th/search/* Disallow: /mil4teachers/th/explore/* Disallow: /mowlac/search Disallow: /mowlac/en/search Disallow: /mowlac/en/search/* Disallow: /mowlac/en/explore/* Disallow: /mowlac/fr/search Disallow: /mowlac/fr/search/* Disallow: /mowlac/fr/explore/* Disallow: /mowlac/es/search Disallow: /mowlac/es/search/* Disallow: /mowlac/es/explore/* Disallow: /mowlac/ru/search Disallow: /mowlac/ru/search/* Disallow: /mowlac/ru/explore/* Disallow: /mowlac/ar/search Disallow: /mowlac/ar/search/* Disallow: /mowlac/ar/explore/* Disallow: /mowlac/zh/search Disallow: /mowlac/zh/search/* Disallow: /mowlac/zh/explore/* Disallow: /mowlac/pt-pt/search Disallow: /mowlac/pt-pt/search/* Disallow: /mowlac/pt-pt/explore/* Disallow: /mowlac/ja/search Disallow: /mowlac/ja/search/* Disallow: /mowlac/ja/explore/* Disallow: /mowlac/id/search Disallow: /mowlac/id/search/* Disallow: /mowlac/id/explore/* Disallow: /mowlac/uk/search Disallow: /mowlac/uk/search/* Disallow: /mowlac/uk/explore/* Disallow: /mowlac/uz/search Disallow: /mowlac/uz/search/* Disallow: /mowlac/uz/explore/* Disallow: /mowlac/th/search Disallow: /mowlac/th/search/* Disallow: /mowlac/th/explore/* Disallow: /reports/access-to-information/2021/search Disallow: /reports/access-to-information/2021/en/search Disallow: /reports/access-to-information/2021/en/search/* Disallow: /reports/access-to-information/2021/en/explore/* Disallow: /reports/access-to-information/2021/fr/search Disallow: /reports/access-to-information/2021/fr/search/* Disallow: /reports/access-to-information/2021/fr/explore/* Disallow: /reports/access-to-information/2021/es/search Disallow: /reports/access-to-information/2021/es/search/* Disallow: /reports/access-to-information/2021/es/explore/* Disallow: /reports/access-to-information/2021/ru/search Disallow: /reports/access-to-information/2021/ru/search/* Disallow: /reports/access-to-information/2021/ru/explore/* Disallow: /reports/access-to-information/2021/ar/search Disallow: /reports/access-to-information/2021/ar/search/* Disallow: /reports/access-to-information/2021/ar/explore/* Disallow: /reports/access-to-information/2021/zh/search Disallow: /reports/access-to-information/2021/zh/search/* Disallow: /reports/access-to-information/2021/zh/explore/* Disallow: /reports/access-to-information/2021/pt-pt/search Disallow: /reports/access-to-information/2021/pt-pt/search/* Disallow: /reports/access-to-information/2021/pt-pt/explore/* Disallow: /reports/access-to-information/2021/ja/search Disallow: /reports/access-to-information/2021/ja/search/* Disallow: /reports/access-to-information/2021/ja/explore/* Disallow: /reports/access-to-information/2021/id/search Disallow: /reports/access-to-information/2021/id/search/* Disallow: /reports/access-to-information/2021/id/explore/* Disallow: /reports/access-to-information/2021/uk/search Disallow: /reports/access-to-information/2021/uk/search/* Disallow: /reports/access-to-information/2021/uk/explore/* Disallow: /reports/access-to-information/2021/uz/search Disallow: /reports/access-to-information/2021/uz/search/* Disallow: /reports/access-to-information/2021/uz/explore/* Disallow: /reports/access-to-information/2021/th/search Disallow: /reports/access-to-information/2021/th/search/* Disallow: /reports/access-to-information/2021/th/explore/* Disallow: /reports/access-to-information/2022/search Disallow: /reports/access-to-information/2022/en/search Disallow: /reports/access-to-information/2022/en/search/* Disallow: /reports/access-to-information/2022/en/explore/* Disallow: /reports/access-to-information/2022/fr/search Disallow: /reports/access-to-information/2022/fr/search/* Disallow: /reports/access-to-information/2022/fr/explore/* Disallow: /reports/access-to-information/2022/es/search Disallow: /reports/access-to-information/2022/es/search/* Disallow: /reports/access-to-information/2022/es/explore/* Disallow: /reports/access-to-information/2022/ru/search Disallow: /reports/access-to-information/2022/ru/search/* Disallow: /reports/access-to-information/2022/ru/explore/* Disallow: /reports/access-to-information/2022/ar/search Disallow: /reports/access-to-information/2022/ar/search/* Disallow: /reports/access-to-information/2022/ar/explore/* Disallow: /reports/access-to-information/2022/zh/search Disallow: /reports/access-to-information/2022/zh/search/* Disallow: /reports/access-to-information/2022/zh/explore/* Disallow: /reports/access-to-information/2022/pt-pt/search Disallow: /reports/access-to-information/2022/pt-pt/search/* Disallow: /reports/access-to-information/2022/pt-pt/explore/* Disallow: /reports/access-to-information/2022/ja/search Disallow: /reports/access-to-information/2022/ja/search/* Disallow: /reports/access-to-information/2022/ja/explore/* Disallow: /reports/access-to-information/2022/id/search Disallow: /reports/access-to-information/2022/id/search/* Disallow: /reports/access-to-information/2022/id/explore/* Disallow: /reports/access-to-information/2022/uk/search Disallow: /reports/access-to-information/2022/uk/search/* Disallow: /reports/access-to-information/2022/uk/explore/* Disallow: /reports/access-to-information/2022/uz/search Disallow: /reports/access-to-information/2022/uz/search/* Disallow: /reports/access-to-information/2022/uz/explore/* Disallow: /reports/access-to-information/2022/th/search Disallow: /reports/access-to-information/2022/th/search/* Disallow: /reports/access-to-information/2022/th/explore/* Disallow: /reports/reshaping-creativity/2022/search Disallow: /reports/reshaping-creativity/2022/en/search Disallow: /reports/reshaping-creativity/2022/en/search/* Disallow: /reports/reshaping-creativity/2022/en/explore/* Disallow: /reports/reshaping-creativity/2022/fr/search Disallow: /reports/reshaping-creativity/2022/fr/search/* Disallow: /reports/reshaping-creativity/2022/fr/explore/* Disallow: /reports/reshaping-creativity/2022/es/search Disallow: /reports/reshaping-creativity/2022/es/search/* Disallow: /reports/reshaping-creativity/2022/es/explore/* Disallow: /reports/reshaping-creativity/2022/ru/search Disallow: /reports/reshaping-creativity/2022/ru/search/* Disallow: /reports/reshaping-creativity/2022/ru/explore/* Disallow: /reports/reshaping-creativity/2022/ar/search Disallow: /reports/reshaping-creativity/2022/ar/search/* Disallow: /reports/reshaping-creativity/2022/ar/explore/* Disallow: /reports/reshaping-creativity/2022/zh/search Disallow: /reports/reshaping-creativity/2022/zh/search/* Disallow: /reports/reshaping-creativity/2022/zh/explore/* Disallow: /reports/reshaping-creativity/2022/pt-pt/search Disallow: /reports/reshaping-creativity/2022/pt-pt/search/* Disallow: /reports/reshaping-creativity/2022/pt-pt/explore/* Disallow: /reports/reshaping-creativity/2022/ja/search Disallow: /reports/reshaping-creativity/2022/ja/search/* Disallow: /reports/reshaping-creativity/2022/ja/explore/* Disallow: /reports/reshaping-creativity/2022/id/search Disallow: /reports/reshaping-creativity/2022/id/search/* Disallow: /reports/reshaping-creativity/2022/id/explore/* Disallow: /reports/reshaping-creativity/2022/uk/search Disallow: /reports/reshaping-creativity/2022/uk/search/* Disallow: /reports/reshaping-creativity/2022/uk/explore/* Disallow: /reports/reshaping-creativity/2022/uz/search Disallow: /reports/reshaping-creativity/2022/uz/search/* Disallow: /reports/reshaping-creativity/2022/uz/explore/* Disallow: /reports/reshaping-creativity/2022/th/search Disallow: /reports/reshaping-creativity/2022/th/search/* Disallow: /reports/reshaping-creativity/2022/th/explore/* Disallow: /reports/science/2021/search Disallow: /reports/science/2021/en/search Disallow: /reports/science/2021/en/search/* Disallow: /reports/science/2021/en/explore/* Disallow: /reports/science/2021/fr/search Disallow: /reports/science/2021/fr/search/* Disallow: /reports/science/2021/fr/explore/* Disallow: /reports/science/2021/es/search Disallow: /reports/science/2021/es/search/* Disallow: /reports/science/2021/es/explore/* Disallow: /reports/science/2021/ru/search Disallow: /reports/science/2021/ru/search/* Disallow: /reports/science/2021/ru/explore/* Disallow: /reports/science/2021/ar/search Disallow: /reports/science/2021/ar/search/* Disallow: /reports/science/2021/ar/explore/* Disallow: /reports/science/2021/zh/search Disallow: /reports/science/2021/zh/search/* Disallow: /reports/science/2021/zh/explore/* Disallow: /reports/science/2021/pt-pt/search Disallow: /reports/science/2021/pt-pt/search/* Disallow: /reports/science/2021/pt-pt/explore/* Disallow: /reports/science/2021/ja/search Disallow: /reports/science/2021/ja/search/* Disallow: /reports/science/2021/ja/explore/* Disallow: /reports/science/2021/id/search Disallow: /reports/science/2021/id/search/* Disallow: /reports/science/2021/id/explore/* Disallow: /reports/science/2021/uk/search Disallow: /reports/science/2021/uk/search/* Disallow: /reports/science/2021/uk/explore/* Disallow: /reports/science/2021/uz/search Disallow: /reports/science/2021/uz/search/* Disallow: /reports/science/2021/uz/explore/* Disallow: /reports/science/2021/th/search Disallow: /reports/science/2021/th/search/* Disallow: /reports/science/2021/th/explore/* Disallow: /tich4sd/search Disallow: /tich4sd/en/search Disallow: /tich4sd/en/search/* Disallow: /tich4sd/en/explore/* Disallow: /tich4sd/fr/search Disallow: /tich4sd/fr/search/* Disallow: /tich4sd/fr/explore/* Disallow: /tich4sd/es/search Disallow: /tich4sd/es/search/* Disallow: /tich4sd/es/explore/* Disallow: /tich4sd/ru/search Disallow: /tich4sd/ru/search/* Disallow: /tich4sd/ru/explore/* Disallow: /tich4sd/ar/search Disallow: /tich4sd/ar/search/* Disallow: /tich4sd/ar/explore/* Disallow: /tich4sd/zh/search Disallow: /tich4sd/zh/search/* Disallow: /tich4sd/zh/explore/* Disallow: /tich4sd/pt-pt/search Disallow: /tich4sd/pt-pt/search/* Disallow: /tich4sd/pt-pt/explore/* Disallow: /tich4sd/ja/search Disallow: /tich4sd/ja/search/* Disallow: /tich4sd/ja/explore/* Disallow: /tich4sd/id/search Disallow: /tich4sd/id/search/* Disallow: /tich4sd/id/explore/* Disallow: /tich4sd/uk/search Disallow: /tich4sd/uk/search/* Disallow: /tich4sd/uk/explore/* Disallow: /tich4sd/uz/search Disallow: /tich4sd/uz/search/* Disallow: /tich4sd/uz/explore/* Disallow: /tich4sd/th/search Disallow: /tich4sd/th/search/* Disallow: /tich4sd/th/explore/* Disallow: /reports/sjdi/2020/search Disallow: /reports/sjdi/2020/en/search Disallow: /reports/sjdi/2020/en/search/* Disallow: /reports/sjdi/2020/en/explore/* Disallow: /reports/sjdi/2020/fr/search Disallow: /reports/sjdi/2020/fr/search/* Disallow: /reports/sjdi/2020/fr/explore/* Disallow: /reports/sjdi/2020/es/search Disallow: /reports/sjdi/2020/es/search/* Disallow: /reports/sjdi/2020/es/explore/* Disallow: /reports/sjdi/2020/ru/search Disallow: /reports/sjdi/2020/ru/search/* Disallow: /reports/sjdi/2020/ru/explore/* Disallow: /reports/sjdi/2020/ar/search Disallow: /reports/sjdi/2020/ar/search/* Disallow: /reports/sjdi/2020/ar/explore/* Disallow: /reports/sjdi/2020/zh/search Disallow: /reports/sjdi/2020/zh/search/* Disallow: /reports/sjdi/2020/zh/explore/* Disallow: /reports/sjdi/2020/pt-pt/search Disallow: /reports/sjdi/2020/pt-pt/search/* Disallow: /reports/sjdi/2020/pt-pt/explore/* Disallow: /reports/sjdi/2020/ja/search Disallow: /reports/sjdi/2020/ja/search/* Disallow: /reports/sjdi/2020/ja/explore/* Disallow: /reports/sjdi/2020/id/search Disallow: /reports/sjdi/2020/id/search/* Disallow: /reports/sjdi/2020/id/explore/* Disallow: /reports/sjdi/2020/uk/search Disallow: /reports/sjdi/2020/uk/search/* Disallow: /reports/sjdi/2020/uk/explore/* Disallow: /reports/sjdi/2020/uz/search Disallow: /reports/sjdi/2020/uz/search/* Disallow: /reports/sjdi/2020/uz/explore/* Disallow: /reports/sjdi/2020/th/search Disallow: /reports/sjdi/2020/th/search/* Disallow: /reports/sjdi/2020/th/explore/* Disallow: /reports/safety-journalists/2022/search Disallow: /reports/safety-journalists/2022/en/search Disallow: /reports/safety-journalists/2022/en/search/* Disallow: /reports/safety-journalists/2022/en/explore/* Disallow: /reports/safety-journalists/2022/fr/search Disallow: /reports/safety-journalists/2022/fr/search/* Disallow: /reports/safety-journalists/2022/fr/explore/* Disallow: /reports/safety-journalists/2022/es/search Disallow: /reports/safety-journalists/2022/es/search/* Disallow: /reports/safety-journalists/2022/es/explore/* Disallow: /reports/safety-journalists/2022/ru/search Disallow: /reports/safety-journalists/2022/ru/search/* Disallow: /reports/safety-journalists/2022/ru/explore/* Disallow: /reports/safety-journalists/2022/ar/search Disallow: /reports/safety-journalists/2022/ar/search/* Disallow: /reports/safety-journalists/2022/ar/explore/* Disallow: /reports/safety-journalists/2022/zh/search Disallow: /reports/safety-journalists/2022/zh/search/* Disallow: /reports/safety-journalists/2022/zh/explore/* Disallow: /reports/safety-journalists/2022/pt-pt/search Disallow: /reports/safety-journalists/2022/pt-pt/search/* Disallow: /reports/safety-journalists/2022/pt-pt/explore/* Disallow: /reports/safety-journalists/2022/ja/search Disallow: /reports/safety-journalists/2022/ja/search/* Disallow: /reports/safety-journalists/2022/ja/explore/* Disallow: /reports/safety-journalists/2022/id/search Disallow: /reports/safety-journalists/2022/id/search/* Disallow: /reports/safety-journalists/2022/id/explore/* Disallow: /reports/safety-journalists/2022/uk/search Disallow: /reports/safety-journalists/2022/uk/search/* Disallow: /reports/safety-journalists/2022/uk/explore/* Disallow: /reports/safety-journalists/2022/uz/search Disallow: /reports/safety-journalists/2022/uz/search/* Disallow: /reports/safety-journalists/2022/uz/explore/* Disallow: /reports/safety-journalists/2022/th/search Disallow: /reports/safety-journalists/2022/th/search/* Disallow: /reports/safety-journalists/2022/th/explore/* Disallow: /webguidelines/search Disallow: /webguidelines/en/search Disallow: /webguidelines/en/search/* Disallow: /webguidelines/en/explore/* Disallow: /webguidelines/fr/search Disallow: /webguidelines/fr/search/* Disallow: /webguidelines/fr/explore/* Disallow: /webguidelines/es/search Disallow: /webguidelines/es/search/* Disallow: /webguidelines/es/explore/* Disallow: /webguidelines/ru/search Disallow: /webguidelines/ru/search/* Disallow: /webguidelines/ru/explore/* Disallow: /webguidelines/ar/search Disallow: /webguidelines/ar/search/* Disallow: /webguidelines/ar/explore/* Disallow: /webguidelines/zh/search Disallow: /webguidelines/zh/search/* Disallow: /webguidelines/zh/explore/* Disallow: /webguidelines/pt-pt/search Disallow: /webguidelines/pt-pt/search/* Disallow: /webguidelines/pt-pt/explore/* Disallow: /webguidelines/ja/search Disallow: /webguidelines/ja/search/* Disallow: /webguidelines/ja/explore/* Disallow: /webguidelines/id/search Disallow: /webguidelines/id/search/* Disallow: /webguidelines/id/explore/* Disallow: /webguidelines/uk/search Disallow: /webguidelines/uk/search/* Disallow: /webguidelines/uk/explore/* Disallow: /webguidelines/uz/search Disallow: /webguidelines/uz/search/* Disallow: /webguidelines/uz/explore/* Disallow: /webguidelines/th/search Disallow: /webguidelines/th/search/* Disallow: /webguidelines/th/explore/* Disallow: /reports/world-media-trends/2021/search Disallow: /reports/world-media-trends/2021/en/search Disallow: /reports/world-media-trends/2021/en/search/* Disallow: /reports/world-media-trends/2021/en/explore/* Disallow: /reports/world-media-trends/2021/fr/search Disallow: /reports/world-media-trends/2021/fr/search/* Disallow: /reports/world-media-trends/2021/fr/explore/* Disallow: /reports/world-media-trends/2021/es/search Disallow: /reports/world-media-trends/2021/es/search/* Disallow: /reports/world-media-trends/2021/es/explore/* Disallow: /reports/world-media-trends/2021/ru/search Disallow: /reports/world-media-trends/2021/ru/search/* Disallow: /reports/world-media-trends/2021/ru/explore/* Disallow: /reports/world-media-trends/2021/ar/search Disallow: /reports/world-media-trends/2021/ar/search/* Disallow: /reports/world-media-trends/2021/ar/explore/* Disallow: /reports/world-media-trends/2021/zh/search Disallow: /reports/world-media-trends/2021/zh/search/* Disallow: /reports/world-media-trends/2021/zh/explore/* Disallow: /reports/world-media-trends/2021/pt-pt/search Disallow: /reports/world-media-trends/2021/pt-pt/search/* Disallow: /reports/world-media-trends/2021/pt-pt/explore/* Disallow: /reports/world-media-trends/2021/ja/search Disallow: /reports/world-media-trends/2021/ja/search/* Disallow: /reports/world-media-trends/2021/ja/explore/* Disallow: /reports/world-media-trends/2021/id/search Disallow: /reports/world-media-trends/2021/id/search/* Disallow: /reports/world-media-trends/2021/id/explore/* Disallow: /reports/world-media-trends/2021/uk/search Disallow: /reports/world-media-trends/2021/uk/search/* Disallow: /reports/world-media-trends/2021/uk/explore/* Disallow: /reports/world-media-trends/2021/uz/search Disallow: /reports/world-media-trends/2021/uz/search/* Disallow: /reports/world-media-trends/2021/uz/explore/* Disallow: /reports/world-media-trends/2021/th/search Disallow: /reports/world-media-trends/2021/th/search/* Disallow: /reports/world-media-trends/2021/th/explore/* Disallow: /reports/wwdr/2022/search Disallow: /reports/wwdr/2022/en/search Disallow: /reports/wwdr/2022/en/search/* Disallow: /reports/wwdr/2022/en/explore/* Disallow: /reports/wwdr/2022/fr/search Disallow: /reports/wwdr/2022/fr/search/* Disallow: /reports/wwdr/2022/fr/explore/* Disallow: /reports/wwdr/2022/es/search Disallow: /reports/wwdr/2022/es/search/* Disallow: /reports/wwdr/2022/es/explore/* Disallow: /reports/wwdr/2022/ru/search Disallow: /reports/wwdr/2022/ru/search/* Disallow: /reports/wwdr/2022/ru/explore/* Disallow: /reports/wwdr/2022/ar/search Disallow: /reports/wwdr/2022/ar/search/* Disallow: /reports/wwdr/2022/ar/explore/* Disallow: /reports/wwdr/2022/zh/search Disallow: /reports/wwdr/2022/zh/search/* Disallow: /reports/wwdr/2022/zh/explore/* Disallow: /reports/wwdr/2022/pt-pt/search Disallow: /reports/wwdr/2022/pt-pt/search/* Disallow: /reports/wwdr/2022/pt-pt/explore/* Disallow: /reports/wwdr/2022/ja/search Disallow: /reports/wwdr/2022/ja/search/* Disallow: /reports/wwdr/2022/ja/explore/* Disallow: /reports/wwdr/2022/id/search Disallow: /reports/wwdr/2022/id/search/* Disallow: /reports/wwdr/2022/id/explore/* Disallow: /reports/wwdr/2022/uk/search Disallow: /reports/wwdr/2022/uk/search/* Disallow: /reports/wwdr/2022/uk/explore/* Disallow: /reports/wwdr/2022/uz/search Disallow: /reports/wwdr/2022/uz/search/* Disallow: /reports/wwdr/2022/uz/explore/* Disallow: /reports/wwdr/2022/th/search Disallow: /reports/wwdr/2022/th/search/* Disallow: /reports/wwdr/2022/th/explore/* Disallow: /reports/wwdr/2023/search Disallow: /reports/wwdr/2023/en/search Disallow: /reports/wwdr/2023/en/search/* Disallow: /reports/wwdr/2023/en/explore/* Disallow: /reports/wwdr/2023/fr/search Disallow: /reports/wwdr/2023/fr/search/* Disallow: /reports/wwdr/2023/fr/explore/* Disallow: /reports/wwdr/2023/es/search Disallow: /reports/wwdr/2023/es/search/* Disallow: /reports/wwdr/2023/es/explore/* Disallow: /reports/wwdr/2023/ru/search Disallow: /reports/wwdr/2023/ru/search/* Disallow: /reports/wwdr/2023/ru/explore/* Disallow: /reports/wwdr/2023/ar/search Disallow: /reports/wwdr/2023/ar/search/* Disallow: /reports/wwdr/2023/ar/explore/* Disallow: /reports/wwdr/2023/zh/search Disallow: /reports/wwdr/2023/zh/search/* Disallow: /reports/wwdr/2023/zh/explore/* Disallow: /reports/wwdr/2023/pt-pt/search Disallow: /reports/wwdr/2023/pt-pt/search/* Disallow: /reports/wwdr/2023/pt-pt/explore/* Disallow: /reports/wwdr/2023/ja/search Disallow: /reports/wwdr/2023/ja/search/* Disallow: /reports/wwdr/2023/ja/explore/* Disallow: /reports/wwdr/2023/id/search Disallow: /reports/wwdr/2023/id/search/* Disallow: /reports/wwdr/2023/id/explore/* Disallow: /reports/wwdr/2023/uk/search Disallow: /reports/wwdr/2023/uk/search/* Disallow: /reports/wwdr/2023/uk/explore/* Disallow: /reports/wwdr/2023/uz/search Disallow: /reports/wwdr/2023/uz/search/* Disallow: /reports/wwdr/2023/uz/explore/* Disallow: /reports/wwdr/2023/th/search Disallow: /reports/wwdr/2023/th/search/* Disallow: /reports/wwdr/2023/th/explore/* Disallow: /en/intangible-cultural-heritage/list Disallow: /en/intangible-cultural-heritage/grid Disallow: /en/intangible-cultural-heritage/map Disallow: /fr/intangible-cultural-heritage/list Disallow: /fr/intangible-cultural-heritage/grid Disallow: /fr/intangible-cultural-heritage/map Disallow: /es/intangible-cultural-heritage/list Disallow: /es/intangible-cultural-heritage/grid Disallow: /es/intangible-cultural-heritage/map Disallow: /ru/intangible-cultural-heritage/list Disallow: /ru/intangible-cultural-heritage/grid Disallow: /ru/intangible-cultural-heritage/map Disallow: /zh/intangible-cultural-heritage/list Disallow: /zh/intangible-cultural-heritage/grid Disallow: /zh/intangible-cultural-heritage/map Disallow: /en/world-media-trends/list Disallow: /en/world-media-trends/grid Disallow: /en/world-media-trends/map Disallow: /fr/world-media-trends/list Disallow: /fr/world-media-trends/grid Disallow: /fr/world-media-trends/map Disallow: /es/world-media-trends/list Disallow: /es/world-media-trends/grid Disallow: /es/world-media-trends/map Disallow: /ru/world-media-trends/list Disallow: /ru/world-media-trends/grid Disallow: /ru/world-media-trends/map Disallow: /ar/world-media-trends/list Disallow: /ar/world-media-trends/grid Disallow: /ar/world-media-trends/map Disallow: /zh/world-media-trends/list Disallow: /zh/world-media-trends/grid Disallow: /zh/world-media-trends/map Disallow: /pt/world-media-trends/list Disallow: /pt/world-media-trends/grid Disallow: /pt/world-media-trends/map Disallow: /en/open-science/list Disallow: /en/open-science/grid Disallow: /en/open-science/map Disallow: /zh/open-science/list Disallow: /zh/open-science/grid Disallow: /zh/open-science/map Disallow: /fr/affaires-juridiques/list Disallow: /fr/affaires-juridiques/grid Disallow: /fr/affaires-juridiques/map Disallow: /es/asuntos-juridicos/list Disallow: /es/asuntos-juridicos/grid Disallow: /es/asuntos-juridicos/map Disallow: /en/memory-world/list Disallow: /en/memory-world/grid Disallow: /en/memory-world/map Disallow: /fr/memory-world/list Disallow: /fr/memory-world/grid Disallow: /fr/memory-world/map Disallow: /es/memory-world/list Disallow: /es/memory-world/grid Disallow: /es/memory-world/map Disallow: /zh/memory-world/list Disallow: /zh/memory-world/grid Disallow: /zh/memory-world/map Disallow: /en/mab/list Disallow: /en/mab/grid Disallow: /en/mab/map Disallow: /fr/mab/list Disallow: /fr/mab/grid Disallow: /fr/mab/map Disallow: /zh/mab/list Disallow: /zh/mab/grid Disallow: /zh/mab/map Disallow: /en/legal-affairs/list Disallow: /en/legal-affairs/grid Disallow: /en/legal-affairs/map Disallow: /fr/legal-affairs/list Disallow: /fr/legal-affairs/grid Disallow: /fr/legal-affairs/map Disallow: /es/legal-affairs/list Disallow: /es/legal-affairs/grid Disallow: /es/legal-affairs/map Disallow: /zh/legal-affairs/list Disallow: /zh/legal-affairs/grid Disallow: /zh/legal-affairs/map Disallow: /en/internet-universality-indicators/list Disallow: /en/internet-universality-indicators/grid Disallow: /en/internet-universality-indicators/map Disallow: /fr/internet-universality-indicators/list Disallow: /fr/internet-universality-indicators/grid Disallow: /fr/internet-universality-indicators/map Disallow: /es/internet-universality-indicators/list Disallow: /es/internet-universality-indicators/grid Disallow: /es/internet-universality-indicators/map Disallow: /ru/internet-universality-indicators/list Disallow: /ru/internet-universality-indicators/grid Disallow: /ru/internet-universality-indicators/map Disallow: /zh/internet-universality-indicators/list Disallow: /zh/internet-universality-indicators/grid Disallow: /zh/internet-universality-indicators/map Disallow: /en/world-heritage/list Disallow: /en/world-heritage/grid Disallow: /en/world-heritage/map Disallow: /fr/world-heritage/list Disallow: /fr/world-heritage/grid Disallow: /fr/world-heritage/map Disallow: /es/world-heritage/list Disallow: /es/world-heritage/grid Disallow: /es/world-heritage/map Disallow: /ru/world-heritage/list Disallow: /ru/world-heritage/grid Disallow: /ru/world-heritage/map Disallow: /ar/world-heritage/list Disallow: /ar/world-heritage/grid Disallow: /ar/world-heritage/map Disallow: /zh/world-heritage/list Disallow: /zh/world-heritage/grid Disallow: /zh/world-heritage/map Disallow: /en/world-book-capital-network/list Disallow: /en/world-book-capital-network/grid Disallow: /en/world-book-capital-network/map Disallow: /en/safety-journalists/observatory/list Disallow: /en/safety-journalists/observatory/grid Disallow: /en/safety-journalists/observatory/map Disallow: /en/enabling-interculturaldialogue/list Disallow: /en/enabling-interculturaldialogue/grid Disallow: /en/enabling-interculturaldialogue/map Disallow: /fr/enabling-interculturaldialogue/list Disallow: /fr/enabling-interculturaldialogue/grid Disallow: /fr/enabling-interculturaldialogue/map Disallow: /en/memory-world-committees/list Disallow: /en/memory-world-committees/grid Disallow: /en/memory-world-committees/map
robots.txt versions
| From | Through | State | Version | |
|---|---|---|---|---|
| 2026-10-26 | 2026-10-27 | ok 200 | f5afb304fb7f |
Timeline of changes
| Date | What changed |
|---|---|
| No changes since the first observation (2026-10-26). | |
Reconstructed history (Common Crawl)
From Common Crawl's robots.txt captures: what CCBot was served, one crawl per quarter. A separate series from the daily observations above; a 403 here means Common Crawl was refused, not this ledger.
| Crawl | Host | State | GPTBot | OAI-SearchBot | ChatGPT-User | ClaudeBot | Claude-SearchBot | Claude-User | PerplexityBot |
|---|---|---|---|---|---|---|---|---|---|
| 2026-09-21 CC-MAIN-2026-39 | www.unesco.org | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2024-09-16 CC-MAIN-2024-38 | www.unesco.org | fetch-blocked | unknown | unknown | unknown | unknown | unknown | unknown | unknown |
| 2023-10-02 CC-MAIN-2023-40 | www.unesco.org | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2022-10-03 CC-MAIN-2022-40 | www.unesco.org | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2021-09-27 CC-MAIN-2021-39 | www.unesco.org | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2020-09-28 CC-MAIN-2020-40 | www.unesco.org | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2019-09-23 CC-MAIN-2019-39 | www.unesco.org | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2018-09-24 CC-MAIN-2018-39 | www.unesco.org | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2017-09-25 CC-MAIN-2017-39 | www.unesco.org | ok view | allows | allows | unknown | allows | allows | unknown | allows |
| 2016-09-05 CC-MAIN-2016-36 | www.unesco.org | ok view | allows | allows | unknown | allows | allows | unknown | allows |
Evidence
Every daily observation of unesco.org is a leaf in that day's Merkle tree. Proof of the robots.txt line for 2026-10-26: audit path (JSON), day root and OpenTimestamps proof (complete (bitcoin block 973294)).
API: https://infrarabbit.com/crawlers/api/v1/policy/unesco.org