Sitemap, robots.txt and llms.txt
Your site builds a sitemap for search engines and an llms.txt table of contents for AI assistants automatically; check and refresh them on Settings → SEO → Sitemap and llms.txt. The sitemap needs search engine indexing switched on, and llms.txt needs AI crawlers allowed as well.
There is nothing to fill in on this sub-tab: the files build themselves; here you see their status and can regenerate them when needed.
Sitemap
- It lists the public, published pages, news and events, with their language versions.
- A page where you switched off search engine indexing is left out, and so is one whose canonical address points elsewhere.
- It rebuilds itself after content changes. If it is older than 24 hours the tab says so; Refresh regenerates it right away.
- It is only available when Allow search engine indexing is on in the Indexing sub-tab. If it is off, the tab says so, and Allow and generate switches it on in one step.
robots.txt
The rules for search engines and AI crawlers come from the Indexing sub-tab: whether indexing is allowed, the Custom disallow paths and Allow AI crawlers.
llms.txt
- A short, structured table of contents of the public content, for AI assistants and agents.
- Every listed page is also available at the same address ending in
.md, as plain Markdown. - It rebuilds itself after content changes; Refresh updates it right away.
- It is available when both search engine indexing and Allow AI crawlers are on in the Indexing sub-tab.
Copy URL copies the file's address, for example for Google Search Console.