Help center › Apps

Sitemap, robots.txt and llms.txt

Your site builds a sitemap for search engines and an llms.txt table of contents for AI assistants automatically; check and refresh them on Settings → SEO → Sitemap and llms.txt. The sitemap needs search engine indexing switched on, and llms.txt needs AI crawlers allowed as well.

There is nothing to fill in on this sub-tab: the files build themselves; here you see their status and can regenerate them when needed.

Sitemap

  • It lists the public, published pages, news and events, with their language versions.
  • A page where you switched off search engine indexing is left out, and so is one whose canonical address points elsewhere.
  • It rebuilds itself after content changes. If it is older than 24 hours the tab says so; Refresh regenerates it right away.
  • It is only available when Allow search engine indexing is on in the Indexing sub-tab. If it is off, the tab says so, and Allow and generate switches it on in one step.

robots.txt

The rules for search engines and AI crawlers come from the Indexing sub-tab: whether indexing is allowed, the Custom disallow paths and Allow AI crawlers.

llms.txt

  • A short, structured table of contents of the public content, for AI assistants and agents.
  • Every listed page is also available at the same address ending in .md, as plain Markdown.
  • It rebuilds itself after content changes; Refresh updates it right away.
  • It is available when both search engine indexing and Allow AI crawlers are on in the Indexing sub-tab.

Copy URL copies the file's address, for example for Google Search Console.