Auto-build a clean llms.txt file from your sitemap in seconds. Fetches page titles, groups URLs by section, and produces both llms.txt and llms-full.txt scaffolds.
llms.txt is an emerging standard for declaring to AI agents (ChatGPT, Claude, Perplexity, Google AI Overviews) which URLs on your site contain the most important content. This generator handles the boring parts: finding your sitemap, parsing it, fetching titles, and grouping URLs into a clean structure.
We probe 7 common sitemap locations (including sitemap_index.xml for WordPress + Yoast) and parse the Sitemap: directive in robots.txt.
URLs are automatically grouped by path pattern (services, tools, blog, case studies). Edit groups inline; reorganize freely.
We fetch the first 60 pages in parallel through our proxy and extract <title> tags so every line has a real description.
Both llms.txt and a starter llms-full.txt scaffold render live as you edit. Copy or download when ready.
Spacemen Digital ships llms.txt, AI Instructions pages, schema markup and the full AEO stack directly into client codebases as part of every retainer.