llms.txt generator
The llms.txt generator is a free tool that reads your home page and sitemap and writes a draft llms.txt file, with your pages grouped into sections. Edit the draft, then download it.
Requests your home page, robots.txt, sitemap and up to 20 pages. Nothing is stored.
Validate the file
After you publish it, check the format and test every link.
Check what AI crawlers get
Tags and files only help when crawlers can read the page. The free scan requests your pages as GPTBot, ClaudeBot, PerplexityBot and CCBot and shows what arrives.
Questions
How does the llms.txt generator work?
It reads your home page for the site name and description, then your sitemap (or the links on your home page if there is no sitemap). It reads the title and description of up to 20 pages, groups them into sections by path, and writes the file in the llmstxt.org format.
Can I edit the file?
Yes. The draft is a starting point. Edit the summary, remove pages that do not help a reader, and add notes after each link. Then download it and upload it as /llms.txt at the root of your domain.
Which pages should be in llms.txt?
Your most useful pages for someone who wants to understand or use the product: what it does, pricing, docs, key guides and comparisons. Put links that can be skipped under an H2 called Optional.
How do I check the file after I publish it?
Run the free llms.txt validator. It checks the format and tests whether each link loads.