What llms.txt is
llms.txt is a proposed standard (from llmstxt.org) for a Markdown file at /llms.txt that gives AI assistants and agents a short, curated map of your site. Where a sitemap lists every URL for crawlers, llms.txt picks the handful of pages that explain what you do, in a format a language model can read in one pass.
Support is still early. No major AI company has committed to reading it for every answer, but coding assistants, agent frameworks and several AI search tools already fetch it, and it costs a few minutes to publish.
The format
The file is plain Markdown in a fixed order:
- An
# H1with the site or project name. This is the only required part. - A
>blockquote with a one-sentence summary. - Optional paragraphs or lists with extra context: who it is for, key terms, what it is not.
## H2sections, each a list of links:- [Title](url): optional note.- An optional
## Optionalsection for links that can be skipped when context is tight.
What to include
- Start with the pages that answer "what is this". Homepage, pricing, a features or how-it-works page.
- For developer products, link docs directly. Quick start, API reference, SDK guides. Markdown versions (
.mdURLs) are ideal if you have them. - Write the notes. "Pricing: free tier, then $19 a month per seat" helps a model answer without opening the page.
- Keep it short. Ten to thirty links is plenty. It is a guide, not a sitemap.
Publish and check
Upload the file so it loads at https://yourdomain.com/llms.txt as plain text. Make sure your robots.txt does not block the AI crawlers you want to read it, then confirm the structure with the llms.txt validator. The webpage to Markdown converter is handy for making .md versions of the pages you link.