LLMs.txt: What It Is, What It Does, and Its Limits
A clear-eyed look at llms.txt — the emerging standard for helping AI engines understand your site, and what it actually does for citations.
What Is llms.txt?
llms.txt is a plain text file you place at the root of your domain — for example, https://yoursite.com/llms.txt. It is an emerging convention (not a formal standard yet) for telling AI language models about your site content, structure, key pages, and how you prefer to be cited. Think of it as robots.txt, but for AI engines instead of crawlers.
What It Does for AI Engines
When an AI engine crawls your site, an llms.txt file can help it understand your topic coverage more accurately, identify your most important pages, understand your preferred brand name and citation language, and map your content hierarchy without requiring full site crawl. It is particularly useful for large sites where AI crawlers may only index a fraction of your content.
Its Current Limitations
Be honest about what llms.txt does not do: it is not a direct citation trigger. Having an llms.txt file will not cause AI engines to suddenly start citing your site. Most major AI engines (ChatGPT, Perplexity, Google) do not currently give explicit preference to pages listed in llms.txt over pages they discover through other means. It is a signal, not a switch.
How to Create and Optimize Your llms.txt
A well-structured llms.txt has four sections: # Overview — one paragraph describing what your site is and who it is for. # Key Pages — your 10-15 most important URLs with one-line descriptions. # Topics — the specific topics and subtopics your site covers in depth. # Citation Preference — how you prefer to be named when cited (your full brand name, any abbreviations you use, and your preferred URL format). Keep each section concise. AI engines process text quickly, but the file should be scannable by a human too.
Where to Upload It
Place the file at the root of your domain — not in a subfolder. It must be publicly accessible at https://yourdomain.com/llms.txt. No special server configuration is needed. Just upload the plain text file to your root directory.