What Is llms.txt? The Complete Setup Guide
llms.txt is a plain-text Markdown file placed at the root of your website (yoursite.com/llms.txt) that gives AI language models a clean, structured summary of who you are and what your most important pages contain. Think of it as robots.txt's younger sibling: robots.txt tells crawlers what they may access; llms.txt tells AI models what actually matters.
Why llms.txt exists
Websites are built for humans — navigation, scripts, pop-ups, styling. When an AI system retrieves your page, it has to dig your actual content out of all that noise, inside a limited context window. The llms.txt proposal (introduced by Jeremy Howard in 2024) solves this with one predictable location where a model can read a distilled version of your site: what the business is, what it offers, and where the canonical explanations live.
Does llms.txt actually improve AI visibility?
Honest answer: it's an emerging standard, not a guaranteed ranking lever. Adoption is growing across AI tooling, some retrieval systems read it, and the cost of adding one is close to zero. We treat it the way early adopters treated schema markup a decade ago — a cheap, forward-compatible signal that makes your site easier for machines to understand correctly. It complements, but doesn't replace, the fundamentals in our AI SEO guide.
llms.txt format
The spec is simple Markdown, in this order:
- An H1 with your site or business name (required)
- A blockquote summarizing what you do
- Optional detail paragraphs
- H2 sections containing lists of key links, each with a short description
A copy-paste template
# Acme Plumbing > Acme Plumbing is a licensed plumbing company serving Lexington, KY > and surrounding areas since 2005. Emergency repairs, water heaters, > and remodels for homes and businesses. ## Services - [Emergency Plumbing](https://acme.com/emergency): 24/7 emergency repair - [Water Heaters](https://acme.com/water-heaters): installation and repair ## About - [About Us](https://acme.com/about): licensing, team, and service area - [Reviews](https://acme.com/reviews): customer reviews and ratings ## Contact - [Contact](https://acme.com/contact): phone, address, hours
How to set it up (5 steps)
- Write the file using the template above — plain Markdown, saved as
llms.txt. - Upload it to your site root so it's reachable at
yourdomain.com/llms.txt. - Verify it loads in a browser as plain text (no redirects, no HTML wrapper).
- Allow AI crawlers in robots.txt — GPTBot, Google-Extended, PerplexityBot, ClaudeBot — or the file can't be fetched at all.
- Keep it current. Update it when services, locations, or key pages change.
llms.txt vs robots.txt vs sitemap.xml
- robots.txt — permission: which crawlers may access which paths.
- sitemap.xml — discovery: every URL you want indexed.
- llms.txt — comprehension: a curated, readable summary for language models.
They work together — and all three are part of the technical layer of AI SEO. Want it handled for you? It's included in our AI Visibility service.