Founding members get 50% off for life. Dottpace is coming soon. Join the list

LearnDoes llms.txt work?

Does llms.txt work? What it is, and whether your site needs one

Guide by Dottpace Research · Last updated

llms.txt is a proposed text file that gives AI tools a short, link-rich summary of a website, but there's no public evidence that it makes ChatGPT, Gemini, Claude or Google's AI Overviews cite or recommend you. Google says you don't need AI text files to appear in its AI features, and none of the major AI companies' crawler documentation says they use it; it's worth having mainly for documentation-heavy products whose users paste docs into AI coding tools.

Few topics in SEO have produced as many confident claims with as little evidence. Some tools flag a missing llms.txt as an error, and some agencies sell it as an "AI ranking" fix. This guide separates what the proposal is from what the AI companies have actually said, so you can decide in five minutes.

What is llms.txt?

llms.txt is a proposal by Jeremy Howard, first published on September 3, 2024 at llmstxt.org. It describes itself as "a proposal to standardise on using an /llms.txt file to provide information to help agents use a website". It is a proposal open for community input, not a standard from a standards body.

The file sits at the root of a site (/llms.txt) and is written in Markdown:

# Acme Store
> Outdoor gear store in Denver, shipping across the US. Backpacks, tents and hiking boots.

## Main pages
- [Backpacks](https://acme.example/collections/backpacks): daypacks and travel packs
- [Shipping and returns](https://acme.example/policies/shipping): free shipping over $75, 30-day returns

## Optional
- [Blog](https://acme.example/blogs/news)

Only the H1 with the site's name is required; a short summary, sections of links and an "Optional" section are suggested. The proposal also suggests offering plain Markdown copies of pages (for example page.md). Some sites also publish a longer llms-full.txt with whole documents inlined; that convention grew up around the proposal rather than in its original text.

Does Google use llms.txt?

Google's guidance for AI Overviews and AI Mode says: "You don't need to create new machine readable files, AI text files, or markup to appear in these features." To be shown as a link, a page needs to be indexed and eligible to show a snippet, and "there are no additional technical requirements". In other words, for Google's AI features, llms.txt is neither required nor described as a signal. Google's representatives have also been reported dismissing it in public discussions, but those are secondhand reports; the documentation above is the primary source.

Do ChatGPT, Claude or Perplexity use it?

None of them say so in their crawler documentation. OpenAI, Anthropic and Perplexity each document how their bots find pages and how to control them with robots.txt; we found no mention of llms.txt in those pages when we checked them on October 19, 2026. Several AI companies publish llms.txt files for their own developer docs, which helps people who paste those docs into a coding assistant. Publishing one is not the same as reading yours to decide whom to recommend.

Could an AI agent read your llms.txt if it happens to fetch it? Yes, like any public file. That's a long way from "it improves your visibility", and nobody has shown that it does.

So does llms.txt work?

For its original purpose, giving an AI tool a clean map of documentation, it can be handy. For getting recommended or cited by AI assistants, there's no evidence that it works. What does have evidence is less exciting: assistants cite pages their search systems can crawl, index and rank. The levers are the same ones covered in how to get your business recommended by ChatGPT: let the AI search bots in, be indexed, state your facts plainly, and be mentioned by others.

When is llms.txt worth adding?

  • Developer tools and APIs. Users ask coding assistants to read your docs. A curated llms.txt with links to Markdown versions of your docs can make those answers better.
  • Large documentation or help centers, where a short map helps any tool find the right page.
  • When it costs nothing to keep accurate, for example when your docs platform generates it automatically.

It's rarely worth the time for a local business, a small store or a brochure site. An out-of-date llms.txt, with old prices or dead links, is worse than none.

If you add one, how should you write it?

  1. Start with the facts a tool needs first. The H1 is your exact business or product name; the summary line says what you do, for whom and where, in one sentence.
  2. Link to pages that already answer questions well: pricing, main products or services, policies, docs. Each link gets a short note saying what's on the page.
  3. Keep it short. It's a map, not a copy of your site. Put secondary links under an "Optional" heading, as the proposal suggests.
  4. Use full, canonical addresses that return a normal page, not redirects or pages blocked in robots.txt.
  5. Put it on your release checklist. When prices, plans or policies change, update the file the same day, or generate it from the same source as your pages.
  6. Don't put anything in it that isn't on your site. Claims written only for machines are the kind of thing search engines' spam policies warn against.

To check whether a site has one, open https://yourwebsite.com/llms.txt. A "not found" page is perfectly fine.

Is a missing llms.txt an SEO error?

No. If an audit tool lists "llms.txt missing" as an error or lowers a score for it, that reflects the tool's opinion, not anything Google, OpenAI, Anthropic or Perplexity has documented. Treat it as optional. Dottpace's own audit doesn't count a missing llms.txt as an issue.

For transparency: as of October 19, 2026, dottpace.com doesn't publish an llms.txt. If we add one, it will be because it's cheap to keep correct, not because we expect it to change rankings or citations.

What should you do instead?

  1. Make sure the AI search bots can read your site. Check your robots.txt for AI crawlers (the free AI bot checker does it for 17 bots) and any CDN bot settings. robots.txt, not llms.txt, is the file AI crawlers say they follow, and blocks there are common: in our study of 2,117 live websites, 10.0% blocked at least one AI bot and 5.3% blocked at least one of OAI-SearchBot, ChatGPT-User or PerplexityBot.
  2. Get indexed in Google and Bing. ChatGPT search citations overlap heavily with Bing's results in published tests.
  3. Write pages that answer the questions buyers ask, with specific facts, prices and sources.
  4. Check what assistants actually say about you, on a schedule, with the same questions each time.

Sources

See what your site is missing.