Skip to content

Blog

What is llms.txt, and does your website need one?

llms.txt is a short Markdown file placed at the root of a website that tells AI tools what the site is about and links to its most useful pages; it is a proposed standard, cheap to add, and helpful for some AI tools, but Google says it is not needed for its AI features.

By Hemanth Arety ·

What is llms.txt?

It is a plain Markdown file at yoursite.com/llms.txt that summarises your site for large language models.

The format was proposed by Jeremy Howard in September 2024. The idea is simple: web pages are full of navigation, scripts and layout, while an AI tool with a limited context window wants the essentials. A single file that says what the site is and where the important pages are gives it that in one read.

What goes in an llms.txt file?

A title, a one-paragraph summary, and lists of links with a note on each.

The proposal sets out this order:

  1. An H1 with the name of the site or project. This is the only required part.
  2. A blockquote with a short summary of what it is.
  3. Optional paragraphs or lists with more detail, without headings.
  4. H2 sections, each a list of Markdown links, optionally followed by a colon and a short note.

A section called "Optional" holds links an AI tool can skip when it needs less context.

What does a good one look like?

Short, factual and current: what you do, for whom, what it costs, and links to the pages that answer common questions.

# Your Company

> Your Company makes [product] for [who]. [One sentence on what makes it different].

Plans start at $X a month. [Where it is available].

## Product
- [Pricing](https://example.com/pricing): plans and what each includes
- [How it works](https://example.com/how-it-works): the main steps

## Help
- [FAQ](https://example.com/faq): answers to common questions

You can see Kortex's own at kortexagent.co/llms.txt. To write your own, or check one you have, use the free llms.txt generator and checker.

Does llms.txt help you show up in AI answers?

It can help AI tools that read it understand you, but no major engine has said it uses llms.txt for ranking, and Google says it is not needed.

Google's guidance on its AI features is direct: you do not need to create new machine-readable files, AI text files or markup to appear in AI Overviews or AI Mode. What matters for Google is that your pages are indexed and eligible to show with a snippet.

Other tools are different. Coding assistants and AI agents often fetch llms.txt when they are pointed at a site, and a clear summary helps them describe you correctly. So treat it as a small, low-cost extra, not a ranking trick.

What matters more than llms.txt?

Being readable by AI search crawlers, serving your words without JavaScript, and answering buyers' questions on your own pages.

If OAI-SearchBot or Claude-SearchBot is blocked, or your pages are blank until scripts run, an llms.txt file will not make up for it. Start with the steps in our guide to getting recommended by ChatGPT, and add llms.txt alongside them.

How do I add one?

Write the file, save it as llms.txt in your site's root folder, and keep it up to date when your prices or pages change.

On most hosts you upload it like robots.txt. On WordPress, a plugin or your theme's static files can serve it. The free Kortex audit checks whether you have one and writes one for your site from what it reads there.

Questions

Frequently asked questions

  • Is llms.txt the same as robots.txt?

    No. robots.txt tells crawlers what they may fetch. llms.txt tells AI tools what your site is about and which pages matter. Neither replaces the other.

  • Does Google use llms.txt?

    Google says you do not need AI text files or special markup to appear in AI Overviews or AI Mode. Its AI features rely on its normal Search index.

  • Where do I put llms.txt?

    At the root of your site, so it loads at yoursite.com/llms.txt. The proposal also allows one under a subpath to cover that part of a site.

  • What is llms-full.txt?

    A common companion file that holds the full text of the key pages in one Markdown file, for tools that want everything in a single fetch. It is a convention, not part of the core proposal.

See whether AI recommends you.

20 questions your customers ask, put to ChatGPT, Gemini and Claude, plus Google, and four fixes written for you. Free, one per website.