← Blog · October 4, 2026

llms.txt: what it is and why AI crawlers want it

A plain-text file that helps AI assistants find and understand your best content.

llms.txt is a proposed convention: a plain-text file at /llms.txt that summarises your site for large language models, with links to your most useful pages.

Why bother

AI assistants increasingly answer questions directly. Giving them a clean, structured map of your site makes it easier to find, understand and cite your content — the same idea as a sitemap, but written for language models.

What goes in it

  • A one-line description of the site
  • What you offer, in plain language
  • Links to your key pages, grouped
  • Pointers to machine-readable content (markdown versions, sitemaps)

A minimal example

# Example

> Free SEO tools that run in the browser.

## Free tools
- FAQ schema generator: https://example.com/tools/faq-schema-generator

## Machine-readable
- Markdown versions at /tools/{slug}.md

Related conventions

  • robots.txt — controls what crawlers may fetch
  • sitemap.xml — lists indexable URLs for search engines
  • Markdown versions of pages — easy for models to read

See it live

This site publishes its own llms.txt and a markdown version of every tool page, e.g. /tools/faq-schema-generator.md. Point AI crawlers at your best content and keep it current.