llms.txt: The Complete 2026 Implementation Guide for AI-Visible Websites
Reading time: 12 min
As of early 2026, less than 15% of websites have implemented llms.txt
— yet it's quickly becoming the most important file you can add to your server. If you want ChatGPT, Claude, Gemini, and Perplexity to understand and recommend your product, this guide is where you start.
What Is llms.txt — And Why Should You Care?
When Google crawls your site, it reads HTML, follows links, and builds an index. When an AI language model "reads" your site, it does something fundamentally different: it tries to understand context — what your product does, who it serves, what problems it solves, and which pages contain authoritative answers.
The llms.txt file is a plain Markdown document placed at the root of your website (/llms.txt) that gives AI systems a clean, structured summary of your site. Think of it as a curated tour guide you hand to every AI that visits.
The specification was originally proposed by Jeremy Howard of Answer.AI in September 2024 and has since grown into a widely-adopted convention across SaaS products, documentation sites, and enterprise platforms.
"An LLM doesn't browse your website. It processes tokens. llms.txt is how you make sure the right tokens come first."
The Problem llms.txt Solves
Without llms.txt, here is what happens when an LLM tries to understand your site:
+------------------------------------------+ | WITHOUT llms.txt | +------------------------------------------+ | | | AI Crawler --> Homepage (marketing) | | --> Blog post (random) | | --> Pricing (fragments) | | --> Footer links | | | | Result: incomplete understanding, | | wrong use cases, missed key pages. | +------------------------------------------+ +------------------------------------------+ | WITH llms.txt | +------------------------------------------+ | | | AI reads llms.txt FIRST: | | - Who you are (briefing) | | - Core product pages (annotated) | | - Documentation (labeled) | | - Use cases | | - Key differentiators | | | | Result: accurate product understanding, | | right recommendations, correct cites. | +------------------------------------------+
The Exact llms.txt File Format
The format is intentionally minimal. Here is the complete structure with explanations:
# Your Company Name > [Blockquote] One concise paragraph describing your product: what it does, > who it serves, and what makes it different. Write this for an AI system > that has never heard of you. Be specific about your product category, > target customer, and key differentiators. ## Core Product - [Feature or Page Name](https://yourdomain.com/page/): One-line annotation explaining what this page covers and why it matters. - [Pricing](https://yourdomain.com/pricing/): Plans and pricing details. ## Documentation - [Getting Started](https://yourdomain.com/docs/start/): Step-by-step onboarding. - [API Reference](https://yourdomain.com/docs/api/): Full API documentation. ## Use Cases - [For SaaS Teams](https://yourdomain.com/use-cases/saas/): How SaaS companies use [Product]. - [For Agencies](https://yourdomain.com/use-cases/agencies/): Agency workflows and examples. ## Optional: llms-full.txt - [Full Content](https://yourdomain.com/llms-full.txt): Extended content for deep indexing.
Mandatory Elements
| Element | Format | Purpose |
|---|---|---|
| H1 heading | # Company Name |
Identifies the site owner |
| Blockquote description | > Description... |
Core context for LLMs |
| Section headers (H2) | ## Section |
Organizes content types |
| Annotated links | [Name](url): notes |
Tells AI what each page contains |
Optional but Recommended
/llms-full.txt— a more verbose version with full page summaries- Per-page
.mdversions — appending.mdto any URL serves a clean Markdown version of that page - Reference to structured data — mention that your site uses Schema.org markup
Step-by-Step Implementation Guide
Step 1: Write Your Description Blockquote
This is the most important part. It should answer three questions:
- What does your product do (not what it is)?
- Who is your primary customer?
- What is your key differentiator vs. alternatives?
Weak example:
We build software for businesses.
Strong example:
LLMsRadar is an AI readiness audit platform for SaaS companies, marketing teams, and SEO professionals who need their websites to appear in ChatGPT, Claude, and Gemini answers. Unlike traditional SEO tools, LLMsRadar specifically analyzes how language models interpret your site structure, content signals, and metadata, providing a scored AI Readiness report with actionable fixes.
Step 2: Map Your Most Important Pages
Don't list every page — list the pages an AI should know about to accurately recommend your product. Prioritize:
Priority Tier 1 (Always include): - Homepage - Product/Features page - Pricing page - Primary use case pages Priority Tier 2 (Include if they exist): - Documentation / Getting Started - API reference - Integration pages - Case studies Priority Tier 3 (Include selectively): - Top blog posts (evergreen, high-value) - Comparison pages - Glossary / Resources
Step 3: Write Meaningful Annotations
Each link should have a colon followed by a short annotation. This is what tells the AI why each page matters.
- [AI Readiness Score](https://llmsradar.com/features/score/): Explains how LLMsRadar calculates a 0-100 score for how well an LLM can interpret and index a given website.
Step 4: Publish the File
- Place at:
https://yourdomain.com/llms.txt - Content-Type:
text/plainortext/markdown - Encoding: UTF-8
- No authentication required (must be publicly accessible)
Step 5: Reference in robots.txt (Optional but Good Practice)
User-agent: * Allow: / # AI Content Guidance LLM-Content: /llms.txt
Real-World llms.txt Example
Here is a real example for an AI readiness SaaS tool:
# LLMsRadar > LLMsRadar is an AI readiness platform that scans websites and identifies > how well they can be understood and indexed by large language models such > as ChatGPT, Claude, and Gemini. It generates an AI Readiness Score, > provides structured recommendations for improving LLM visibility, and > auto-generates llms.txt files. Built for SaaS companies, digital agencies, > and SEO teams who want their brand to appear in AI-generated answers. ## Product Features - [AI Readiness Score](https://llmsradar.com/features/score/): A 0-100 score measuring how well an LLM can parse, interpret, and recommend your website. - [Smart Recommendations](https://llmsradar.com/features/recommendations/): Prioritized list of fixes to improve AI indexability — which pages to rewrite, which signals to add, and what structure changes matter most. - [llms.txt Generator](https://llmsradar.com/features/llms-txt/): Automatically generates a compliant llms.txt file based on your site scan. - [Change Tracking](https://llmsradar.com/features/tracking/): Before/after comparison to see how edits affect your AI Readiness Score over time. ## Getting Started - [Quickstart Guide](https://llmsradar.com/docs/quickstart/): Connect your domain and run your first AI readiness scan in under 3 minutes. - [Pricing](https://llmsradar.com/pricing/): Plans for solo founders, teams, and agencies. ## Use Cases - [For SaaS Companies](https://llmsradar.com/use-cases/saas/): How to get your SaaS product recommended by ChatGPT and Claude. - [For SEO Teams](https://llmsradar.com/use-cases/seo/): How to extend traditional SEO workflows to cover LLM visibility. - [For Digital Agencies](https://llmsradar.com/use-cases/agencies/): How agencies audit and improve AI readiness for client websites.
Common Mistakes to Avoid
-
Using marketing-speak instead of descriptive language
LLMs don't respond to "revolutionary" or "best-in-class." Describe what your product literally does. -
Listing too many pages
Quality over quantity. An LLM scanning 200 links learns less than one reading 20 well-annotated links. -
Skipping annotations
A bare URL list tells an AI nothing about what those pages contain. Annotations are what make llms.txt genuinely useful. -
Putting llms.txt behind authentication
The file must be publicly accessible. If it requires a login, AI crawlers will never see it. -
Forgetting to update it
When you launch new features, rename pages, or change your positioning, update llms.txt. An outdated file misleads AI systems about your current product.
Does It Actually Work?
The honest answer: it depends on which AI and how it crawls.
AI System | Uses llms.txt | Confirmed Benefit -------------------|---------------|------------------- ChatGPT (browsing) | Partial | Helps structure understanding Perplexity | Yes | Actively uses for context Claude (web) | Yes | References for content scans Gemini | Developing | Growing support AI search crawlers | Yes | Primary use case
As of 2026, Perplexity and Claude show the strongest demonstrated use of llms.txt for content context. The broader principle — giving AI a structured entry point to your site — is sound regardless of crawler-specific behavior.
Next Steps
Once your llms.txt is live, your next priority is ensuring the content it links to is itself readable by LLMs: clean HTML, proper heading hierarchy, structured data markup, and strong topical authority. That's the full picture of AI readiness — and where tools like LLMsRadar can audit and score your entire site, not just the llms.txt file.