llms.txt

1. Faster AI comprehension: AI systems can understand your site's purpose and structure from a single file rather than crawling dozens of pages.
2. Controlled narrative: You choose which pages and facts AI systems see first, shaping how they represent your brand.
3. Higher citation accuracy: AI systems that consult llms.txt can cite the correct, authoritative page for each topic.
4. Reduced misrepresentation: Key facts (pricing, features, locations) are stated explicitly, reducing AI hallucination about your business.
5. Early adopter advantage: As of early 2026, fewer than 5% of websites have an llms.txt file, making it a differentiator.

[One-sentence description of what the site/business does. Keep under 200 characters.]

• Page Title: Concise description of what this page covers and why it matters.
• Another Page: Description of content.

• Less Critical Page: Description.

undefined

- Must be the first line of the file.
- Should be the official business/site name.
- Use the H1 heading format (single `#`).

**2. Description (Required)**
```markdown
> Brief description of the site/business

• Must appear immediately after the title.
• Use Markdown blockquote format (

  >

  ).
• Keep under 200 characters.
• Should clearly state what the business does and who it serves.
• Avoid marketing fluff -- be factual and specific.

##

## Docs

## Optional

## API

## Blog

## Products

## Services

## About

## Resources

## Legal

## Contact

- [Page Title](URL): Description of page content

• Title: Use the actual page title or a clear descriptive title.
• URL: Must be a full, absolute URL (not relative paths).
• Description: 10-30 words describing what the page covers. Be specific about the information available.
• Order: List pages in order of importance within each section.
• Limit: Include 10-30 page entries total. Prioritize your most authoritative and useful pages.

undefined

• Founded in [year] by [founder(s)]
• Headquarters: [City, Country]
• customers/users in [Y] countries
• Key products: [Product A], [Product B], [Product C]
• Industry: [Industry classification]

This section provides quick reference data that AI systems frequently need to answer user queries about your business.

**6. Contact Section (Recommended)**

```markdown

• Website: https://example.com
• Email: hello@example.com
• Support: support@example.com
• Phone: +1-555-123-4567
• Address: 123 Main St, City, State, ZIP, Country

---

1. Use WebFetch to retrieve

   [domain]/llms.txt

   .
2. Also check for

   [domain]/llms-full.txt

   .
3. Record HTTP status code:
   • 200: File exists -- proceed to validation.
   • 404: File does not exist -- recommend generation.
   • 403: File exists but is blocked -- flag as misconfiguration.
   • 301/302: Redirect -- follow and note the redirect.

• Does it cover all major site sections visible in the navigation?
• Are the most important/highest-traffic pages included?
• Is the Key Facts section present with accurate business data?
• Does it include recent/updated content?

• Do descriptions accurately reflect page content?
• Are URLs valid and pointing to the correct pages?
• Are Key Facts verifiable and current?
• Is the business description accurate?

• Would an AI system understand the site's purpose from this file alone?
• Are descriptions specific enough to differentiate pages?
• Are the most citation-worthy pages highlighted?
• Is the organization logical and intuitive?

1. Crawl the site's main navigation and sitemap.
2. Identify important pages NOT listed in llms.txt.
3. Check if any listed URLs are broken or redirected.
4. Verify that the business description matches current homepage messaging.
5. Flag stale entries (pages that have been significantly updated since the llms.txt was written).

1. Fetch the homepage and extract:
   • Site name (from

     <title>

     ,

     <meta property="og:site_name">

     , or H1)
   • Business description (from meta description or hero section)
   • Main navigation links
   • Footer links
2. Fetch

   /sitemap.xml

   to discover all public pages.
3. Identify the site's primary business type (SaaS, E-commerce, Local, Publisher, Agency).

• Homepage
• About / Company page
• Pricing page (if exists)
• Primary product/service pages (top 3-5)
• Contact page
• Documentation landing page (if exists)

• Top blog posts (by apparent importance, recency, or comprehensiveness)
• Case studies or customer stories
• Key resource/guide pages
• FAQ page
• Careers page (for large companies)

• Thin category/tag pages
• Pagination pages
• Login/signup pages
• Legal boilerplate (unless specifically relevant)
• Duplicate or near-duplicate content
• Pages with minimal unique content

1. Fetch the page content using WebFetch.
2. Read the H1, meta description, and first 2-3 paragraphs.
3. Write a description that:
   • Is 10-30 words long
   • States what information is on the page
   • Mentions specific topics, data, or features covered
   • Avoids marketing language ("best," "leading," "revolutionary")
   • Uses factual, informative language

• Explains the three pricing tiers (Free, Pro, Enterprise) with feature comparison and annual/monthly costs.

• Details the company's founding in 2018, team of 45 employees, and office locations in Austin and London.

• Covers integration setup for Slack, Salesforce, and HubSpot with step-by-step guides and API endpoints.

• Our amazing pricing page!

  (marketing language, no specifics)

• Learn more about our company.

  (too vague)

• Click here for details.

  (not descriptive)

• Year founded
• Founder name(s)
• Headquarters location
• Number of employees (if public)
• Number of customers/users (if public)
• Key products or services (list top 3-5)
• Industry classification
• Notable clients or partnerships (if public)
• Key differentiators (what makes this business unique)
• Recent milestones or achievements (last 12 months)

[One clear sentence: what the business does, who it serves, and its primary value proposition. Under 200 characters.]

• Most Important Page: Description covering the key content on this page.
• Second Page: Description of this page's content and value.
• Third Page: What users and AI systems will find here.

• Product A: Core features, target users, and pricing model for Product A.
• Product B: What Product B does and how it differs from Product A.

• Guide Title: Comprehensive guide covering [topic] with [X] sections and practical examples.
• Blog Post: Analysis of [topic] with original data from [source].

• Founded in [year] by [name(s)]
• Headquartered in [City, Country]
• [Specific metric: e.g., "Serves 10,000+ businesses in 40 countries"]
• [Key differentiator: e.g., "Only platform offering real-time X and Y integration"]
• Industry: [Classification]

• Website: https://example.com
• Email: [primary contact email]
• Support: [support URL or email]

undefined

1. Verify all URLs are reachable (200 status).
2. Confirm total entry count is between 10-30.
3. Check that no description exceeds 50 words.
4. Verify the overall file length is 50-150 lines.
5. Ensure Markdown formatting is clean and consistent.

1. Page Title -- [Why it should be included]
2. Page Title -- [Why it should be included]

1. [Specific recommendation]
2. [Specific recommendation]
3. [Specific recommendation]

llms.txt

GEO-LLMSTXT-GENERATION.md

• How many pages were discovered and how many were selected
• The prioritization rationale
• Any pages that were borderline (might add later)
• Recommended update frequency (e.g., monthly for active blogs, quarterly for stable sites)

1. Update regularly. If your site publishes weekly blog posts, update llms.txt monthly. If your product changes quarterly, update after each release.
2. Lead with your strongest content. The first entries in each section should be your most authoritative, comprehensive pages.
3. Be specific in descriptions. "Comprehensive 3,000-word guide to React Server Components with code examples" is far more useful than "React guide."
4. Include your differentiators. If your site has unique data, original research, or exclusive features, highlight these in descriptions and Key Facts.
5. Keep it concise. The llms.txt should be scannable in under 60 seconds. Save detail for llms-full.txt.
6. Use absolute URLs. Always include the full

   https://

   URL, never relative paths.
7. Test after deployment. After uploading, verify the file is accessible at

   https://yourdomain.com/llms.txt

   with no redirects.
8. Coordinate with robots.txt. Ensure pages listed in llms.txt are not blocked in robots.txt for AI crawlers.
9. Mirror your site structure. Section names in llms.txt should roughly correspond to your main navigation categories.
10. Avoid sensitive pages. Do not include internal tools, admin panels, or pages with sensitive information.