Skip to main content
Optimization llms.txt

llms.txt: The New robots.txt for LLMs

Updated Recently updated
#llms-txt#ai#crawlers#guide
Share
This article includes a quiz, test your knowledge at the end! Jump to quiz

What is llms.txt?

Comparison of robots.txt vs llms.txt: robots.txt indicates what NOT to explore (Disallow), llms.txt indicates what to understand FIRST (key pages, collections, policies)
Figure 1 - robots.txt vs llms.txt: two complementary files for AI

The llms.txt file is an emerging convention that lets website owners guide LLMs toward their most important content. Placed at the site root (https://your-store.com/llms.txt), it provides a structured summary of your business and a list of priority links.

It complements robots.txt: where robots.txt says “what not to crawl,” llms.txt says “what to understand first.”

Who’s adopting llms.txt?

Industry adoption accelerated significantly in 2025-2026. Major organizations now publishing llms.txt include Anthropic (Claude documentation), Cloudflare, and Stripe (source: llmstxt.org, 2026). GitBook automatically generates an llms.txt for every docs site it publishes. Perplexity consults llms.txt when available to prioritize content to explore.

The specification now defines three variants merchants can use:

  • /llms.txt - links and descriptions of key pages (the standard)
  • /llms-medium.txt - a single markdown page with core content
  • /llms-full.txt - complete content dump with all guides, policies, and product info

For Shopify merchants, the standard /llms.txt with links is sufficient and most impactful.

Why content freshness in llms.txt matters

Research shows 50% of content cited in AI search responses is less than 13 weeks old (source: Amsive, 2026). This means keeping your llms.txt updated with your latest collections, new products, and current policies directly impacts how often AI engines cite your store.

Why it matters for AI

When an LLM visits your store to answer a query (“what’s the best anti-aging serum?”), it needs to quickly understand:

  • Who you are
  • What you sell
  • Why your products are reliable

Without llms.txt, the LLM must explore your site page by page, risking missing your key content or misjudging the hierarchy.

With llms.txt, you control the narrative: you decide which pages the LLM should consult first.

Key questions to ask yourself

To know if your llms.txt is effective, check:

  • Does it exist? An llms.txt file at the root of your site
  • Is it well-structured? Title, description, links organized by section
  • Do the links work? Each URL points to an existing page
  • Does it cover the essentials? Your collections, policies, and key pages are represented

Verity Score automatically checks the presence and quality of your llms.txt.

# Your Store Name

> Short description (1-2 sentences) of what you do.

## Products
- [Category 1](https://your-store.com/collections/category-1)
- [Best-sellers](https://your-store.com/collections/best-sellers)

## About
- [Our story](https://your-store.com/pages/about)

## Policies
- [Shipping](https://your-store.com/policies/shipping-policy)
- [Returns](https://your-store.com/policies/refund-policy)

Best Practices

  1. Be concise : The LLM doesn’t need your entire catalog. Guide it to key pages.
  2. Prioritize : Put the most important collections first.
  3. Include policies : AI shopping agents systematically check shipping and returns.
  4. Keep updated : If you add a new collection or important content, update llms.txt.

How to Add on Shopify

Option 1: Via a Shopify page (recommended)

  1. Create a “llms” page in Admin > Pages
  2. The URL will be https://your-store.com/pages/llms
  3. Paste your llms.txt content in plain text format in the editor
  4. Add a link in the <head> of your theme (file theme.liquid):
<link rel="alternate" type="text/plain" href="/pages/llms" title="llms.txt">

Note: Shopify doesn’t natively allow serving an arbitrary .txt file at the domain root. The /pages/llms URL is the simplest method and requires no technical configuration.

Option 2: Via a CDN or proxy (exact /llms.txt URL)

If you use a CDN or proxy in front of Shopify (Cloudflare, Vercel, Netlify), you can configure a rewrite rule to serve an llms.txt file directly at the domain root. This is the ideal method if you want the exact /llms.txt URL conforming to the specification.

Examples for Different Sectors

Cosmetics / Beauty

# Belle Peau | Organic Skincare

> Organic face care, made in France. Cosmos Organic certified formulas.

## Featured Products
- [Anti-aging serum](https://bellepeau.com/products/anti-aging-serum)
- [Moisturizer](https://bellepeau.com/products/moisturizer)
- [All face care](https://bellepeau.com/collections/face-care)

## Certifications
- [Our labels](https://bellepeau.com/pages/certifications)

Fashion

# Urban Style | Sustainable Streetwear

> Eco-friendly streetwear, manufactured in Europe.

## Collections
- [New arrivals](https://urbanstyle.com/collections/new)
- [Best-sellers](https://urbanstyle.com/collections/best-sellers)
- [Collaborations](https://urbanstyle.com/collections/collabs)

## Sustainability
- [Our approach](https://urbanstyle.com/pages/sustainability)

Resources

Check if your store has an llms.txt: free audit.

Frequently Asked Questions

What is an llms.txt file and what does it do?
llms.txt is an emerging standard that helps LLMs understand your website. Placed at your site root, it provides a structured summary of your business and links to your most important pages, like a robots.txt but for guiding AI instead of blocking crawlers.
How do I add llms.txt to my Shopify store?
Shopify doesn't support serving .txt files at the domain root natively. The simplest method is creating a 'llms' page in Admin → Pages and linking it in your theme's head tag. If you use Cloudflare or a CDN, you can set up a rewrite rule for the exact /llms.txt URL.
What should I include in my llms.txt file?
Include your store name, a short description, links to your main collections, best-sellers, policy pages (shipping, returns), and any key content pages (about, certifications, FAQ). Keep it concise. Guide the AI to your top 10-20 most important pages.
Is llms.txt required for AI visibility?
Not required, but strongly recommended. Without llms.txt, AI must discover your content by crawling page by page, risking missing important pages. With llms.txt, you control which content AI prioritizes, improving the accuracy of recommendations.
What is the difference between robots.txt and llms.txt?
robots.txt tells crawlers what NOT to access (blocking rules). llms.txt tells LLMs what to READ FIRST (priority guidance). They're complementary. robots.txt controls access permissions while llms.txt controls content discovery and prioritization.
🧠 Test your knowledge
1 / 5

Related guides

Optimization

Conversational Content: Writing for Humans AND AI

How to structure your Shopify product page content so it's both engaging for humans and actionable for AI agents.

Critical

What is Agentic Commerce? Complete Guide 2026

Autonomous AI agents search, compare, and buy for consumers. Understand ACP, UCP, and how to prepare your Shopify store.

Critical

robots.txt and AI Crawlers: Don't Block Your Sales

How robots.txt affects your Shopify store's visibility to AI agents. Practical guide to opening access for GPTBot, OAI-SearchBot, PerplexityBot, and ClaudeBot.