What Is llms.txt? What Our Server Logs Show | Loop2Tech Skip to main content

New on the blog: Google Maps Ranking Factors in 2026: What Moves a Business Into the Top 3 Read it

What Is llms.txt, and Does It Actually Help?

A plain-text llms.txt file describing a website for AI engines

Quick answer: llms.txt is a Markdown file at the root of a website (yoursite.com/llms.txt) that summarises the site and links its most useful pages for AI tools. It was proposed in September 2024 and isn't an official standard. Google says you don't need it for AI Overviews, two large studies found no sign that it earns AI citations, and in 60 days of our own server logs not one AI crawler requested ours. It's worth having on documentation sites that developers point AI tools at. For most business websites it's optional housekeeping, not a visibility tactic.

What is llms.txt?

llms.txt is a plain-text file written in Markdown, published at /llms.txt on your domain, that gives an AI tool a short, clean summary of your site and a list of the pages worth reading. The idea is that a model working inside a small context window can read one tidy file instead of digging through menus, scripts and cookie banners.

The format was proposed by Jeremy Howard of Answer.AI on 3 September 2024 and is documented at llmstxt.org. Only one part is required, an H1 with the site's name. The rest is a convention:

  • A one-paragraph summary in a blockquote, directly under the title.
  • Optional plain paragraphs explaining what the site is and how to read the links.
  • Sections with an H2 heading, each holding a list of links in the form [Page name](url): what it covers.
  • An H2 section called Optional for links a tool can skip when it's short on space.

The proposal also suggests serving a clean Markdown copy of important pages at the same URL with .md added. Some documentation platforms go further and publish llms-full.txt, the full text of every page in one file. That's a common habit, not part of the proposal.

What does an llms.txt file look like?

Here's a short example for a service business. The live file for this site, generated from our content, is at loop2tech.com/llms.txt.

# Example Dental Clinic

> A family dental clinic offering check-ups, cleaning, fillings, braces and emergency appointments, open six days a week.

Appointments can be booked online or by phone. Prices for common treatments are listed on the pricing page.

## Services
- [Check-ups and cleaning](https://example.com/services/check-ups): what a visit includes and how long it takes
- [Braces and aligners](https://example.com/services/braces): options, treatment time and cost ranges
- [Emergency dentist](https://example.com/emergency): same-day appointments and what counts as an emergency

## About
- [Our dentists](https://example.com/team): qualifications and experience
- [Pricing](https://example.com/pricing): current prices for common treatments

## Optional
- [Blog](https://example.com/blog): dental care guides

It's spelled llms.txt, with an s. A file named llm.txt won't be found by tools that look for the standard name.

Does Google use llms.txt?

No. Google's own guidance on AI features says: "You don't need to create new machine readable files, AI text files, or markup to appear in these features." The same page, Google's guide to AI features and your website, says there are no additional requirements to appear in AI Overviews or AI Mode, and no special schema to add.

That matters because Google AI Overviews are, for most businesses, the AI answer their customers see most often. What gets you into them is ordinary SEO: pages Google can crawl, index and trust, with answers it can lift. Read our guide to optimising for AI Overviews.

Do ChatGPT, Claude and Perplexity read llms.txt?

Rarely, according to every large dataset published so far. Two studies are worth knowing:

  • Ahrefs checked 137,210 websites in May 2026. About 28% had an llms.txt, and 97% of those files received no requests at all that month. Of the requests that did arrive, AI search crawlers from OpenAI, Perplexity and Anthropic made 1.1%. SEO audit tools made far more.
  • SE Ranking analysed about 300,000 domains and found that 10% had the file. Neither its statistical analysis nor its machine learning model found any effect of llms.txt on how often a domain is cited by AI. Removing the variable made their model slightly more accurate.

Both companies sell SEO tools, so read them as industry data rather than independent research. They do point the same way, and so does our own site.

What our own server logs show

Loop2Tech has published an llms.txt since August 2026, rebuilt automatically every time we publish. We went through 60 days of our server logs (all of August, six days of September and 1 to 23 October 2026) and counted every request from the main AI crawlers. Our site isn't served through a CDN cache, so every request reaches our server and shows up in these logs.

CrawlerRun byRequests to our siteRequests to /llms.txt
ClaudeBotAnthropic1,6830
ChatGPT-UserOpenAI8570
OAI-SearchBotOpenAI7100
GPTBotOpenAI5670
PerplexityBotPerplexity4010
Total4,2180

The AI crawlers were busy. They read our robots.txt more than 600 times and made over 500 requests for blog posts. Not one of them asked for llms.txt. The requests it did get came from SEO audit tools, a handful of small crawlers, and our own team testing it.

This is one small site over two months, so treat it as a data point, not proof. It's consistent with the studies above: AI crawlers read your pages, not a summary of them.

Should your website have an llms.txt?

It depends on who uses your site.

  • Add one if you run documentation, an API or a developer tool. Developers paste llms.txt links into coding assistants and AI tools so the model reads the right pages. Here the file is used on purpose by a person, not discovered by a crawler, and that's where it earns its place.
  • It's optional for a business website, an online store or a local service. It won't hurt, and once it's generated automatically it costs nothing to keep. It won't get you recommended by ChatGPT or into AI Overviews either. For a store, product schema, a clean Merchant Center feed and indexable collection pages matter far more.

We keep ours because it's automated and accurate, and because it's a handy summary for anyone who wants one. We don't sell it as a visibility lever, and you should be wary of anyone who does.

How to add llms.txt properly

If you decide to publish one, three things separate a useful file from a stale one.

  1. Generate it from your content. A hand-written file drifts out of date the first time you add a service or retire a page. Ours is built from the same database as the site, so it lists exactly what is published.
  2. Make sure your server actually serves it. On some shared hosting, any request ending in .txt is answered directly by the web server and never reaches your website's code. A file your CMS generates on the fly can then return an error instead of your summary. We write ours to disk on every deploy and every content change so the web server always has a real file to send.
  3. Test it. Open yoursite.com/llms.txt in a browser and check that it loads as plain text, starts with your business name and has working links. Then check your server logs after a month to see who, if anyone, requests it.

What gets you cited by AI instead

The work that moves AI visibility is the same work that makes a page worth quoting:

  • Pages that open with a direct answer AI can lift without editing. See answer-first content.
  • A business that's easy to verify: the same name, description and contact details everywhere, and mentions on other trusted sites. See entity SEO.
  • Crawler access. Check that robots.txt doesn't block OAI-SearchBot, PerplexityBot or the other AI crawlers you want to be visible to.
  • Measurement. Ask the AI tools your buyers' questions regularly and track how often you appear. See how to measure GEO.

Not sure where your site stands? Run the free website audit, or read how all of this fits together in our guide to generative engine optimization.

Frequently asked questions

Is it llm.txt or llms.txt?

llms.txt, with an s. That's the name in the original proposal and the one tools look for. A file called llm.txt won't be picked up.

Who invented llms.txt?

Jeremy Howard, co-founder of Answer.AI, proposed it on 3 September 2024. The specification is published at llmstxt.org. It's a community proposal, not a standard from Google, OpenAI or any standards body.

Does llms.txt help SEO?

No. Google doesn't use it for rankings or for AI Overviews, and its guidance says no special AI text files are needed. It has no effect on your position in search results.

Is llms.txt actually used by AI tools?

Very little. Ahrefs found that 97% of llms.txt files received no requests in a month, and in 60 days of our own logs no AI crawler requested ours. It's used when a person deliberately gives the file to an AI tool, which is common with developer documentation.

Should an online store have an llms.txt?

It's optional. It won't hurt, but it won't bring shoppers either. Product structured data, an accurate Merchant Center feed and well-written collection pages do far more for a store's visibility in Google and in AI answers.

How do I test my llms.txt?

Visit yoursite.com/llms.txt and check it loads as plain text, begins with an H1 line such as # Your Business, and every link works. Then look at your server's access logs after a few weeks to see which tools request it.