Skip to main content

You Don't Need an llms.txt File. Here's What You Do Need.

D

DL Minds Growth Desk

8 min read
Share:
Agency owner at a small Jaipur office desk reviewing a client deliverables list while answering the llms.txt do you need it question

Priya runs a four-person digital agency in Jaipur. In April she sold a logistics client a "future-proofing" package whose headline item was a text file. The client, a freight firm called Marudhar, paid ₹45,000. The file took eleven minutes to write. When the client's founder asked her in July about llms.txt do you need it or was this a fashion, she did not have a good answer. She does now, and it cost her a refund.

⚡ Quick Summary
  • Google's May 2026 AI optimization guide states llms.txt is not required for its AI features in Search.
  • No major search engine has published a ranking benefit for the file.
  • It is cheap to add and harmless. It is not a service worth thousands of rupees.
  • The things that do affect whether you get cited are unglamorous and already on your SEO list.
  • Short version of llms.txt do you need it: no, and here is where that budget should go.

What llms.txt Even Is

It is a proposed convention: a markdown file at your domain root that lists your most important pages in a simplified form, so a language model can read your site without wading through navigation and scripts. Think of it as a sitemap written for a reader rather than a crawler. The idea is reasonable. It is a community proposal, not a standard adopted by a search engine.

That distinction is the whole article. Anyone answering llms.txt do you need it with a five-figure quote is charging you for a convention, not for work. A proposal you can adopt in an afternoon is not a competitive advantage anyone can sell you.

llms.txt Do You Need It? What the Evidence Says

Google's AI optimization guide, published in May 2026 at developers.google.com/search/docs/fundamentals/ai-optimization-guide, addresses this directly. Its position is that AI features in Search draw on the same index and the same signals as ordinary Search, and that llms.txt, AI-specific content rewriting and special AI schema are not required.

📌
The bar for a paid deliverable A vendor should be able to point to either a primary source or their own controlled test. On llms.txt do you need it, the only primary source available says no. That does not settle every AI assistant in existence, but it settles the largest one.

What about other assistants? Honest answer: nobody has published a clean, reproducible result showing the file changes citation rates. Absence of evidence is not evidence of absence. It is, however, a very good reason not to bill for it as a ranking service.

Why It Keeps Getting Sold

Because it demos beautifully, and because llms.txt do you need it is a question with a satisfying yes-shaped answer available for sale. It is a file. You can show it to a client. It has a URL. Compare that with "we improved your server response time and rewrote nine pages", which is real work and photographs badly.

Sells easily
  • A new file at a visible URL
  • A schema markup "AI pack"
  • Rewriting pages into bullet lists
  • A monthly "AI visibility score" dashboard
  • Buzzwords with a deadline attached
Actually moves citations
  • Pages that answer one question completely
  • Facts in HTML text, not in images or PDFs
  • Server-rendered content a crawler can fetch
  • Accurate standard structured data
  • Independent mentions on sites you do not own

Five Things to Do Instead

1
Audit what is actually blocked
Read your robots.txt line by line. Staging rules that survived a launch are the single most common cause of invisible content we find.
2
Move buried facts into text
Pricing tables, service areas, turnaround times and specifications trapped inside images or PDFs cannot be quoted by anything.
3
Split omnibus pages
One page per real question. A single services page covering eleven offerings competes with itself and answers nobody precisely.
4
Fix render-blocking content
If key copy only appears after a tab click or a script finishes, assume it does not exist for anything reading your page automatically.
5
Get mentioned somewhere you do not control
Industry directories, association member lists, supplier pages, local press. Corroboration is the signal that is genuinely hard to manufacture.

What Marudhar Freight Did With the Refund

Priya put the ₹45,000 back and rebuilt the scope. Illustrative figures, but the shape is real.

Marudhar had a rate calculator that rendered entirely client-side, so its lane pricing existed nowhere in the HTML. They had one page titled "Services" carrying nine service lines. Their Google Business Profile listed a warehouse address that had moved in 2024. Three fixes, none of them exciting, all of them things a person searching for a Jaipur-to-Surat part-load quote would benefit from.

The founder still asks about llms.txt do you need it every couple of months, usually after a webinar. The answer has not changed. The file sits at their root now, added in ten minutes, unbilled, and nobody pretends it is doing anything.

💡
A question to ask any vendor "Which primary source says this is required?" If the reply is a blog post citing another blog post, you have found a trend, not a technique. That single question saves more money than any audit tool.

When Adding It Is Actually Reasonable

There is a real case for it, and it has nothing to do with rankings. Asked narrowly enough, llms.txt do you need it does get a yes.

If you publish developer documentation, an API reference, or a large knowledge base, a curated index of your canonical pages is useful to your own tooling, to partners, and to anyone building an internal assistant over your docs. Maintain it as documentation hygiene. Budget it at the cost of writing a file, which is what it is.

The trade-off worth naming: a stale llms.txt is worse than none. If it lists pages you retired in March, you have published a wrong map of your own site. Nobody who sells the file also sells the maintenance, which tells you how seriously the deliverable is meant.

  • Confirm nothing important is blocked in robots.txt
  • Get prices, specs and locations into crawlable HTML
  • One page, one question, answered fully
  • Standard schema that matches the visible page
  • Three independent mentions this quarter on sites you do not own

What to Tell the Person Who Read the Webinar Slide

The awkward part of this argument is rarely technical. It is that someone senior attended a session, wrote down a filename, and now expects to see it actioned. Telling them the whole idea is nonsense goes badly. Here is a version that works.

Start by agreeing. The instinct behind it is sound: make your important content easy for a machine to read. Then separate the instinct from the artefact. When a founder asks llms.txt do you need it, what they usually mean is "are we going to be invisible in AI answers", and that is a fair worry deserving a real reply rather than a lecture about specifications.

Second, put the file on the plan and price it honestly. Ten minutes, no retainer, no ongoing fee, reviewed whenever the site structure changes. Nothing is gained by refusing a cheap, harmless file. Everything is lost by billing for it as strategy.

Third, show what the same money buys elsewhere. A single blocked directory found and fixed. Four spec tables lifted out of PDFs. Two omnibus pages split into eight that each answer a real question. Those are demonstrable, and you can show a before and after. Whenever someone raises llms.txt do you need it in a planning meeting, that comparison ends the conversation faster than any argument about standards bodies.

⚠️
Watch for the rebrand When a deliverable stops selling, it gets renamed. If your next proposal contains an "AI content index", an "LLM sitemap" or an "answer manifest", check whether it is the same file with a new label. The question llms.txt do you need it applies just as well to whatever it is called next quarter.

One caveat worth conceding out loud, because pretending certainty here would be its own kind of sales pitch: the ecosystem is young, and a convention nobody requires today could be adopted tomorrow. That is exactly why the correct posture is a cheap file and an expensive focus on fundamentals. If the convention is adopted, you already have it. If it is not, you spent ten minutes. Asking llms.txt do you need it every six months is reasonable. Paying a retainer for the answer is not.

✅ Bottom Line
  • Google has published that llms.txt is not required for its AI features in Search.
  • No search engine has published a ranking benefit for it.
  • Add it if you have real documentation to index, and maintain it. Do not pay a retainer for it.
  • Put the money into crawlability, page structure and independent mentions.
  • On llms.txt do you need it, the useful reply is: not for ranking, and the file is not the problem with your site.
Get a Second Opinion on Your AI-SEO Invoice
Send us the deliverables list from your current agency. We will tell you which items have a primary source behind them and which ones you are paying for twice.
Get a Free Quote →
D

DL Minds Growth Desk

Digital marketing and web development expert at DL Minds. Passionate about helping businesses grow through innovative technology solutions and strategic digital marketing.

Enjoyed this article?

Subscribe to our newsletter to get more insights and tips delivered straight to your inbox.