As AI search becomes part of everyday research, a new file called llms.txt has become a popular talking point. Some SEO advice presents it as the next robots.txt: a small file that will supposedly help ChatGPT, Google AI Mode and other AI systems understand, cite and rank your website.
The reality is more measured.
An llms.txt file may be useful in a limited number of situations, but it is not a Google ranking factor, and it is not required to appear in Google AI Overviews or AI Mode. Googleโs current documentation is unusually clear: Google Search ignores llms.txt, so creating one will neither help nor harm your Google Search visibility.
For most businesses, strengthening the fundamentals of SEO services will create far more value than adding another file to the website’s root.
What is llms.txt?
llms.txt is a proposed plain-text file placed at the root of a website, usually at:
https://example.com/llms.txt
It is typically written in Markdown and designed to provide a short, structured overview of a site. It may include links to key pages, product documentation, policies, contact information and concise descriptions of what the business does.
The idea is understandable. Large language models can struggle with cluttered navigation, long pages and JavaScript-heavy websites. A clean index of important content could, in theory, help systems or tools that choose to support the format.
The key phrase is โchoose to supportโ. It is a proposed convention, not a universally adopted web standard.
Does llms.txt help Google SEO?
Noโnot at present.
Google says there are no special files, AI text files or new markup formats required to appear in Google Searchโs generative AI features. It specifically states that Google Search does not use llms.txt and that the file has no positive or negative effect on rankings or visibility.
That means adding an llms.txt file will not:
- Improve organic rankings
- Make a page more likely to appear in AI Overviews
- Guarantee a citation in AI Mode
- Replace structured data
- Fix weak content or technical SEO problems
- Make Google crawl your website more effectively
Googleโs AI search systems still rely on its index and core ranking systems. For a page to be eligible as a supporting link in AI Mode or AI Overviews, it needs to be indexed and eligible to appear in normal Search with a snippet.
This is good news for site owners. You do not need to rebuild your website around an unproven file format. The fundamentals you already knowโuseful content, accessible pages, strong internal links, good user experience and accurate informationโremain the priority.
llms.txt is not robots.txt
The confusion partly comes from the name. llms.txt sounds similar to robots.txt, but the files serve very different purposes.
robots.txt gives crawlers instructions about which URLs they may access. It is an established web standard for managing crawler traffic. Even then, it does not guarantee that a page will stay out of search results; a blocked URL can still appear if Google discovers it through links.
An llms.txt file does not control crawling, indexing or ranking. It is a voluntary information file. It cannot force an AI tool to read your content, cite your website or follow the links inside it.
If your goal is to control whether a specific crawler can access your site, look at your robots.txt rules and your server or CDN settingsโnot llms.txt.
What actually matters for AI search visibility
The temptation to search for one technical solution is understandable. AI search feels new, so website owners expect a new checklist. But Googleโs guidance points back to the same work that produces better organic results.
Publish information worth using
Thin rewrites and generic summaries give AI systems little reason to rely on your website. Add first-hand expertise, specific examples, original research, useful comparisons and clear explanations.
If your company sells a service, explain the process, outcomes, limitations and who it is right for. If you publish product information, keep specifications, availability and policies accurate.
Make important pages crawlable and indexable
Check that the pages you want discovered are not blocked from crawling, marked noindex by mistake or hidden behind unnecessary JavaScript barriers. Your XML sitemap and internal links should help search engines discover the pages that matter.
Create a clear site structure
A well-organised website helps users and crawlers understand where a page fits. Keep related content connected: a general guide can link to specialist articles, while those articles link back to a clear cornerstone resource.
A thoughtful internal linking strategy is far more likely to improve discoverability than adding an AI-only text file.
Keep business information consistent
For ecommerce and local businesses, accurate prices, stock, shipping, returns, locations and contact details are more useful than speculative AI optimisation. Use recognised structured data where it genuinely applies, but remember that schema is also not a guarantee of rich results or AI citations.
What about ChatGPT and other AI tools?
Different AI services have different crawlers and policies. For ChatGPT search, OpenAI says websites should allow OAI-SearchBot to be eligible to appear in ChatGPT search results. That setting is managed through robots.txt and by ensuring your hosting provider or CDN does not block the crawler.
Allowing a crawler does not guarantee that your website will be shown. Search systems still assess relevance, reliability and the userโs query. But it is a meaningful technical check if ChatGPT visibility is part of your strategy.
You can also track eligible ChatGPT search referrals in analytics through the utm_source=chatgpt.com parameter. This is much more useful than assuming that an llms.txt file has produced visibility.
When might it be worth creating one?
There is little downside to maintaining a simple, accurate llms.txt file if:
- You operate a large documentation site
- Your developers are already testing AI-supporting tools that use it
- You have the resources to keep it updated
- You want to make a clean summary of key pages available for future-compatible services
Treat it as a supplementary publishing asset, not an SEO project. Do not spend hours creating a file while important landing pages remain thin, slow or poorly linked.
Avoid adding exaggerated claims, keyword lists or hundreds of URLs. If another system does read the file, a concise and accurate overview is more useful than a machine-generated dump of every page.
Put effort where it can produce results
llms.txt is an interesting development, but it should not distract from work that has been proven to help users and improve search performance.
Prioritise genuinely helpful content, technical health, clear navigation and credible mentions from relevant publications. If you want to increase the authority of your strongest pages while reaching new audiences, a targeted guest posting strategy can support that wider approach.
The best way to prepare for AI search is not to chase every new file format. It is to build a website that is clear, trustworthy, and useful enough to be discovered in any search experience.