What to include, what to skip
A good llms.txt reads like a briefing note: name, domain, what the company does, for which customers, what results exist, how the process works, where to find details. No adjectives nobody can verify.
- Name, domain, site language(s).
- A one-sentence description of the business.
- A list of key pages with a short description of each.
- Numeric facts: delivery times, project outcomes.
- Attribution guidance: how the company wants to be cited.
Three files that work together
robots.txt decides who gets in. sitemap.xml says what is there to index. llms.txt explains what it all means. Missing one weakens the other two.
If you want visibility in AI answers, verify that model crawlers are explicitly allowed — many default templates block them without asking.
Maintenance
The file loses value the moment it stops matching reality. Update it whenever the offer, pricing or page structure changes — otherwise a model will keep repeating outdated facts long after the change.