Free llms.txt Generator
Generate an llms.txt file that helps AI search engines understand your website. Copy or download it, then publish it at your site's root.
Want us to handle everything?
Our managed SEO, AEO, and GEO services do the optimisation work for you. Get found where AI looks.
What is llms.txt?
llms.txt is a simple text file that introduces your website to AI crawlers: what the site is about, which pages matter, and how the content is organised. We scan your sitemap and use AI to categorise your pages, then hand you a finished file to download.
One honest caveat: it is an emerging standard, and engine adoption is still settling. We add it for our own clients because it takes minutes and costs nothing, not because it works miracles. The full story is in our llms.txt guide.
How the generator builds your llms.txt, and what to check before you publish it.
Enter your website address. The generator looks for your sitemap, including any sitemaps listed in your robots.txt file, and if it cannot find one it tries a set of common pages instead. Your homepage is always included. It reads up to fifty pages, taking each one's title, meta description and first few headings.
Those details go to Claude, which groups your pages into sections and writes a short description of each one in Australian English. You get two files. llms.txt is the concise version, which the AI is asked to keep to about thirty entries. llms-full.txt is asked to list every page the generator found, each with its description. Neither file contains the full text of your pages; both are maps that point an AI crawler to the pages worth reading.
Before you publish, read both files. The descriptions are written by an AI from your titles and headings, so check that each one says what the page is actually for. The links come from that same step and are not re-checked against your site, so click through a few of them. Take out anything you would rather not highlight, such as thin pages, old campaigns or pages behind a login, and move your most important services and guides to the top.
Then put the file at the root of your site, so it loads at your domain followed by /llms.txt, the same way robots.txt does. On WordPress that usually means uploading it through your hosting file manager or using a plugin that serves it; on other platforms your developer can add it as a static file. If you publish llms-full.txt as well, put it beside the first file.
Be realistic about what it does. llms.txt is a proposed convention rather than a standard every AI company follows, and no engine promises to read it. It is cheap to publish and gives any crawler that does read it a clean summary of your site. It does not replace the basics: the crawlers still need to be allowed in your robots.txt file, and your pages still need to answer questions clearly.
If your site is large, choose what matters. The generator reads up to fifty pages and the concise file aims for about thirty, so on a big site it may miss pages you care about or include ones you do not. Edit the file freely: it is plain text, and a short list of your best pages, chosen by someone who knows the business, says more than a long automatic one.
Keep it current. When you add a service or retire a page, run the generator again or edit the file by hand, so it never points crawlers at pages that are no longer there.
There is no email to give. You can generate five files a day, and each site's result is kept for a day, so running it twice in a row shows the same file. If the pages it found do not match what you expected, check your sitemap first: the generator can only list what your site tells it about.
Common questions.
What is llms.txt?
llms.txt is a plain-text file at the root of your website (yoursite.com/llms.txt) that tells AI model crawlers what your site is about and which pages matter most. Think of it as a guidebook for machines: robots.txt says where crawlers may go, llms.txt explains what they will find.
Do AI engines actually read llms.txt?
Honestly: adoption is still emerging. llms.txt is a young standard and the major engines have not all confirmed they use it. The case for adding one anyway is that it costs minutes, carries no risk, and positions you for crawlers that do read it, of which there are more each month.
Where do I upload the file?
At the root of your domain, so it is reachable at yoursite.com/llms.txt. On most hosting that means dropping it in the same folder as your robots.txt. Verify by visiting the URL in a browser: if you can read it, so can a crawler.
What is the difference between llms.txt and llms-full.txt?
llms.txt is the summary: what your site is about and which pages to prioritise. llms-full.txt is the longer version: every page we found, each with a short description. Start with llms.txt; add llms-full.txt when you want engines to see the wider map of your site.
File uploaded?See what else the crawlers want.
llms.txt is one check inside the free audit’s six categories. Run it to see your whole AI-readiness picture, crawler access included. Sixty seconds, no card.