Recently, we were asked by OpenAI, the company behind ChatGPT, to add a new file to our websites called llms.txt.
This file acts as a kind of sitemap specifically for AI systems. Unlike a regular sitemap that lists every page on the site, the llms.txt file highlights only the most recently created content. That includes your newest pages, posts, categories, and other fresh additions across the site.
What does an llms.txt file look like?
The file is essentially a simple list of URLs that represent your most recent content. Our agency website, for example, has an llms.txt file that includes the latest pages, posts, and important sections that we want AI systems to notice.
How do you create an llms.txt file easily?
-
Make sure your Yoast SEO plugin is updated to the latest version.
-
Go to Yoast SEO > Settings.
-
Scroll to the bottom and enable the llms.txt option.
Most users aren’t aware of this, but Yoast allows you to manually select the pages you believe are most important. Instead of relying on automatic selection, you can choose exactly which pages will appear in the llms.txt file.
To do this:
-
Open the llms.txt settings panel.
-
Switch from Automatic page selection to Manual page selection.
-
Choose the key pages you want included, such as About, Contact, Terms, Privacy Policy, your Store page, or any other essential content you want AI systems to prioritize.
After saving your selections, click View the llms.txt file to see the final version generated for your site.
And that’s it.
You now have a fresh llms.txt file that helps AI models understand which new pieces of content were recently published on your site. This increases your chances of becoming a trusted source when ChatGPT and similar AI tools provide information.
