- Reading robots.txt, sitemaps and the home page
- Reading page titles and descriptions
- Grouping pages and writing the file
Customize your file
Changes appear in the file as you type.
Site details
Notes for AI tools: what the site offers, who it is for, how to read the links. Paragraphs and lists are fine; headings are not allowed here.
Sections and links
Untick a page to leave it out. Edit names and descriptions, move pages to another section, or change their order.
Other discovered URLs Found on the site but not in the file
llms.txt
You edited the file by hand. Changes in the builder are not applied until you rebuild it, which replaces your edits.
| # | Keyword | Count | Density |
|---|