Audit and publish llms.txt listing for key domain migration pages.
- Audit and publish llms.txt listing for key domain migration pages2 cited sources1 category
Save for later 0
Use × to move an item here. You can restore it when you’re ready.
Your checks and saved items stay in this browser. Nothing is submitted.
Why this matters
Allowing AI crawlers explicit, curated access via llms.txt during domain migration supports accurate citation and minimizes loss of AI visibility when site URLs change.
Hypothetical standard operating procedure
Adapt this example to your site, access, tools, and change process. It is our suggested procedure, informed by the sources below.
- Review current robots.txt to confirm AI crawlers are not blocked.
- Create or update llms.txt with clear descriptions of your organization, products, services, and link key authoritative pages.
- Publish llms.txt at the root domain immediately before or upon migration launch.
- Test AI crawler access using logs and audit tools to confirm llms.txt and robots.txt accessibility.
- Monitor AI citation presence over subsequent weeks to confirm stable mention and visibility trends.
Watch for
Do not rely solely on llms.txt; maintain crawlable HTML, structured data, and redirects as llms.txt is only supplementary and not universally supported by all AI engines.
Definition of done
Published llms.txt file at site root accurately lists current canonical URLs and authoritative entity info; verified AI crawlers like OAI-SearchBot and GPTBot can access key pages post-migration.
Sources & attribution
Original checklist wording and example SOP by Best SEO Checklist, using source-grounded AI assistance. Editorial contact: Ted Kubaitis, @tedkubaitis on Teams. Check current source guidance before implementation.