Best SEO Checklist
ONE FOCUSED ACTION

Check XML sitemap is referenced in robots.txt and homepage headers.

Crawlability optimization

1 checklist items

Save for later 0

Use × to move an item here. You can restore it when you’re ready.

    Your checks and saved items stay in this browser. Nothing is submitted.

    Why this matters

    Referencing sitemap in robots.txt and headers increases the chance crawlers discover full URL sets.

    A STARTING-POINT EXAMPLE

    Hypothetical standard operating procedure

    Adapt this example to your site, access, tools, and change process. It is our suggested procedure, informed by the sources below.

    1. Open robots.txt and verify Sitemap directive points to sitemap.xml location.
    2. Check HTTP Link headers on homepage include sitemap references.
    3. Ensure sitemap files are accessible without restrictions.
    4. Update sitemap references if location or filename changes.
    5. Test discovery using crawler simulation or webmaster tools.

    Watch for

    Unlinked sitemaps may be overlooked by AI crawlers leading to incomplete site indexing.

    Definition of done

    robots.txt and HTTP headers include correct sitemap.xml URLs, publicly accessible and valid.

    Sources & attribution

    1. Website crawlability and discovery checklist for AI agents ↗
    2. Technical SEO Checklist: 30 Checks That Actually Matter ↗

    Original checklist wording and example SOP by Best SEO Checklist, using source-grounded AI assistance. Editorial contact: Ted Kubaitis, @tedkubaitis on Teams. Check current source guidance before implementation.