Best SEO Checklist
ONE FOCUSED ACTION

Verify XML Sitemap References in Robots.txt.

Crawlability optimization

1 checklist items

Save for later 0

Use × to move an item here. You can restore it when you’re ready.

    Your checks and saved items stay in this browser. Nothing is submitted.

    Why this matters

    Ensuring that the XML sitemap is correctly referenced in robots.txt helps search engines discover and crawl canonical, indexable URLs efficiently, improving crawl budget use.

    A STARTING-POINT EXAMPLE

    Hypothetical standard operating procedure

    Adapt this example to your site, access, tools, and change process. It is our suggested procedure, informed by the sources below.

    1. Fetch the robots.txt file from the root of the website.
    2. Check for the presence of a Sitemap directive with the correct URL to the XML sitemap.
    3. Verify the XML sitemap lists only URLs that return 200 HTTP status and are canonical.
    4. Confirm no non-indexable, redirected, or duplicate URLs appear in the sitemap.
    5. Use Google Search Console and crawl tools to corroborate sitemap accessibility and correctness.

    Watch for

    Missing or incorrect sitemap references in robots.txt can cause search engines to miss important pages or crawl excessive duplicates, harming SEO performance.

    Definition of done

    The robots.txt file includes a valid Sitemap directive pointing to the current XML sitemap location, which lists only canonical, indexable pages.

    Sources & attribution

    1. The Technical SEO Checklist: 30 Checks That Actually Matter ↗
    2. SEO Technical Checklist: What It Is and How It Works ↗

    Original checklist wording and example SOP by Best SEO Checklist, using source-grounded AI assistance. Editorial contact: Ted Kubaitis, @tedkubaitis on Teams. Check current source guidance before implementation.