Best SEO Checklist
ONE FOCUSED ACTION

Verify XML sitemap is referenced in robots.txt and contains only canonical, indexable URLs.

Crawlability optimization

1 checklist items

Save for later 0

Use × to move an item here. You can restore it when you’re ready.

    Your checks and saved items stay in this browser. Nothing is submitted.

    Why this matters

    Ensuring the XML sitemap is properly referenced in robots.txt and contains only canonical, indexable URLs helps search engines efficiently crawl and index a site without wasting crawl budget on redirects or non-indexable pages.

    A STARTING-POINT EXAMPLE

    Hypothetical standard operating procedure

    Adapt this example to your site, access, tools, and change process. It is our suggested procedure, informed by the sources below.

    1. Fetch and review robots.txt to confirm it has a Sitemap: directive pointing to the XML sitemap URL.
    2. Access the XML sitemap and verify each listed URL returns a 200 HTTP status and is canonical for the content.
    3. Check that no URLs in the sitemap are redirects or contain noindex meta tags or header directives.
    4. Remove or update any entries in the sitemap that are non-canonical, redirecting, or noindex to reflect only crawlable URLs.
    5. Regularly schedule a check to ensure sitemap references remain accurate and keep the sitemap clean of low-value URLs.

    Watch for

    Including redirected, noindexed, or non-canonical URLs in the sitemap can signal poor site maintenance and waste crawl resources, hurting SEO performance.

    Definition of done

    Robots.txt includes a sitemap directive pointing to an XML sitemap that lists only indexable, 200-status, canonical URLs without redirects or noindex tags.

    Sources & attribution

    1. Technical SEO Checklist: 30 Checks That Actually Matter ↗
    2. SEO Technical Checklist: What It Is and How It Works ↗

    Original checklist wording and example SOP by Best SEO Checklist, using source-grounded AI assistance. Editorial contact: Ted Kubaitis, @tedkubaitis on Teams. Check current source guidance before implementation.