ONE FOCUSED ACTION

Allow PerplexityBot in robots.txt to enable crawler access.

Crawl-budget optimization · Crawlability optimization · Perplexity search optimization · Website migration SEO · XML sitemap optimization

1 checklist items

Save for later 0

Use × to move an item here. You can restore it when you’re ready.

    Your checks and saved items stay in this browser. Nothing is submitted.

    Why this matters

    Perplexity uses PerplexityBot to crawl pages; blocking it prevents your content from appearing in results.

    A STARTING-POINT EXAMPLE

    Hypothetical standard operating procedure

    Adapt this example to your site, access, tools, and change process. It is our suggested procedure, informed by the sources below.

    1. Edit robots.txt to add 'User-agent: PerplexityBot' and 'Allow: /' directives.
    2. Verify no server-level (firewall/CDN) blocking of PerplexityBot user agent.
    3. Use robots.txt testing tools to confirm PerplexityBot is not blocked.
    4. Periodically re-check to ensure access remains open.

    Watch for

    Blocking PerplexityBot results in zero citations from Perplexity search.

    Definition of done

    Robots.txt explicitly allows PerplexityBot and passes tests with no blocking rules.

    Sources & attribution

    1. Optimize for Perplexity - AEO.Page ↗
    2. How to Optimize for Perplexity Search: 7-Step Business Checklist ↗
    3. Website crawlability and discovery checklist for AI agents ↗
    4. Answer Engine Optimization in 2026: The Complete AEO Checklist ↗
    5. Crawl Budget Optimization: A Technical Guide for SEO ↗
    6. Site Migration SEO: The Complete Checklist for 2026 ↗
    7. XML Sitemap Best Practices: Limits, lastmod and Submission | Crawl Budget Snapshot ↗

    Original checklist wording and example SOP by Best SEO Checklist, using source-grounded AI assistance. Editorial contact: Ted Kubaitis, @tedkubaitis on Teams. Check current source guidance before implementation.