Allow PerplexityBot crawler access via robots.txt.
- Allow PerplexityBot crawler access via robots.txt2 cited sources1 category
Save for later 0
Use × to move an item here. You can restore it when you’re ready.
Your checks and saved items stay in this browser. Nothing is submitted.
Why this matters
Perplexity AI uses PerplexityBot to crawl and index content. Blocking this crawler in your robots.txt prevents your site from being cited in Perplexity's AI answers.
Hypothetical standard operating procedure
Adapt this example to your site, access, tools, and change process. It is our suggested procedure, informed by the sources below.
- Review current robots.txt file for user-agent rules.
- Add an explicit allow rule for 'User-agent: PerplexityBot' for all or relevant pages.
- Disallow only non-public or irrelevant paths (e.g., /admin/ or /private/).
- Test the updated robots.txt using a robots.txt testing tool to ensure PerplexityBot access.
- Monitor your analytics for increased traffic referrals from Perplexity.ai over the following weeks.
Watch for
Blocking PerplexityBot results in zero citations and loss of AI-driven referral traffic from Perplexity.ai.
Definition of done
PerplexityBot is explicitly allowed in robots.txt, verified with a robots.txt testing tool, and your content starts appearing as numbered source citations in Perplexity AI answers.
Sources & attribution
Original checklist wording and example SOP by Best SEO Checklist, using source-grounded AI assistance. Editorial contact: Ted Kubaitis, @tedkubaitis on Teams. Check current source guidance before implementation.