Allow PerplexityBot in robots.txt to enable content crawling.
- Allow PerplexityBot in robots.txt to enable content crawling2 cited sources
Save for later 0
Use × to move an item here. You can restore it when you’re ready.
Your checks and saved items stay in this browser. Nothing is submitted.
Why this matters
Perplexity AI’s crawler, PerplexityBot, must be explicitly allowed to index your pages; blocking it prevents any content from appearing in Perplexity answers.
Hypothetical standard operating procedure
Adapt this example to your site, access, tools, and change process. It is our suggested procedure, informed by the sources below.
- Audit current robots.txt for any blockrules against PerplexityBot user agent.
- Add explicit Allow rule for 'User-agent: PerplexityBot' with 'Allow: /' to robots.txt.
- Ensure no firewall or CDN rules block PerplexityBot user agent.
- Use a robots.txt validator to confirm PerplexityBot is permitted.
- Monitor crawling activity or initial Perplexity citations within 1-2 weeks after changes.
Watch for
Blocking PerplexityBot or using restrictive wildcard rules can completely block your site from Perplexity citations.
Definition of done
PerplexityBot can crawl the site without being blocked, verified by robots.txt testing tools.
Sources & attribution
Original checklist wording and example SOP by Best SEO Checklist, using source-grounded AI assistance. Editorial contact: Ted Kubaitis, @tedkubaitis on Teams. Check current source guidance before implementation.