You can identify our web crawler by its user agent

JSX
User agent token: PerplexityBot
Full user agent: User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)

​
Customizing access

​
Disallow PerplexityBot

To prevent PerplexityBot from accessing your site data, add a record to your site’s robots.txt

JSX
User-Agent: PerplexityBot
Disallow: /

​
Custom access rules

You can also customize access, disallowing data retrieval only from specific paths.

JSX
User-Agent: PerplexityBot
Allow: /public/
Disallow: /private/
Pricing