We strive to improve our service every day. To provide the best search experience, we need to collect data. We use web crawlers to gather information from the internet and index it for our search engine.

You can identify our web crawler by its user agent

User agent token: PerplexityBot
Full user agent: User-Agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +

Customizing access

Disallow PerplexityBot

To prevent PerplexityBot from accessing your site data, add a record to your site's robots.txt

User-Agent: PerplexityBot
Disallow: /

Custom access rules

You can also customize access, disallowing data retrieval only from specific paths.

User-Agent: PerplexityBot
Allow: /public/
Disallow: /private/