AI agents · Search crawler

PerplexityBot

PerplexityBot is Perplexity's search crawler: it indexes pages so they can be found and cited later.

Operator
Perplexity
User agent
PerplexityBot
Verified by
Published IP ranges

What PerplexityBot does

A search crawler reads your pages ahead of time and adds them to its operator's index. That index is what its search and assistant draw on to find pages and point people to them.

How to recognize it

PerplexityBot names itself in its user agent with the token PerplexityBot. That's what Ethogram matches, as a whole word in any case.

A user agent is only a claim, though: anyone can send PerplexityBot. Scrapers borrow well-known names to get past rules meant for the real agent, so before you trust a visit, or block one, check where it came from.

How to tell it's really PerplexityBot

Perplexity publishes the IP ranges PerplexityBot uses, as JSON: www.perplexity.ai/perplexitybot.json. A request from inside those ranges is the real PerplexityBot. One from outside them is an impostor.

Ethogram runs these checks on every request and gives each visit a verdict: verified, unverified or spoofed. Spoofed visits are counted apart and never added to PerplexityBot's numbers. How verdicts work.

Allow or block PerplexityBot in robots.txt

robots.txt groups its rules by user-agent token. To ask PerplexityBot to stay off your whole site, add this group:

robots.txt
# Keep PerplexityBot out of the whole siteUser-agent: PerplexityBotDisallow: /

To let it read everything, name it with an allow rule. A group that names PerplexityBot replaces the User-agent: * group for it, so it follows only these rules:

robots.txt
# Let PerplexityBot read the whole siteUser-agent: PerplexityBotAllow: /

robots.txt is a request, not a lock: it's up to PerplexityBot to read it and follow it. Ethogram reads your robots.txt every day and shows whether PerplexityBot respects it, with the disallowed paths it asked for. To actually keep it out, use your firewall or bot protection, and check the visit's verdict first so you block impostors, not the real PerplexityBot.

See what PerplexityBot does on your site

Most analytics filter PerplexityBot out as a bot. Ethogram records it on your server, where every request lands, with no script to load, and shows:

  • Every visit from PerplexityBot, with a verdict on whether it's really PerplexityBot.
  • Each visit step by step: the pages it read, what it searched for, and where it was blocked, looped or hit an error.
  • Whether it respects your robots.txt, with the disallowed paths it asked for.
  • How much of your bandwidth it takes, next to its share of requests.
  • Impostors that use its name, caught and counted apart from the real PerplexityBot.
  • New versions of its user agent as they appear, and what changed in its behavior with each.
  • A heads-up when its visits spike or stop, or when it starts getting blocked.
A PerplexityBot visit in EthogramSample data
  1. +0sRead sitemap.xml /sitemap.xml200
  2. +7sViewed page /products/rain-shell200
  3. +24sViewed page /collections/hiking200
  4. +40sViewed page /returns200
  5. +52sViewed page /products/rain-shell200
  6. +1m 01sViewed page /products/down-vest200

1 more steps. Browsed and left. Nothing went wrong.

Open in the demo