Features·Web analytics

See the crawlers your tracker can't.

AI crawlers fetch your raw HTML and almost never run JavaScript, so a browser tracker cannot see them. These are counted on your server, where they show up.

What it does

Crawler traffic on its own page.

A separate middleware stores crawler data apart from your human sessions.

Three kinds of bot

Each bot is sorted by what it does with your pages.

  • AI assistants fetching your pages
  • Search engine crawlers
  • Model-training crawlers

Counted where they land

A small server-side middleware records the request itself, so nothing depends on JavaScript running.

  • Express, Next.js and any fetch handler
  • Never delays a response
  • Edge runtimes too, in front of static sites

Kept out of your real numbers

Crawler hits are not visitors and are never counted as such. Datacenter traffic is filtered from human analytics too.

  • Never joined to human sessions
  • Datacenter IP ranges dropped at ingest
  • No bots in your visitor counts

How it works

Use it in three steps.

  1. 01

    Add the middleware

    One package and one line in your server, alongside the browser snippet you already have.

  2. 02

    Crawlers get logged

    Each crawler request is identified by who sent it and recorded as it happens.

  3. 03

    Read the Bots page

    Stat strip, trend chart, then ranked breakdowns across every dimension a crawl hit carries.

FAQ

Questions about this one.

What people ask before they switch it on.

Why can a normal analytics tool not see this?

Because it is a script in the page, and a crawler fetching raw HTML never executes it. The only place to see these requests is on the server that served them.

Do bot hits count against my plan?

No. Crawler hits are stored separately from your visitor events, so they never count toward your allowance and never inflate your visitor numbers.

Does the middleware slow my site down?

No. It records the request and returns straight away, so the response is never held up.

Can I hide it if I do not care?

Yes. There is a toggle that removes the crawler card from your overview. The data keeps being collected either way, so turning it back on shows the history.

See your own numbers today.

Free up to 100k events a month · no credit card

Contact

Tell us what you need.

A real person reads these. We usually reply within one working day.

Or email us directly at contact@spreelytics.com.