AI crawlers·Mistral
MistralAI-Index
Mistral’s crawler for its search index, which Vibe uses to answer questions. Mistral says what it crawls is not used to train AI models of any kind.
- Operator
- Mistral
- robots.txt token
MistralAI-Index- Follows robots.txt
- Not stated
- IP ranges
- Published
- In Spreelytics
- Indexing tab
- Source
- Mistral’s documentation
What user agent does MistralAI-Index use?
Mistral publishes this user agent string for MistralAI-Index.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)How do I block MistralAI-Index?
Mistral lists MistralAI-Index among the robots.txt tags it uses, but does not say what blocking it does.
This is the robots.txt rule that names it:
User-agent: MistralAI-Index
Disallow: /How do I check that a MistralAI-Index visit is real?
Anyone can put a crawler’s name in a user agent, so the name alone proves nothing.
Mistral publishes the IP addresses MistralAI-Index crawls from, as JSON.
Spreelytics runs this check for you. Every crawl that claims to be MistralAI-Index is compared with the IP ranges Mistral publishes, refreshed every 12 hours, and one from outside them counts as spoofed.
How do I see MistralAI-Index visits on my site?
Your server’s access logs record the user agent of each request, so you can search them for “MistralAI-Index”.
Or add the Spreelytics server middleware, @spreelytics/ai-crawl. It recognises MistralAI-Index by its user agent and counts each visit on the Bots page under Indexing, apart from your visitor numbers.
Sources: docs.mistral.ai/robots
See your own numbers today.
Free up to 100k events a month · no credit card