AI crawlers·Mistral
MistralAI-Training
Mistral’s training crawler. It collects web content to build datasets for training Mistral’s generative AI models, and Mistral says it is not used for search indexing or to answer questions live in Vibe.
- Operator
- Mistral
- robots.txt token
MistralAI-Training- Follows robots.txt
- Yes
- IP ranges
- Not published
- In Spreelytics
- Training tab
- Source
- Mistral’s documentation
What user agent does MistralAI-Training use?
Mistral publishes this user agent string for MistralAI-Training.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)How do I block MistralAI-Training?
Mistral says you can disallow MistralAI-Training in your robots.txt file.
Add this to the robots.txt file at the root of your site:
User-agent: MistralAI-Training
Disallow: /How do I check that a MistralAI-Training visit is real?
Anyone can put a crawler’s name in a user agent, so the name alone proves nothing.
Mistral does not publish IP ranges or a DNS check for MistralAI-Training, so there is no way to confirm a request really came from it.
How do I see MistralAI-Training visits on my site?
Your server’s access logs record the user agent of each request, so you can search them for “MistralAI-Training”.
Or add the Spreelytics server middleware, @spreelytics/ai-crawl. It recognises MistralAI-Training by its user agent and counts each visit on the Bots page under Training, apart from your visitor numbers.
Sources: docs.mistral.ai/robots
See your own numbers today.
Free up to 100k events a month · no credit card