AI crawlers·DeepSeek
DeepSeekBot
DeepSeek’s training crawler. DeepSeek’s training summaries say it collects public web content to train DeepSeek’s general-purpose AI models, and to cross-check existing data against other sources.
- Operator
- DeepSeek
- robots.txt token
DeepseekBot- Follows robots.txt
- Yes
- IP ranges
- Not published
- In Spreelytics
- Training tab
- Source
- DeepSeek’s documentation
What user agent does DeepSeekBot use?
DeepSeek publishes no user agent string for it. Its training summaries spell the crawler’s name DeepseekBot.
How do I block DeepSeekBot?
DeepSeek says its crawler is designed to respect robots.txt. It publishes no robots.txt example, so this uses the name from its training summaries; robots.txt matches names regardless of letter case.
Add this to the robots.txt file at the root of your site:
User-agent: DeepseekBot
Disallow: /How do I check that a DeepSeekBot visit is real?
Anyone can put a crawler’s name in a user agent, so the name alone proves nothing.
DeepSeek does not publish IP ranges or a DNS check for DeepSeekBot, so there is no way to confirm a request really came from it.
How do I see DeepSeekBot visits on my site?
Your server’s access logs record the user agent of each request, so you can search them for “DeepSeekBot”.
Or add the Spreelytics server middleware, @spreelytics/ai-crawl. It recognises DeepSeekBot by its user agent and counts each visit on the Bots page under Training, apart from your visitor numbers.
Sources: cdn.deepseek.com/policies/en-US/model-algorithm-disclosure.html, cdn.deepseek.com/policies/DeepSeek-V4.1-public-summary-of-training-content.pdf
See your own numbers today.
Free up to 100k events a month · no credit card