AI crawlers·Moonshot AI
Kimi-SearchBot
Moonshot AI’s search crawler. It analyses pages and builds the index behind Kimi’s search features.
- Operator
- Moonshot AI
- robots.txt token
Kimi-SearchBot- Follows robots.txt
- Yes
- IP ranges
- Published
- In Spreelytics
- Indexing tab
What user agent does Kimi-SearchBot use?
Moonshot AI publishes this user agent string for Kimi-SearchBot.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; Kimi-SearchBot/1.0; +https://www.kimi.com/policies/kimi-crawlersHow do I block Kimi-SearchBot?
Moonshot says blocking Kimi-SearchBot keeps your site out of Kimi’s search results. Each Kimi crawler is set separately, rules apply per subdomain and Crawl-delay is honoured. Moonshot recommends robots.txt over blocking its IP addresses, which would stop it reading your latest rules.
Add this to the robots.txt file at the root of your site:
User-agent: Kimi-SearchBot
Disallow: /How do I check that a Kimi-SearchBot visit is real?
Anyone can put a crawler’s name in a user agent, so the name alone proves nothing.
Moonshot publishes the IP addresses its crawlers use and says a request from inside them comes from Kimi, though the addresses change. Its three bots share the same addresses, so the address alone cannot tell them apart.
Spreelytics runs this check for you. Every crawl that claims to be Kimi-SearchBot is compared with the IP ranges Moonshot AI publishes, refreshed every 12 hours, and one from outside them counts as spoofed.
How do I see Kimi-SearchBot visits on my site?
Your server’s access logs record the user agent of each request, so you can search them for “Kimi-SearchBot”.
Or add the Spreelytics server middleware, @spreelytics/ai-crawl. It recognises Kimi-SearchBot by its user agent and counts each visit on the Bots page under Indexing, apart from your visitor numbers.
Sources: www.kimi.com/policies/kimi-crawlers
More from Moonshot AI.
See your own numbers today.
Free up to 100k events a month · no credit card