AI crawlers·Apple
Applebot-Extended
Not a crawler but a robots.txt token. It tells Apple whether pages Applebot has crawled may be used to train the foundation models behind Apple Intelligence and Apple’s other generative AI features.
- Operator
- Apple
- robots.txt token
Applebot-Extended- Follows robots.txt
- Yes
- IP ranges
- Not published
- In Spreelytics
- Never seen in a request
- Source
- Apple’s documentation
Does Applebot-Extended have a user agent?
No. Apple says Applebot-Extended does not crawl webpages: Applebot does the fetching, and the token only decides how what it fetched may be used.
How do I block Applebot-Extended?
Disallowing Applebot-Extended tells Apple not to use your pages to train its foundation models. Apple says the pages can still appear in its search results, and the token does not affect ranking. It does not keep content out of AI answers in Siri or Search either: for that, Apple points to the nosnippet meta tag.
Add this to the robots.txt file at the root of your site:
User-agent: Applebot-Extended
Disallow: /Sources: support.apple.com/en-us/119829
More from Apple.
See your own numbers today.
Free up to 100k events a month · no credit card