AI crawlers·OpenAI
OAI-AdsBot
Checks the landing pages of ads submitted to ChatGPT against OpenAI’s ad policies, and may use a page to judge when its ad is relevant. OpenAI says it only visits pages submitted as ads, and that its data is not used to train AI models.
- Operator
- OpenAI
- robots.txt token
OAI-AdsBot- Follows robots.txt
- Yes
- IP ranges
- Published
- In Spreelytics
- Training tab
- Source
- OpenAI’s documentation
What user agent does OAI-AdsBot use?
OpenAI publishes this user agent string for OAI-AdsBot.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-AdsBot/1.0; +https://openai.com/adsbotHow do I block OAI-AdsBot?
OpenAI says its crawlers stop as soon as robots.txt disallows them. If you advertise on ChatGPT, leave OAI-AdsBot allowed, or your landing pages cannot be reviewed.
Add this to the robots.txt file at the root of your site:
User-agent: OAI-AdsBot
Disallow: /How do I check that a OAI-AdsBot visit is real?
Anyone can put a crawler’s name in a user agent, so the name alone proves nothing.
OpenAI publishes the IP addresses OAI-AdsBot makes requests from, as JSON.
Spreelytics runs this check for you. Every crawl that claims to be OAI-AdsBot is compared with the IP ranges OpenAI publishes, refreshed every 12 hours, and one from outside them counts as spoofed.
How do I see OAI-AdsBot visits on my site?
Your server’s access logs record the user agent of each request, so you can search them for “OAI-AdsBot”.
Or add the Spreelytics server middleware, @spreelytics/ai-crawl. It recognises OAI-AdsBot by its user agent and counts each visit on the Bots page under Training, as an AI crawler with no clearer purpose, apart from your visitor numbers.
Sources: developers.openai.com/api/docs/bots, help.openai.com/en/articles/20001243-advertiser-guidance-for-allowing-openai-web-crawlers
See your own numbers today.
Free up to 100k events a month · no credit card