In one sentence
GPTBot is the user agent of OpenAI's web crawler, which OpenAI documents as collecting public web content that may be used to train its generative models.
What it means
GPTBot is not the only OpenAI user agent. OpenAI documents separate ones for search indexing (OAI-SearchBot) and for fetching a page when a ChatGPT user asks (ChatGPT-User). Each is controlled independently through robots.txt.
That split matters. Disallowing GPTBot tells OpenAI not to use your pages for training. It does not by itself remove you from ChatGPT search results, which depend on the search user agent.
What to do about it
Decide whether you want your content in training data. Many brands allow it, because being known to the model is part of visibility. Others block it for licensing reasons. Whichever you choose, keep the search user agent allowed if you want to be cited in ChatGPT answers, and confirm the outcome with the AI crawler access checker. Check OpenAI's documentation for current user agent names.
How Pineprompt measures it
The AI crawler access checker tests GPTBot access. Pineprompt tracks whether ChatGPT then mentions and cites you, via the ChatGPT visibility tracker.
Frequently asked
- What is GPTBot?
- GPTBot is the user agent of OpenAI's web crawler, which OpenAI documents as collecting public web content that may be used to train its generative models.
- How does Pineprompt measure GPTBot?
- The AI crawler access checker tests GPTBot access. Pineprompt tracks whether ChatGPT then mentions and cites you, via the ChatGPT visibility tracker.