OAI-SearchBot
OpenAI · Indexes content for ChatGPT search / retrieval features
By Vinespire Editorial Team, Editorial ·
Update: Verified against OpenAI operator documentation for OAI-SearchBot.
This page is the operator/profile guide for OAI-SearchBot. To paste a full robots.txt and check OAI-SearchBot plus other AI crawlers in one pass, use the Robots.txt AI Crawler Validator. Short definitional entries also live in the AI search glossary.
Related free utilities are in free AI SEO tools.
What is OAI-SearchBot?
OAI-SearchBot is OpenAI’s crawler associated with search and retrieval-style indexing for ChatGPT search experiences, separate from GPTBot’s broader crawl/training role and ChatGPT-User’s on-demand fetches. If you want pages discoverable in OpenAI search surfaces, allowing OAI-SearchBot is the relevant robots.txt decision. Blocking it may reduce inclusion in those search features without necessarily stopping all other OpenAI agents. Always confirm behavior and user-agent spelling against OpenAI’s current bot documentation, and keep Allow/Disallow groups explicit so a catch-all User-agent: * rule does not accidentally apply.
How to block OAI-SearchBot
Add this group to robots.txt to disallow OAI-SearchBot. Path rules can be narrowed if you only need to protect parts of the site.
User-agent: OAI-SearchBot Disallow: /
How to allow OAI-SearchBot
For most public marketing and documentation sites, allowing well-behaved AI agents is the default recommended stance for AI visibility—while remaining a factual robots.txt Allow rule you can reverse later.
User-agent: OAI-SearchBot Allow: /
Should you block OAI-SearchBot?
Search-indexing bots sit between classic SEO crawlers and training crawlers: they influence whether your pages can appear in an AI product’s search layer. Brands optimizing for AI visibility usually allow OAI-SearchBot. Block if you do not want content available to that product’s search index or if capacity/legal constraints require it. Blocking OAI-SearchBot is not a substitute for noindexing sensitive URLs in search engines generally—use the right tool for each surface. Pair an Allow rule with solid on-page structure so indexed pages are useful when retrieved.
Category: Search indexing
Official documentation (OpenAI)
Last verified: . Re-check operator docs after major crawler announcements.
Related bots (Search indexing)
OAI-SearchBot FAQ
- OpenAI documents robots.txt controls for its bots including search-oriented agents. Use User-agent: OAI-SearchBot with Allow or Disallow and confirm on the official bot documentation.