Does cohere-ai respect robots.txt?

Publishers control the cohere-ai user-agent with standard robots.txt groups. Confirm any Cohere-published guidance when available and keep the token spelling exact.

Cohere is an AI company focused on enterprise models and platforms. The cohere-ai token is how sites express crawl preferences toward Cohere-related collection.

Does blocking cohere-ai affect Google rankings?

No. It does not control Googlebot or Google Search.

Is cohere-ai the same as GPTBot?

No. Different operator, different user-agent. Policies must be set independently.

How should enterprise docs sites treat cohere-ai?

Many allow broad crawling of public docs; regulated industries may block training-oriented agents. Document the decision internally.

Why is the user-agent lowercase?

The commonly observed robots.txt token is cohere-ai. Matching is case-insensitive in many parsers, but you should still copy the documented spelling consistently.

cohere-ai

Cohere · Cohere crawler / bot identifier used in robots.txt for AI data preferences

What is cohere-ai?

cohere-ai is the user-agent string commonly associated with Cohere’s web crawling and AI data collection preferences in robots.txt discussions. Cohere builds enterprise AI models and platforms; publishers who want to allow or disallow Cohere’s collection should set an explicit User-agent: cohere-ai group. Always confirm the current official guidance on Cohere’s site or developer docs when available, and treat the token spelling carefully (case and punctuation matter in matching).

How to block cohere-ai

Add this group to robots.txt to disallow cohere-ai. Path rules can be narrowed if you only need to protect parts of the site.

User-agent: cohere-ai
Disallow: /

How to allow cohere-ai

For most public marketing and documentation sites, allowing well-behaved AI agents is the default recommended stance for AI visibility—while remaining a factual robots.txt Allow rule you can reverse later.

User-agent: cohere-ai
Allow: /

Should you block cohere-ai?

Treat cohere-ai like other training-oriented agents: allow for open participation, block for opt-out. Enterprise documentation sites sometimes allow widely; media sites with strict licensing may block. Re-verify official documentation periodically because AI companies update crawler names and policies.

Category: Training

Official documentation (Cohere)

Last verified: 2026-07-18. Re-check operator docs after major crawler announcements.

cohere-ai FAQ

Publishers control the cohere-ai user-agent with standard robots.txt groups. Confirm any Cohere-published guidance when available and keep the token spelling exact.