Who operates Cohere AI?

Cohere AI is operated by Cohere. It functions as Cohere's AI crawler.

Does Cohere AI respect robots.txt?

Yes. Cohere AI generally follows robots.txt directives, so you can allow or disallow it with a rule for its user agent.

Should I block Cohere AI?

Block it if you do not want your content used to train AI models. Allow it if you want to contribute to and potentially be referenced by those systems.

Can I see when Cohere AI crawls my site?

Yes. Promptwatch classifies Cohere AI from your server and CDN logs in real time, showing which pages it hits, the response codes it gets, and how its crawls relate to AI citations.

Cohere AI - What It Is & How to Handle It

What is Cohere AI?

Cohere AI is Cohere's AI crawler. Cohere AI collects publicly available web text that helps train and refine Cohere's large language models for enterprise generative AI.

Cohere AI matters for AI visibility because the pages it collects can shape what large language models learn about your brand, products, and expertise. Allowing it can strengthen how accurately AI systems describe and recommend you, while disallowing it keeps your content out of training data. Either way, knowing Cohere AI visits is the first step to managing how your brand shows up in AI search.

Tracking which AI crawlers and agents reach your site, and what they do once there, is the foundation of generative engine optimization. See our guides to AI crawlers and robots.txt to control automated access and protect your AI search visibility.

Promptwatch tracks Cohere AI in real time from your server and CDN logs, so you can see exactly when it visits, which pages it requests, and how those crawls relate to citations. Learn more in AI crawler logs.

Track Cohere AI with Promptwatch

Promptwatch classifies Cohere AI (cohere-ai) in real time from your server and CDN logs. See exactly when it visits, which pages it requests, the status codes it gets, and how those crawls map to AI citations.

How to handle Cohere AI

If you do not want Cohere AI using your content for AI training, disallow it in robots.txt. If you are comfortable contributing to AI systems, leave it allowed.

To control Cohere AI, add a rule for its user agent to your robots.txt:

User-agent: cohere-ai
Disallow: /

Cohere AI generally honors robots.txt directives.

Examples

A publisher reviews server logs, sees Cohere AI requesting long-form articles, and decides whether to allow or disallow it in robots.txt.
A site owner adds a Disallow rule for Cohere AI to keep premium guides out of AI training datasets.

Related bots

GPTBot

Crawls web content to improve OpenAI's generative AI models and ChatGPT; respects 'robots.txt' directives to exclude sites from training data.

AI Crawler

ClaudeBot

ClaudeBot helps enhance the utility and safety of our generative AI models by collecting web content that could potentially contribute to their training.

AI Crawler