Is Chathive crawler triggered by an end-user question?

The documented workflow is a configured knowledge-base crawl. The sources do not describe Chathive crawler as a one-page fetch that starts when an assistant user submits a question.

Does Chathive crawler affect AI search or model training?

It can affect answers from the Chathive customer assistant whose knowledge base is being built. The available documentation does not identify this crawler as a public AI search indexer or a model training crawler.

Does Chathive crawler respect robots.txt?

Its robots.txt behavior is unconfirmed in this catalog, and Cloudflare's bot directory marks `followsRobotsTxt` as false. Use the `ChathiveCrawler` rule as a preference, then enforce any hard boundary at the CDN or origin.

How is Chathive crawler identified?

Cloudflare's bot directory lists `ChathiveCrawler/1.0`. There is no Web Bot Auth directory in the record, its IP verification flag is false, and a user-agent string can be copied, so the string alone does not authenticate a request.

Why does the Chathive documentation mention Oniroco?

The operator URL in Cloudflare's record now presents the crawler as Oniroco and gives `OnirocoCrawler/1.0` as its default user agent. It also says the user agent can be customized, while this directory record retains the `ChathiveCrawler` identity.

Chathive crawler AI Crawler Guide

What is Chathive crawler?

Chathive crawler is the Inteso Group BV crawler that Chathive customers use to bring their own website content into an AI assistant. It is not presented as a general web crawler. The customer supplies the starting material for the assistant's knowledge base.

The operator's crawler documentation describes a workflow that starts from a list of URLs or a sitemap. The crawler visits those pages, follows links within a configured URL range, removes material it considers irrelevant, then saves new content or updates existing content in the knowledge base.

Requests therefore belong to a configured content ingestion run, not a live page fetch triggered by someone asking the assistant a question. A run can touch several linked pages, and a later run can update material that the knowledge base already contains. Server logs may show a cluster of related requests rather than a single page view.

A successful crawl can affect what one Chathive customer's assistant knows about your site. The available sources do not say that Chathive crawler supplies a public AI search index or a foundation model training dataset. Its traffic should not be treated as evidence of either activity.

Cloudflare's bot directory records ChathiveCrawler/1.0 as the full user agent and ChathiveCrawler as the matching token. The operator page listed by Cloudflare now calls the crawler Oniroco, documents OnirocoCrawler/1.0 as its default, and says customers can customize the user agent. That naming and configuration detail is worth checking before attributing every related request from its user agent alone.

Robots behavior is not confirmed in this bot, while Cloudflare's bot directory marks the crawler as not following robots.txt. The listing has no Web Bot Auth directory, and Promptwatch does not mark its IPs as verified. A user-agent rule can state your preference, but strict access decisions need an origin or edge rule backed by current logs and the operator's published IP information.

Relevant for AI searchChatHive

Is Chathive crawler relevant for AI search?

Yes. Chathive crawler feeds ChatHive, so the pages it can reach shape what those AI products say about you.

Chathive crawler crawls and indexes pages so the AI search or assistant behind it can retrieve them at answer time. A page it has never fetched cannot be quoted, summarized, or linked in that product's answers, so most sites keep it allowed to stay citable. Blocking it removes your pages from that AI surface and hands those citations to competitors.

How to handle Chathive crawler

Allow Chathive crawler when you or a customer deliberately configured Chathive to ingest the public pages in question. Keep account areas, internal search results, and other content that does not belong in the assistant's knowledge base outside the permitted crawl scope.

The stable token in this bot supports a robots.txt rule:

User-agent: ChathiveCrawler
Disallow: /

This catalog leaves robots.txt compliance unconfirmed, and Cloudflare's bot directory marks it as false. The operator also permits customized user agents. If the block must be enforced, match the observed traffic at your CDN or origin and validate any source addresses against the operator's current IP list instead of relying on this directive alone.

Examples

A support team adds its product manual sitemap to Chathive, then checks that a revised setup article was saved into the assistant's knowledge base.
A site owner permits crawler access to public documentation but enforces a deny rule for customer account paths at the edge.
An analyst sees `ChathiveCrawler/1.0` in logs and checks the operator's current crawler documentation before grouping it with newer Oniroco traffic.

Frequently asked questions about Chathive crawler

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Inteso Group BV describes a crawler that visits customer-supplied URLs or sitemaps, follows links within the configured range, strips irrelevant material, and saves or updates the result in the assistant's knowledge base.

Related bots

Amazon Kendra

Amazon Kendra is a managed information retrieval and intelligent search service that uses natural language processing and advanced deep learning model.

AI Assistant