Is Anomura used to train AI models?

No. Direqt's crawler documentation says Anomura is not used for model training. Its documented purpose is search discovery and indexing.

Does Direqt Anomura respect robots.txt?

Its status is unconfirmed because the published records conflict. Direqt says the crawler follows rules for `Anomura`, while Cloudflare's directory entry marks it as not following robots.txt. Test the rule on your site and use an enforced network control when the block is mandatory.

What happens if I block Anomura?

Direqt says blocked content will not appear in its search features. Blocking Anomura does not provide an additional model-training opt-out because Direqt already states that this crawler is not used for training.

How can I identify a genuine Anomura request?

Look for the `Anomura` token and compare the source with the crawler details linked from Direqt's documentation. Cloudflare does not publish a signature directory for this bot, so the user-agent string alone is not proof of origin.

Direqt Anomura: AI Crawler Guide & robots.txt

What is Direqt Anomura?

Direqt Anomura is the crawler behind Direqt's search features. It uses the Anomura token, and Cloudflare's bot directory records the full user agent as Anomura/1.2 (+https://www.direqt.ai). Direqt's crawler documentation is the operator reference for this traffic.

Anomura discovers links and metadata that Direqt can surface in search. A successful fetch makes a page available to that retrieval workflow, but it does not promise that the page will appear for a particular query or receive a particular position.

This is search collection, not model training. Direqt explicitly says that Anomura is not used to collect content for training models. Allowing it therefore affects possible inclusion in Direqt search features without granting a separate foundation-model training permission.

A complete block can keep a site out of those search features. Path-level rules offer a narrower choice: a publisher can expose public reference material while withholding account areas, licensed reports, or other sections that should not enter the index.

The robots.txt evidence is inconsistent. Direqt's operator page says Anomura follows directives addressed to its token, while Cloudflare's directory record marks it as not following robots.txt. For that reason, this bot's robots behavior remains unconfirmed rather than being presented as a dependable control.

Cloudflare does not list a Web Bot Auth signature directory for Anomura. The user-agent string can be copied by another client, so sites that need stronger identity checks should compare requests with Direqt's current published crawler addresses and confirm the observed behavior in their own logs.

Relevant for AI search

Is Direqt Anomura relevant for AI search?

Yes. Direqt Anomura collects pages for an AI product, so what it can crawl influences how AI systems describe your brand.

Direqt Anomura crawls and indexes pages so the AI search or assistant behind it can retrieve them at answer time. A page it has never fetched cannot be quoted, summarized, or linked in that product's answers, so most sites keep it allowed to stay citable. Blocking it removes your pages from that AI surface and hands those citations to competitors.

How to handle Direqt Anomura

Allow Anomura on pages you want Direqt search to discover. If you do not want a section represented there, address the stable Anomura token in robots.txt:

User-agent: Anomura
Disallow: /

Published records disagree about whether this rule is honored, so check subsequent requests instead of assuming the directive worked. A path-specific Disallow is preferable when only part of the site needs protection.

If the restriction must be enforced, add a server, CDN, or firewall rule as well. Match against Direqt's current operator documentation and source addresses rather than trusting the user-agent header by itself.

Examples

A software company allows Anomura to fetch its public documentation but disallows `/account/` and customer-only release notes.
A publisher sees `Anomura/1.2` in a request, checks the source against Direqt's current crawler information, and then decides whether to allow it.
A research site blocks a licensed report directory while leaving abstracts available for discovery in Direqt search.