Does OnticaBot respect robots.txt?

The data record marks compliance as unconfirmed. Ontica's published bot page says the crawler follows robots.txt, so verify that stated behavior after changing your rules.

Will OnticaBot try to enter a paywall or login area?

Ontica says it fetches only public URLs and does not attempt to bypass paywalls or authentication. Server access controls should still protect any nonpublic content.

How can I verify OnticaBot is genuine?

Validate its Web Bot Auth signature with Ontica's key directory at https://ontica.com.au/.well-known/http-message-signatures-directory. A matching user agent is useful for classification but does not authenticate a request.

What happens if I block OnticaBot?

Ontica will be unable to fetch the blocked articles for its discovery and feed workflow. The sources do not indicate any effect outside Ontica's own service.

Does OnticaBot train AI models or influence AI search?

The operator documents summarization for curated feeds, but not model training or general AI search. A visit is not evidence that an independent assistant will cite the page.

OnticaBot & AI Search: What to Know

What is OnticaBot?

OnticaBot is an automated feed crawler run by Ontica Pty Ltd. It fetches publicly accessible articles so Ontica can discover material for curated content feeds, rather than building previews for a single social share.

Ontica says fetched material is used for content discovery, indexing, and summarization. Its bot page also says the crawler uses conservative request rates and does not try to pass paywalls or authentication. The published user agent is OnticaBot/1.0 (+https://ontica.com.au/bot).

Requests may carry Web Bot Auth signatures. Ontica publishes the verification keys at https://ontica.com.au/.well-known/http-message-signatures-directory, giving sites a stronger identity check than the copyable OnticaBot header.

The summarization step is part of Ontica's curated-feed workflow. No source identifies OnticaBot as a crawler for a general AI search engine or says that fetched articles train a model. Allowing it may make public articles eligible for Ontica feeds, but it has no documented effect on citations from unrelated AI assistants.

Indirectly relevant

Is OnticaBot relevant for AI search?

Indirectly. OnticaBot has no AI product of its own, but its output can end up in the systems that AI answers draw on.

OnticaBot fetches pages to build link-preview cards. It does not feed an AI index, but it reads the same Open Graph and structured metadata that AI systems parse to understand your pages, so clean preview metadata doubles as AI-friendly metadata.

How to handle OnticaBot

Allow OnticaBot if you accept discovery of public articles for Ontica's curated feeds. To exclude the crawler, publish a rule for its exact product token:

User-agent: OnticaBot
Disallow: /

The stored record leaves robots.txt compliance unconfirmed, while Ontica's current bot page says it respects robots.txt. Check your logs after a rule change because that statement is an operator policy, not technical enforcement.

When an edge platform supports Web Bot Auth, verify signatures with https://ontica.com.au/.well-known/http-message-signatures-directory. Do not grant access to sensitive paths merely because a request contains the right user-agent text.

Examples

OnticaBot discovers a public analysis and retrieves it for consideration in a curated feed. It does not receive credentials or attempt to open the subscriber-only version of the site.
A publisher excludes `/members/` in robots.txt but leaves public articles available. Afterward, the team validates signed requests and checks that OnticaBot stays out of the excluded path.

Frequently asked questions about OnticaBot

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Ontica says it uses them for discovery, indexing, and summarization in curated content feeds. It also says it does not resell the raw scraped content.