Promptwatch Logo

Webzio-Extended

Webz.io's crawler that tags collected web content as permitted or not permitted for AI and ML training.
UnverifiableWebz.ioWebzio-Extended
AI TrainingAI Crawler

What is Webzio-Extended?

Webzio-Extended is half of what Webz.io calls the Webzio Duo, announced in its post From Omgilibot to the Webzio Duo. The Duo replaces the older omgilibot.

According to Webz.io, Webzio crawls and structures content, while Webzio-Extended performs ethical validation. It tags data as usable or not usable for AI and ML training, and Webz.io says it only provides data tagged as explicitly permitted for AI purposes.

Webz.io states that the pair adheres to robots.txt exclusions. It publishes no IP ranges for Webzio-Extended, so a request using this name cannot be verified from operator data.

Relevant for AI search

Is Webzio-Extended relevant for AI search?

Yes. Webzio-Extended decides whether your content is tagged as usable for AI training in Webz.io's datasets.

Webz.io sells web data to AI and software companies. Webzio-Extended reviews content collected by its companion crawler and tags it as permitted or not permitted for AI and ML training. Blocking it keeps your pages out of the datasets sold for training, and has no effect on search engine visibility.

How to handle Webzio-Extended

To keep your content out of Webz.io's AI training datasets:

User-agent: Webzio-Extended
Disallow: /

This is a training opt-out, so it does not change how search engines or answer engines treat your site. Manage omgilibot separately if you still see the legacy crawler in logs.

Examples

  • A publisher adds a Webzio-Extended disallow rule to opt out of AI training datasets sold to third parties.
  • A site owner sees the old `omgilibot` token and the new Webz.io tokens in logs and updates robots.txt for all of them.

Frequently asked questions about Webzio-Extended

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Webz.io says its crawlers adhere to robots.txt exclusions.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard