Promptwatch Logo

PetalBot

PetalBot is a web crawler operated by Huawei's Petal Search engine.
Huawei's Petal Search enginePetalBot
Search Engine CrawlerAI Assistant

What is PetalBot?

PetalBot is Huawei's crawler for the Petal Search engine. It visits desktop and mobile websites to build Petal's index database. That index supports ordinary Petal search and content recommendations in Huawei Assistant and AI Search.

Both crawler variants use the stable token PetalBot. The recorded desktop agent is Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot), while the mobile form includes an Android and Mobile Safari prefix before the same token. One robots.txt group can address both.

A page that PetalBot can crawl may become searchable through Petal or eligible for recommendations in the two Huawei services named by the operator. Huawei warns that banning the crawler makes site pages unsearchable across Petal search-engine services. This is a direct search and recommendation consequence, not a generic claim about every AI answer engine.

PetalBot keeps recrawling so its index can retrieve current resources. The operator says it adjusts activity using factors such as server capacity, website quality, and website updates, and asks site owners to report unreasonable traffic to [email protected].

The published PetalBot documentation describes indexing, search, and recommendations. It does not say that crawled pages are used to train an AI model. Blocking PetalBot should therefore be understood as a Petal discovery control, not as a documented model-training opt-out.

PetalBot complies with the robots protocol. Huawei also documents a reverse-DNS and forward-DNS check for investigating whether a request really comes from its crawler, although this bot does not contain static verified IP ranges. Index cleanup is not immediate after a block; the operator says already indexed pages can take several months to disappear.

Relevant for AI search

Is PetalBot relevant for AI search?

Yes. PetalBot collects pages for an AI product, so what it can crawl influences how AI systems describe your brand.

PetalBot crawls and indexes pages so the AI search or assistant behind it can retrieve them at answer time. A page it has never fetched cannot be quoted, summarized, or linked in that product's answers, so most sites keep it allowed to stay citable. Blocking it removes your pages from that AI surface and hands those citations to competitors.

How to handle PetalBot

Allow PetalBot on pages that should remain searchable in Petal and available for Huawei Assistant or AI Search recommendations. To remove the whole site from future crawling, use the operator's documented rule:

User-agent: PetalBot
Disallow: /

PetalBot is recorded as respecting robots.txt, and Huawei says the file can also block selected paths instead of the entire site. Keep private material behind authentication as well, since crawler directives do not provide access control.

Do not expect an immediate removal from Petal's existing index. Huawei says clearing pages that were indexed before the rule can take several months. Urgent removal requests and crawl-load concerns can be sent to [email protected].

For identity checks, start with the PetalBot token and follow Huawei's documented reverse-DNS lookup with a forward lookup back to the original address. A copied user-agent string by itself is not sufficient verification.

Examples

  • A publisher permits PetalBot on its public articles so they can be indexed by Petal and considered for Huawei Assistant recommendations.
  • A site owner disallows PetalBot across the domain, knowing that previously indexed URLs may remain visible for several months.
  • An administrator investigating a burst of PetalBot traffic performs the operator's two-step DNS check before reporting the crawl load.

Frequently asked questions about PetalBot

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Petal Search uses the index for search results. Huawei Assistant and AI Search, both powered by Petal Search, also use it for content recommendations.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard