Promptwatch Logo

PanguBot

PanguBot crawls web content used to train Huawei's Pangu family of large language models.
UnverifiableHuaweiPanguBot
AI CrawlerAI Training

What is PanguBot?

PanguBot is attributed to Huawei and described in this directory as collecting web content for the Pangu model family. The attribution is marked unverifiable. That warning matters because a request containing PanguBot cannot be treated as confirmed Huawei traffic from the available evidence.

Huawei's Pangu documentation describes NLP, multimodal, computer-vision, prediction, and scientific-computing models managed through ModelArts Studio. It covers data processing, model training, deployment, and application development, but it does not document a web crawler named PanguBot.

The facts record supplies one stable token, PanguBot, and no complete user-agent example. It also has no Cloudflare catalog entry, published IP verification, or HTTP-signature directory. The token is enough to write a policy rule and search logs, not enough to verify the operator.

If the recorded purpose and attribution are accurate, pages fetched by PanguBot may be used as training material for Pangu models. There is no documented connection to a live AI search engine, retrieval service, or citation feature. Allowing the token should not be presented as a way to gain placement in Huawei AI answers.

Robots compliance is recorded as partial. No operator documentation in the source material explains which directives or request types are covered, so a robots.txt block is useful as a stated preference but cannot be assumed to stop every request. There is no supported basis for attributing the partial status to a particular fetching mode.

Sites can apply a conservative policy without resolving the attribution. Keep nonpublic content behind authentication, use an edge rule when a robots preference is ignored, and avoid granting special access to a client simply because it claims the PanguBot name.

Relevant for AI search

Is PanguBot relevant for AI search?

Yes. PanguBot collects pages for an AI product, so what it can crawl influences how AI systems describe your brand.

PanguBot gathers public web content that can end up in the training data for large language models. Once your pages are in that set, they influence how the operator's models talk about you for that model generation. Allowing it lets your own writing carry weight in those answers; blocking it means the models learn about you from third parties instead.

How to handle PanguBot

If you do not want the claimed crawler fetching content for the recorded training purpose, publish a dedicated rule:

User-agent: PanguBot
Disallow: /

Robots compliance is only partial, with no operator explanation in the record. Check whether requests continue after the rule is available. Use a CDN, firewall, or application block when exclusion must be enforced, and keep private pages authenticated.

Do not create an allowlist from the user-agent token. PanguBot is marked unverifiable and has no recorded IP or HTTP-signature method for confirming Huawei as the source.

Examples

  • A manufacturer disallows `PanguBot` on technical manuals that its contracts do not permit it to supply for model training.
  • A site sees requests continue after publishing the robots rule and enforces the same policy at its CDN because compliance is recorded as partial.
  • A security analyst labels a matching log entry as claimed PanguBot traffic, rather than verified Huawei traffic, because no stronger identity data is available.

Frequently asked questions about PanguBot

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

The directory attributes PanguBot to Huawei, but the verification status is `unverifiable`. Huawei's Pangu product documentation does not identify a crawler with this name.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard