Why does NitroPack request the same site more than once?

NitroPack can optimize desktop and mobile versions, warm pages found through links or a sitemap, and schedule new work after cached pages are purged or invalidated.

Does NitroBot respect robots.txt?

The local metadata leaves compliance unknown, and Cloudflare's bot directory marks the bot as not following robots.txt. Use an enforceable control if requests must stop.

Can NitroPack warmup affect server load?

Yes. NitroPack says warmup may visit many URLs in a short period and that fetching page resources can raise CPU use on a constrained origin.

Is NitroBot used for AI search or model training?

No such use is documented. It fetches customer content and resources for NitroPack's page optimization workflow.

NitroBot & AI Search: What to Know

Q: Which NitroBot user agents are recorded?

Cloudflare's bot directory lists `Nitro-Warmup-Agent`, `Nitro-Webhook-Agent`, and `Nitro-Optimizer-Agent`, all matched by the `Nitro-` token in this entry.

What is NitroBot?

NitroBot is service traffic from NitroPack's cloud-based site-speed optimizer. NitroPack fetches a customer's pages and their resources so it can create optimized versions away from the origin server. When a WordPress site is first connected, the service starts by requesting the home page for desktop and mobile optimization.

Cache Warmup can create further visits. NitroPack simulates user requests to the home page and linked URLs, or to pages supplied through a sitemap. It also queues fresh optimization after a cached page is purged or invalidated. Large warmup sets can therefore produce a concentrated run of requests and higher origin CPU use.

Cloudflare's bot directory records three user agents under the common Nitro- prefix: Nitro-Warmup-Agent, Nitro-Webhook-Agent, and Nitro-Optimizer-Agent. Robots behavior is not confirmed in the local metadata, while Cloudflare's bot directory marks the identity as not following robots.txt. No Web Bot Auth directory or verified IP status appears in this bot.

NitroBot does not have a documented AI search or model-training purpose. The service may improve page performance for human visitors and other crawlers, but a Nitro request is not evidence that an AI engine indexed, trained on, or cited the page.

Indirectly relevant

Is NitroBot relevant for AI search?

Indirectly. NitroBot has no AI product of its own, but its output can end up in the systems that AI answers draw on.

NitroBot is an SEO auditing crawler. It has no direct effect on search rankings or AI answers, but the reports it feeds are used to fix crawlability and content issues that do affect how search and AI systems see your site.

How to handle NitroBot

Sites connected to NitroPack should allow the recorded agents to reach the public pages and assets selected for optimization. If warmup traffic strains the origin, reduce the configured warmup scope or disable that feature rather than exposing extra routes. NitroPack says carts and checkout pages are not optimized because their content is visitor-specific.

A robots.txt group can state a preference against all three recorded identities:

User-agent: Nitro-Warmup-Agent
User-agent: Nitro-Webhook-Agent
User-agent: Nitro-Optimizer-Agent
Disallow: /

Cloudflare says NitroBot does not follow robots.txt, so use a CDN, firewall, or application rule for an enforceable block. A site that still uses NitroPack should disconnect or reconfigure the service before blocking its requests.

Examples

After a WordPress site connects to NitroPack, the origin sees desktop and mobile requests that start optimization of the home page.
A sitemap-based warmup queues many public URLs after a cache purge, and the team narrows the warmup configuration when origin CPU rises.
A former NitroPack customer blocks the three recorded Nitro agents at its CDN after disconnecting the site from the service.

Frequently asked questions about NitroBot

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

NitroPack Ltd operates the agents as part of its cloud-based site-speed optimization service.

Related bots

AhrefsBot

Powers the database for both Ahrefs, a marketing intelligence platform, and Yep, an independent, privacy-focused search engine.

SEO

AhrefsSiteAudit

Powers Ahrefs’ Site Audit tool. Ahrefs users can use Site Audit to analyze websites and find both technical SEO and on-page SEO issues.

SEO

Barkrowler

Barkrowler is Babbar's web crawler that fuels and updates their graph representation of the web, providing SEO tools for the marketing community.

SEO

ClarityBot

ClarityBot is seoClarity's web crawler that performs technical SEO audits, analyzes content, and monitors website performance.

SEO

DataForSeoBot

DataForSeoBot is a backlink checker bot operated by DataForSEO that crawls websites to build and maintain their backlink database.

SEO

NitroBot