Who operates Sitebulb?

Sitebulb is operated by SEO. It functions as SEO's SEO crawler.

Does Sitebulb respect robots.txt?

Not always. Because Sitebulb performs user-initiated or real-time fetches, it can bypass robots.txt. Watch your access logs to confirm how it behaves on your site.

Should I block Sitebulb?

It depends on whether you rely on the service behind Sitebulb. If you do, keep it allowed; otherwise you can disallow it in robots.txt.

Sitebulb - What It Is & How to Handle It

What is Sitebulb?

Sitebulb is SEO's SEO crawler. Sitebulb is a desktop and cloud-based website crawler used by SEO professionals for technical SEO audits. It analyzes websites to find technical issues, opportunities for improvement, and provides detailed reports with visualizations and prioritized recommendations.

Sitebulb fetches pages in real time on behalf of a person using an AI product, so a visit usually means a user is actively trying to reach your content through AI. These user-driven fetches are often the moments that turn into citations and referral traffic, which makes them valuable signals for GEO.

Like any automated client, Sitebulb consumes crawl budget and appears in your server and CDN logs. Reviewing those logs alongside your robots.txt rules helps you keep automated traffic deliberate and easy to reason about.

Want to see every AI bot hitting your site? Promptwatch turns your server and CDN logs into a live view of AI crawler and agent traffic, so you can watch ChatGPT, Claude, Perplexity, Gemini, and others crawl your pages and connect those visits to real citations and revenue. Learn more in AI crawler logs.

See every AI bot hitting your site

Promptwatch turns your server and CDN logs into a live view of AI crawler and agent traffic. Watch ChatGPT, Claude, Perplexity, Gemini, and more crawl your pages in real time, see exactly what they take, and connect every crawl to the citations and revenue it drives.

How to handle Sitebulb

Whether to allow Sitebulb depends on whether you rely on the service behind it. Use a robots.txt rule to allow or disallow it.

To control Sitebulb, add a rule for its user agent to your robots.txt:

User-agent: Sitebulb
Disallow: /

Because Sitebulb performs user-initiated or real-time fetches, it may not always honor robots.txt, confirm its behavior by watching your access logs.

Examples

A site owner spots Sitebulb in access logs and confirms it against the operator's documented user agent.
An operations team allows Sitebulb so the service it powers keeps working as expected.

Related bots

Lumar

The Lumar website intelligence platform is used by SEO, engineering, marketing and digital operations teams to monitor the performance of their site’s technical health, and ensure a high-performing,...

SEO