Why is ClarityBot crawling my site now?

A seoClarity customer likely started an on-demand audit or scheduled daily checks. The requested URL set and crawl rate come from that customer's configuration.

Does ClarityBot respect robots.txt?

Yes, according to seoClarity and this bot. The operator also says it obeys crawl delays.

Can ClarityBot crawl JavaScript sites?

seoClarity documents optional JavaScript rendering. A project owner can also choose crawl depth, speed, and whether to scan a whole site or a narrower URL set.

Does ClarityBot affect AI answers or training?

No direct AI use is documented. It produces technical and content analysis for a seoClarity audit rather than feeding a public answer engine.

Can I verify ClarityBot?

Only at the user-agent level. The entry is marked unverifiable and provides no verified IP identity or Web Bot Auth keys, so `ClarityBot` is not an authentication credential.

ClarityBot & AI Search: What to Know

What is ClarityBot?

ClarityBot identifies seoClarity's page and site-audit crawler. A seoClarity customer starts a crawl to inspect technical issues and page content, or configures selected pages for recurring daily checks. The bot is therefore customer-directed audit traffic, not an open crawler collecting every site it encounters.

A customer can point the crawler at an entire site, a sitemap, a URL list, or one section. seoClarity also lets that customer set crawl depth and request speed, and its crawler can render JavaScript. Those settings explain why one ClarityBot run may touch a few chosen pages while another produces a large, concentrated batch.

The official bot page lists desktop and mobile identities containing ClarityBot and says the crawler obeys robots.txt and crawl delays. This directory agrees, but the entry remains marked unverifiable and has no matching Cloudflare record. A token match classifies the request without authenticating it.

ClarityBot's output is an SEO audit for the customer who requested it. The record does not assign the bot any public AI-search or model-training function. Audit findings may lead a site owner to fix crawlability, but the bot's visit is not evidence of AI indexing or citation.

Indirectly relevant

Is ClarityBot relevant for AI search?

Indirectly. ClarityBot has no AI product of its own, but its output can end up in the systems that AI answers draw on.

ClarityBot is an SEO auditing crawler. It has no direct effect on search rankings or AI answers, but the reports it feeds are used to fix crawlability and content issues that do affect how search and AI systems see your site.

How to handle ClarityBot

Teams using seoClarity should keep the audit scope reachable and first reduce speed or frequency in the product when a run is too heavy. To prevent the standard identity from crawling the site, use:

User-agent: ClarityBot
Disallow: /

seoClarity says ClarityBot honors robots.txt and crawl-delay directives. Blocking it will interrupt Site Clarity crawls and managed page checks unless the customer configures an alternate agent. Since this catalog cannot verify the sender's IP or signature, do not expose protected pages solely for a claimed ClarityBot request.

Examples

An enterprise SEO team runs a JavaScript crawl of a product section and sees ClarityBot request rendered page assets during the audit.
A publisher schedules daily checks for a small set of important articles rather than launching a full-site crawl.
An SRE asks the seoClarity project owner to lower crawl speed after a large audit raises origin latency.

Frequently asked questions about ClarityBot

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

seoClarity operates ClarityBot for its page-audit and site-audit features. The crawler runs against sites or pages selected by seoClarity customers.

Related bots

AhrefsBot

Powers the database for both Ahrefs, a marketing intelligence platform, and Yep, an independent, privacy-focused search engine.

SEO

AhrefsSiteAudit

Powers Ahrefs’ Site Audit tool. Ahrefs users can use Site Audit to analyze websites and find both technical SEO and on-page SEO issues.

SEO

Barkrowler

Barkrowler is Babbar's web crawler that fuels and updates their graph representation of the web, providing SEO tools for the marketing community.

SEO

DataForSeoBot

DataForSeoBot is a backlink checker bot operated by DataForSEO that crawls websites to build and maintain their backlink database.

SEO

DotBot

DotBot is a web crawler operated by Moz (formerly SEOmoz) that collects data for their Link Explorer tool and Links API.

SEO

ClarityBot