Why does AddSearchBot appear in web analytics?

The crawler loads pages while adding them to or refreshing the AddSearch index. Analytics software can count those automated page requests unless bot traffic is filtered.

Does AddSearchBot respect robots.txt?

AddSearch's documentation provides `AddSearchBot` rules for excluding content, but the metadata is unknown and Cloudflare says false. Publish the rule and verify its effect rather than using robots.txt as access control.

What happens if an AddSearch customer blocks it?

Blocked pages may disappear from or stop updating in that customer's on-site search. Feeds or API updates may still cover content supplied through those separate methods.

Does AddSearchBot feed AI search or training?

No AI use is documented. Its stated purpose is to populate a customer's site-search index.

Can I exclude one page without blocking the crawler?

Yes. AddSearch documents path-specific robots rules, an `AddSearchBot` robots meta tag, and exclusions managed through Site Areas in its dashboard.

AddSearchBot & AI Search: What to Know

What is AddSearchBot?

AddSearchBot can inflate page-view counts even though no visitor opened the requested pages. The crawler loads a customer's site while building or refreshing the index behind its AddSearch search box, and many analytics tools record those automated fetches as traffic.

What enters that index depends on the customer's search configuration. Site owners can exclude folders or individual pages with robots.txt, AddSearch-specific meta tags, or Site Areas in the AddSearch dashboard. AddSearch also offers feeds and an API for index updates, so not every indexed item must arrive through the crawler.

This is an on-site search workflow, not general AI search or model training. Blocking AddSearchBot can make a customer's own results incomplete or stale. It has no documented effect on whether the same pages appear in ChatGPT, Gemini, or another external answer engine.

The recorded user agents contain AddSearchBot/1.0 and link to AddSearch's bot page. AddSearch's documentation shows crawler-specific robots.txt rules, while the local metadata leaves compliance unknown and Cloudflare's bot directory marks it false. That conflict makes log verification worthwhile after changing a rule.

Indirectly relevant

Is AddSearchBot relevant for AI search?

Indirectly. AddSearchBot has no AI product of its own, but its output can end up in the systems that AI answers draw on.

AddSearchBot is an SEO auditing crawler. It has no direct effect on search rankings or AI answers, but the reports it feeds are used to fix crawlability and content issues that do affect how search and AI systems see your site.

How to handle AddSearchBot

If the site uses AddSearch, allow the pages that belong in its search results and manage exclusions in both robots.txt and the AddSearch configuration. A full crawler block is:

User-agent: AddSearchBot
Disallow: /

AddSearch documents this exact token and provides examples for excluding paths. Cloudflare's compliance field disagrees with those instructions, so confirm the result in access logs. Do not allowlist the header for private content; the version can change, the token can be copied, and this bot has no authenticated IP or signature status.

Examples

A documentation site leaves product guides open to AddSearchBot so its own search box can return them.
A retailer excludes `/checkout/` from the AddSearch index while continuing to crawl public category pages.
An analyst filters AddSearchBot requests out of human traffic reports after an index refresh inflates page-view counts.

Frequently asked questions about AddSearchBot

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Addsearch operates it for customers using the AddSearch site-search product. The crawler fills and refreshes each customer's search index.

Related bots

AhrefsBot

Powers the database for both Ahrefs, a marketing intelligence platform, and Yep, an independent, privacy-focused search engine.

SEO

AhrefsSiteAudit

Powers Ahrefs’ Site Audit tool. Ahrefs users can use Site Audit to analyze websites and find both technical SEO and on-page SEO issues.

SEO

Barkrowler

Barkrowler is Babbar's web crawler that fuels and updates their graph representation of the web, providing SEO tools for the marketing community.

SEO

ClarityBot

ClarityBot is seoClarity's web crawler that performs technical SEO audits, analyzes content, and monitors website performance.

SEO

DataForSeoBot

DataForSeoBot is a backlink checker bot operated by DataForSEO that crawls websites to build and maintain their backlink database.

SEO

AddSearchBot