Promptwatch Logo

Kagi Bot

Kagi Bot is the web crawler for the Kagi search engine. It crawls the web to build its own search index, which supports its ad-free search product.
KagiKagibot
Search Engine Crawler

What is Kagi Bot?

Kagibot fetches web pages for Kagi's own search index. That index supports Kagi's ad-free search product, so this traffic belongs to a search indexing workflow rather than an ad crawler, preview generator, or user-triggered browser session.

Requests use a user agent such as Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot). Kagi publishes the crawler's current IP addresses and hostnames on that bot page. A user-agent match is useful for log filtering, while the published network details provide a stronger check when a request needs to be authenticated operationally.

Kagi documents an unusual robots fallback. A section addressed to Kagibot takes precedence, but when that section is absent the crawler follows directives written for Googlebot. Site owners who give Google broader access than other crawlers can therefore expose the same paths to Kagibot unless they add an explicit rule.

Being crawled can make a page eligible for Kagi's search index. It does not guarantee ranking, inclusion, or use in an AI-generated answer. Kagi's bot documentation also makes no claim that Kagibot gathers model-training data, so its impact should be described as Kagi search discovery rather than general AI visibility.

Relevant for AI search

Is Kagi Bot relevant for AI search?

Yes. Kagi Bot collects pages for an AI product, so what it can crawl influences how AI systems describe your brand.

Kagi Bot feeds a search index that also powers that engine's AI answer features and overviews. One crawl can serve a classic results page and a generated summary, so blocking it costs you both the rankings you would expect and a growing share of AI answers built on the same index.

How to handle Kagi Bot

Sites that want to participate in Kagi search can allow ordinary public pages and write narrower disallows for private, faceted, or expensive URLs. Add a dedicated Kagibot section if you do not want Kagi to inherit your Googlebot policy.

To block the crawler across the site, use its stable product token:

User-agent: Kagibot
Disallow: /

Kagi's official bot page says standard robots.txt directives are respected. The supplied directory record leaves this field unconfirmed, and the matching Cloudflare record marks it false, so the sources conflict. Check for requests to disallowed paths after deployment. Use an origin or edge rule if denial must be enforced rather than requested.

Examples

  • An independent publisher adds a Kagibot section that allows articles but excludes an internal calendar with effectively unlimited URL combinations.
  • A webmaster notices Kagibot following a permissive Googlebot rule and adds an explicit Kagi policy instead of changing Google crawling for the whole site.
  • A security analyst matches a claimed Kagibot request against the current IP and hostname list on Kagi's bot page before creating an allow rule.

Frequently asked questions about Kagi Bot

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Kagi operates it to crawl the web and build Kagi's own search index. The documented purpose is search indexing for Kagi's ad-free search product.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard