Promptwatch Logo

Kernel Browsers

Runs browser automation on behalf of Kernel customers for web agents, automations, and web scraping.
AI CrawlerUser Initiated

What is Kernel Browsers?

Kernel Browsers is browser infrastructure for web agents, customer automations, and scraping jobs. Kernel's own documentation calls its user-directed browser identity Kernel Agent and says it visits pages in response to an end user's request. It is not an automatic crawler with one shared indexing mission.

These sessions use a browser, so they may navigate, interact with controls, or operate inside an authenticated workflow when the customer has legitimate access. A Kernel visit can be part of many different tasks. The platform identity does not reveal the customer, the instruction, or what happens to retrieved material afterward.

Kernel documents a separate identity for Kernel Search. That crawler uses the KernelSearchBot token to build search indexes and retrieval databases, and it follows robots.txt for that token. This page covers the broader Kernel browser agent, whose record does not contain a stable user-agent token. The two identities should not be combined when writing access rules.

Nothing in the Kernel Browsers record says that these sessions collect a shared foundation-model training set or maintain a public AI search index. A customer's own agent may use page content during a task, but allowing Kernel does not by itself improve general AI search visibility. Blocking it can instead prevent a requested automation from completing.

Kernel identifies its agent with Web Bot Auth. Signed requests can be checked against https://www.kernel.sh/.well-known/http-message-signatures-directory, which Cloudflare also lists for the Kernel agent. This is stronger evidence than a browser user agent because the HTTP message signature can be verified cryptographically.

Robots behavior depends on which Kernel identity is present. Kernel promises robots compliance for KernelSearchBot, while Cloudflare's bot directory marks the user-directed Kernel agent as not following robots.txt. Since the browser agent has no dedicated token, control it by verified signature, authentication, and edge policy rather than inventing a robots.txt name.

Relevant for AI search

Is Kernel Browsers relevant for AI search?

Yes. Kernel Browsers collects pages for an AI product, so what it can crawl influences how AI systems describe your brand.

Kernel Browsers fetches, indexes, or retrieves pages for an AI product, so the pages it can reach shape how that system describes your brand and products.

How to handle Kernel Browsers

Do not add a KernelBrowsers robots.txt block. No such stable token is documented for the user-directed agent. Kernel's KernelSearchBot rule applies to its separate search crawler, not to every browser session on the platform.

For Kernel Agent traffic, read the Signature-Agent, Signature-Input, and Signature headers and verify them with the keys at https://www.kernel.sh/.well-known/http-message-signatures-directory. Allow, block, or rate limit the verified identity at your CDN or application boundary. Keep sensitive actions behind normal authentication and authorization even when a signature is valid.

Examples

  • A customer support agent uses a signed Kernel browser to open public troubleshooting pages. The site allows those requests but still requires login before account data is shown.
  • A publisher permits `KernelSearchBot` to index documentation yet blocks the separate Kernel Agent signature from interactive account routes.
  • A security team sees browser-like automation with no dedicated Kernel user-agent token and verifies the HTTP message signature before classifying it.

Frequently asked questions about Kernel Browsers

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Kernel operates the browser platform. Cloudflare links the agent entry to https://www.kernel.sh/docs, while individual sessions run on behalf of Kernel customers or their users.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard