What is Claude-User?
Claude-User is the identity Anthropic uses when Claude retrieves a webpage at a user's direction. A request can follow a question or another task in Claude that requires current content from a site. It is different from Claude-SearchBot, which supports search indexing, and ClaudeBot, which collects material that could be used for model training.
Because the fetch is tied to a user request, Claude-User normally visits a specific URL needed for that interaction rather than sweeping a site to build a general index. The page may then inform Claude's answer to that user. Seeing this agent in a log is evidence of user-directed retrieval, not proof that Anthropic is crawling the domain broadly.
Allowing Claude-User can make content available when Claude responds to a user-directed web query. Blocking it can prevent retrieval at that moment and may reduce visibility in those responses. This control is separate from model training: Anthropic assigns potential training collection to ClaudeBot, so a Claude-User visit alone does not mean the page entered a training dataset.
Anthropic says its bots aim to crawl with minimal disruption, honor standard robots.txt directives, and respect Crawl-delay where appropriate. The records used for this page nevertheless classify Claude-User's robots support as partial, while Cloudflare's directory marks it as not following robots.txt. Site owners who need a hard block should verify the observed behavior and enforce access at the server or edge rather than rely on a directive alone.
The stable token is Claude-User. Cloudflare's bot directory records two browser-style user agents, differing only in the capitalization of the contact address: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-User/1.0; [email protected]) and Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-User/1.0; [email protected]). This text is useful for log classification, but a user-agent header can be copied.
Anthropic also publishes source IP information for its crawlers, and Claude-User is marked as IP-verifiable. Check the source address as well as the header before treating a request as genuine. There is no Web Bot Auth signature directory listed for Claude-User.
Promptwatch counts Claude-User visits as citation crawls in your AI crawler logs, after checking the source against Anthropic's IP information. Pair them with prompt tracking to see which Claude answers ended up citing the page.
