Top Crawler Pages
Get top pages requested by crawlers. Projects with no recorded crawler logs return an empty array.
Authorizations
API key for authentication. Get yours from the Promptwatch dashboard under Settings > API Keys.
Query Parameters
Start date for analytics data (YYYY-MM-DD). Max range 90 days.
End date for analytics data (YYYY-MM-DD). Max range 90 days.
Filter by crawler(s). Repeat for multiple: crawlers=openai-gptbot&crawlers=perplexity-bot. Allowed: openai-gptbot, openai-searchbot, openai-chatgpt-user, openai-adsbot, anthropic-claudebot, anthropic-claude-user, anthropic-claude-search-bot, anthropic-claude-web, anthropic-ai, perplexity-bot, perplexity-user, cohere-ai, mistral-ai-user, mistral-ai-index, deepseek-bot, x-ai-grok-bot, x-ai-grok-search, x-ai-grok-deep-search, google-extended, google-mobile-agent, google-desktop-agent, meta-web-indexer, meta-external-agent, meta-external-fetcher, meta-facebook-bot. If omitted, crawler activity trend uses every known key above; other operations that support this field may apply no per-crawler filter in the data store.
openai-gptbot, openai-searchbot, openai-chatgpt-user, openai-adsbot, anthropic-claudebot, anthropic-claude-user, anthropic-claude-search-bot, anthropic-claude-web, anthropic-ai, perplexity-bot, perplexity-user, cohere-ai, mistral-ai-user, mistral-ai-index, deepseek-bot, x-ai-grok-bot, x-ai-grok-search, x-ai-grok-deep-search, google-extended, google-mobile-agent, google-desktop-agent, meta-web-indexer, meta-external-agent, meta-external-fetcher, meta-facebook-bot IANA timezone for date bucketing (e.g., 'America/Los_Angeles')
Filter by specific page path
Path matching mode: 'exact' for exact match, 'partial' for prefix match (default: 'partial')
exact, partial Response
Default Response