Visible Amsterdam: Join us Sep 3
Promptwatch Logo
Back to all integrations

Connect Cloudflare to Promptwatch

Ingest crawler logs via Logpush or an auto-deployed Cloudflare Worker.
Setup Guide

Overview

Cloudflare sits in front of your website and sees every request, including visits from AI crawlers like GPTBot, ClaudeBot, and PerplexityBot. Connect Cloudflare to Promptwatch and those requests flow straight into your crawler analytics: timestamps, URLs, status codes, and user agents for every AI crawler hit, classified across 25+ known AI bots.

There are two ways to connect. On Cloudflare Enterprise, a native Logpush job streams the HTTP Requests dataset directly to Promptwatch. On any other plan, a lightweight Cloudflare Worker forwards AI crawler requests — and Promptwatch can deploy and configure that Worker for you automatically using a temporary Cloudflare API token that is used once and never stored.

Once connected, the Crawler Logs dashboard separates training crawls (GPTBot, ClaudeBot) from search indexing (OAI-SearchBot) and citation fetches — the requests ChatGPT, Claude, and Perplexity make when a user clicks your link in an AI answer. Guided setups are also available for WP Engine, Kinsta, Webflow, and Shopify sites running behind Cloudflare.

Two connection paths

Native Logpush on Enterprise, or a lightweight Worker on any Cloudflare plan.

Automated Worker deploy

Promptwatch deploys and configures the Worker for you; the temporary token is never stored.

Citation visits included

See ChatGPT, Claude, and Perplexity citation fetches separately from training crawls.

How it works

  1. 1.Pick your path: a Logpush job on Cloudflare Enterprise, or a Cloudflare Worker on any plan.
  2. 2.For the Worker, paste a temporary Cloudflare API token and Promptwatch finds your zone, uploads the script, and configures the route automatically — or follow the manual guide.
  3. 3.Make sure your DNS records are proxied (orange cloud) so traffic passes through Cloudflare.
  4. 4.Open the Crawler Logs dashboard: AI crawler visits appear within minutes.

More Crawler Logs integrations

All Integrations

AWS CloudFront

Stream CloudFront access logs through Kinesis Data Firehose.

Fastly

Forward Fastly CDN logs to Promptwatch in real time.

Vercel

Send Vercel log drains straight to your crawler analytics.

Netlify

Connect Netlify log drains for AI crawler insights.

Akamai

Stream Akamai edge logs via DataStream.

Google Cloud CDN

Deliver Cloud CDN logs through Pub/Sub.

Custom HTTP

Push logs from any stack to our HTTP ingest endpoint.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard