Promptwatch Logo

APIs-Google

Crawling preferences addressed to the APIs-Google user agent affect the delivery of push notification messages by Google APIs.
Google APIsAPIs-Google
Search Engine Crawler

What is APIs-Google?

APIs-Google delivers push notifications from Google APIs to application endpoints. Despite this directory entry's search-crawler category, the documented request is a webhook delivery, not a page-discovery crawl. Developers use the notifications so an application can react to changes without repeatedly polling Google's servers.

Google requires a developer to prove control of a domain before registering a URL on that domain as a notification destination. Once configured, APIs-Google sends the message to the registered HTTPS endpoint. This explains why a domain administrator may see the user agent even though no public page was submitted for indexing.

The official APIs-Google documentation says each notification is an HTTPS POST and the receiving site needs a valid SSL certificate. Temporary delivery failures cause retries with exponential backoff, potentially continuing for several days. A broken route can therefore produce recurring requests without any crawl of neighboring URLs.

Robots support is specific. APIs-Google does not use rules written for Googlebot, and Google's special-crawler table says it ignores the global * group. It does honor rules addressed directly to APIs-Google, which is why this file records respectsRobotsTxt: true. A wildcard-only policy does not control this sender.

There is no search-index or AI-training consequence to document for these webhook requests. Blocking APIs-Google interrupts delivery of configured Google API notifications. It does not opt a site out of Google Search, AI Overviews, Gemini grounding, or model training.

The full recorded header is APIs-Google (+https://developers.google.com/webmasters/APIs-Google.html). Cloudflare's bot directory marks followsRobotsTxt as false, which differs from Google's documented support for a dedicated group and may reflect the ignored wildcard. No Web Bot Auth signature URL or verified IP flag is present, so do not authenticate a notification from the user-agent string alone.

Relevant for AI searchAI Overviews

Is APIs-Google relevant for AI search?

Yes. APIs-Google feeds AI Overviews, so the pages it can reach shape what those AI products say about you.

APIs-Google feeds a search index that also powers that engine's AI answer features and overviews. One crawl can serve a classic results page and a generated summary, so blocking it costs you both the rankings you would expect and a growing share of AI answers built on the same index.

How to handle APIs-Google

If the endpoint belongs to an active integration, keep it available over HTTPS and handle notification retries safely. When the requests are unexpected, first find the application or subdomain owner that registered the callback and disable the notification subscription at its source. That prevents the sender from continuing a delivery job that the server rejects.

Google documents this targeted block:

User-agent: APIs-Google
Disallow: /

A User-agent: * rule is not enough. Google says there can be a short delay before APIs-Google notices a robots.txt change; if messages still arrive several days later, check the file's host and location. Use an application or edge denial when the endpoint must stop accepting requests immediately, and expect failed deliveries to retry.

Examples

  • An application receives an HTTPS POST from APIs-Google after a watched resource changes, avoiding a constant polling loop.
  • A domain administrator traces unexpected notifications to an application owned by a separate subdomain team and asks that team to unregister the callback.
  • An engineer adds a dedicated APIs-Google rule because the site's existing wildcard disallow does not apply to this sender.

Frequently asked questions about APIs-Google

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Its documented function is delivering Google API push notifications to registered HTTPS endpoints. It does not discover pages for a search index.

Related bots

AdIdxBot

An AdIdxBot visit usually starts with a Bing Ads workflow rather than an organic search crawl.

Search Engine Crawler

Adsense

The AdSense crawler visits participating sites in order to provide them with relevant ads.

Search Engine Crawler

Algolia

The Algolia Crawler extracts content from your site and makes it searchable.

Search Engine Crawler

Amazon AdBot

Amazon AdBot scans pages that request ads from Amazon's advertising systems.

Search Engine Crawler

Amazon Product Discovery

Amazon Product Discovery collects public product details from Amazon selling-partner, brand, and retailer websites.

Search Engine Crawler

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard