Promptwatch Logo

Amazon Product Discovery

Amazon's web crawler used to collect publicly available product details from Amazon Selling Partner websites to help improve the accuracy and completeness of product information on Amazon.
UnverifiableAmazon
E-commerceSearch Engine Crawler

What is Amazon Product Discovery?

Amazon Product Discovery is Amazon's search engine crawler. Amazon's web crawler used to collect publicly available product details from Amazon Selling Partner websites to help improve the accuracy and completeness of product information on Amazon. This helps ensure that Amazon customers see correct and complete information to help them in their shopping journey.

Amazon Product Discovery powers a search engine, and search indexes increasingly feed AI answers and overviews alongside classic results. The pages it can crawl are the pages eligible to rank and to be pulled into AI-generated summaries, so allowing it protects both your SEO and your AI search visibility.

Like any automated client, Amazon Product Discovery consumes crawl budget and appears in your server and CDN logs. Reviewing those logs alongside your robots.txt rules helps you keep automated traffic deliberate and easy to reason about.

Want to see every AI bot hitting your site? Promptwatch turns your server and CDN logs into a live view of AI crawler and agent traffic, so you can watch ChatGPT, Claude, Perplexity, Gemini, and others crawl your pages and connect those visits to real citations and revenue. Learn more in AI crawler logs.

See every AI bot hitting your site

Promptwatch turns your server and CDN logs into a live view of AI crawler and agent traffic. Watch ChatGPT, Claude, Perplexity, Gemini, and more crawl your pages in real time, see exactly what they take, and connect every crawl to the citations and revenue it drives.

How to handle Amazon Product Discovery

Most sites keep Amazon Product Discovery allowed, because blocking it can remove your pages from the AI answers and search results it powers. Only disallow it if you specifically want to opt out of that surface.

To control Amazon Product Discovery, add a rule for its user agent to your robots.txt:

User-agent: AmazonProductDiscovery
Disallow: /

Replace the user-agent token above with the exact string Amazon Product Discovery sends, check the operator's documentation, since display names and user-agent tokens can differ.

Amazon Product Discovery generally honors robots.txt directives.

Examples

  • After publishing a new comparison page, a marketer checks whether Amazon Product Discovery has fetched it so the content can appear in AI answers.
  • An SEO lead keeps Amazon Product Discovery allowed in robots.txt to preserve visibility in AI-powered search.

Related bots

Amazon Seller Initiated Listing

Amazon's web crawler that helps sellers succeed by giving them the option to provide a URL to a website and create high-quality product pages in Amazon's store.

E-commerce

AdIdxBot

AdIdxBot is the crawler used by Bing Ads for quality control of ads and their destination websites. It has multiple user agent variants including desktop, iPhone, and Windows Phone versions.

Search Engine Crawler

Adsense

The AdSense crawler visits participating sites in order to provide them with relevant ads.

Search Engine Crawler

Algolia

The Algolia Crawler extracts content from your site and makes it searchable.

Search Engine Crawler

Amazon AdBot

Amazon AdBot is a crawler used by different advertising services at Amazon to determine a website's content in order to provide relevant and appropriate advertising.

Search Engine Crawler

Frequently asked questions about Amazon Product Discovery

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Amazon Product Discovery is operated by Amazon. It functions as Amazon's search engine crawler.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard