Promptwatch Logo

Amazon Q

Amazon Q Business is a generative artificial intelligence (generative AI)-powered assistant that you can tailor to your business needs.
AI Assistant

What is Amazon Q?

Amazon Q Business is a generative AI assistant that an organization can configure around its own information. The Web Crawler connector is one of the data sources available to that assistant. It gathers pages selected by the organization and adds them to the application's searchable content.

The connector accepts public sites and internal company sites over HTTPS. A customer can start from URLs or sitemaps, and AWS documents authentication and proxy options for content that is not openly reachable. AWS also requires customers to crawl only their own pages or pages they have permission to index.

An Amazon Q request therefore points to a particular customer's configuration. It is not evidence that Amazon has chosen the page for a public web index. The content may later be used to answer questions from people who have access to that customer's Q Business application.

This has a narrow visibility effect. Blocking the crawler can keep a page out of the relevant organization's assistant, but it does not lower the page in Google, Bing, or public AI search. AWS presents the crawl as retrieval-data ingestion and does not document it as a foundation-model training crawl.

AWS's robots documentation currently names amazon-QBusiness for its Web Crawler. The stored bot record does not define a stable user-agent token, and there is no matching Cloudflare directory entry or Web Bot Auth key URL. Confirm the live request against the current AWS connector documentation before making an identity-based firewall exception.

AWS now notes that Amazon Q Business is no longer open to new customers. Existing applications and configured web data sources can still account for this traffic, so the product status alone is not a reason to label a request fake. The application owner should be able to identify the data source and its authorized scope.

Relevant for AI searchAmazon Q

Is Amazon Q relevant for AI search?

Yes. Amazon Q feeds Amazon Q, so the pages it can reach shape what those AI products say about you.

Amazon Q crawls and indexes pages so the AI search or assistant behind it can retrieve them at answer time. A page it has never fetched cannot be quoted, summarized, or linked in that product's answers, so most sites keep it allowed to stay citable. Blocking it removes your pages from that AI surface and hands those citations to competitors.

How to handle Amazon Q

Amazon Q Business Web Crawler respects standard robots.txt Allow and Disallow rules. AWS documents its current syntax on the Amazon Q crawler control page.

Do not derive a robots.txt token from the display name. this bot has no stable token, so a guessed AmazonQ group could miss the crawler or affect an unrelated client. Use the exact token from the AWS documentation that applies to the connector you are investigating.

If the crawl belongs to your organization's Q Business application, allow only the paths intended for that knowledge source and keep normal authentication in place. If nobody can account for the configuration, block the request at the edge and ask the claimed customer to establish authorization.

Examples

  • An IT team connects an internal HTTPS policy site to Amazon Q Business so employees can ask questions against the approved documents.
  • A vendor allows a customer's Q crawler to index a dedicated support section but excludes contractual and account pages.
  • A webmaster receives an Amazon Q request with an unfamiliar user agent and checks the customer's data-source configuration before creating a firewall exception.

Frequently asked questions about Amazon Q

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

It crawls HTTPS pages selected as a data source by an Amazon Q Business customer. Those pages are indexed for search and answers in that customer's application.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard