What information can the scraper extract?

The agency names product descriptions, quantities, sizes, and prices as examples. The exact fields depend on the statistical collection.

How is StatistikAustria identified?

Look for `StatistikAustria` in the user-agent header. The supplied record gives a browser-compatible example containing `StatistikAustria/1.0`.

What limits does Statistics Austria place on its scrapers?

They should identify themselves, avoid harming site performance, and must not bypass captchas or IP blocks. The agency also says scraping must not duplicate a provider's database for publication elsewhere.

Does StatistikAustria affect AI search or training?

No documented use ties the crawler to either one. It collects price data for official statistical work.

StatistikAustria & AI Search: What to Know

What is StatistikAustria?

Austria's official price statistics include data collected from public websites, and StatistikAustria is the identifier attached to that automated work. Statistics Austria uses web scraping where online product ranges are too large for practical manual collection. The programs extract defined fields such as descriptions, quantities, sizes, and prices into structured records.

Statistics Austria writes these scrapers in R and Python and monitors them for website changes. Data gathered this way has contributed to official price indices since 2021 in selected areas. Current examples in the agency's documentation include clothing, electricity and gas tariffs, municipal charges, and mobile phone plans. Some collected values are also used to check the plausibility of other price data.

The published user-agent example contains StatistikAustria/1.0 in a browser-compatible string. Statistics Austria says its collection programs should use a fixed, recognizable identity. Its rules also say they must not bypass captchas or IP blocks, duplicate a provider's database for republication, or impair the provider's infrastructure.

This is an official-statistics workflow, not a shopping index or an AI crawler. Statistics Austria does not connect these requests with generative search or model training. Allowing or denying the bot changes whether a site's public prices can enter this collection, not whether the site can appear in AI answers.

Indirectly relevant

Is StatistikAustria relevant for AI search?

Indirectly. StatistikAustria has no AI product of its own, but its output can end up in the systems that AI answers draw on.

StatistikAustria collects content from many sites and redistributes it through its own product. Aggregated copies can end up in datasets that AI systems later learn from, and some aggregators are themselves sources that AI answer engines draw on.

How to handle StatistikAustria

Allow the requests if public prices on the site may be sampled for Austrian statistics. Check that the traffic contains the documented identifier and is confined to relevant public product or tariff pages before making an exception.

The fixed token can be addressed in robots.txt:

User-agent: StatistikAustria
Disallow: /

Statistics Austria does not publish a robots.txt commitment for this scraper. It does state that its programs must not work around captchas or IP blocks, so use an edge or origin rule when the restriction must be enforced. A block can remove the site's prices from this statistical source.

Examples

A clothing retailer sees `StatistikAustria/1.0` reading public product pages and confirms that the requests stay within the catalog rather than entering customer accounts.
A tariff site declines automated collection, blocks the documented user agent at the edge, and verifies that the crawler does not attempt to bypass that restriction.

Frequently asked questions about StatistikAustria

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Online assortments can be too large for manual price collection. Statistics Austria uses scrapers to record defined product and price fields for official statistics.