Promptwatch Logo

Epivoz Crawler

News aggregator needs to crawl news/blog articles to generate short summaries for page preview of attributed links.
TechmemeEpivozCrawler
Aggregator

What is Epivoz Crawler?

The supplied bot record identifies Epivoz Crawler as a Techmeme news-aggregation client. It fetches news stories and blog posts so the service can produce a short preview next to an attributed link. The known request identity is EpivozCrawler/1.7.

Techmeme has separately explained why its crawler needs article text. Its algorithms analyze that text to alert editors to stories and help organize the home page. Techmeme also says it deliberately avoids sections of some large publications that rarely cover technology, so the crawl is shaped by the site's editorial subject rather than by a goal of indexing the whole web.

Public Techmeme material does not name EpivozCrawler, publish an IP range, or define a crawl schedule for this identifier. The user-agent record is therefore useful for classification, but it is not enough to authenticate a request. Publishers should inspect the requested article paths and their own referral relationship with Techmeme.

No source ties Epivoz Crawler to model training or a general AI answer engine. Fetching article text for news selection and link previews is an aggregation use. Blocking it can reduce or prevent a publisher's appearance on Techmeme, but it does not directly change eligibility for AI search.

Indirectly relevant

Is Epivoz Crawler relevant for AI search?

Indirectly. Epivoz Crawler has no AI product of its own, but its output can end up in the systems that AI answers draw on.

Epivoz Crawler collects content from many sites and redistributes it through its own product. Aggregated copies can end up in datasets that AI systems later learn from, and some aggregators are themselves sources that AI answer engines draw on.

How to handle Epivoz Crawler

Allow the article fetches if inclusion and referral traffic from Techmeme are useful to the publication. If requests are unexpected, compare them with the EpivozCrawler/1.7 signature and ask Techmeme about the source before allowlisting it.

The stable identifier supports this robots.txt rule:

User-agent: EpivozCrawler
Disallow: /

The supplied record marks robots compliance as false, and Techmeme has not published an Epivoz-specific robots policy. Treat the stanza as a preference. Use a server or CDN rule for a definite block, then check whether Techmeme stops seeing the publication's stories.

Examples

  • A technology publication sees `EpivozCrawler/1.7` reading newly posted articles and keeps those paths open because Techmeme sends readers back through attributed links.
  • A publisher receives repeated Epivoz requests outside its technology section, applies a path-specific edge rule, and contacts Techmeme with timestamps for review.

Frequently asked questions about Epivoz Crawler

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

The supplied record says it reads news and blog articles for short previews attached to attributed links in a news aggregator.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard