Who operates New York Times Newsgathering?

New York Times Newsgathering is operated by The New York Times. It functions as The New York Times's content aggregator.

Does New York Times Newsgathering respect robots.txt?

The New York Times has not published a robots.txt commitment for New York Times Newsgathering. Treat its behavior as unconfirmed and watch your access logs to see whether your rules are honored.

Should I block New York Times Newsgathering?

It depends on your distribution strategy. Keep New York Times Newsgathering allowed to reach the audiences it serves, or disallow it to keep readers on your own site.

New York Times Newsgathering - What It Is & How to Handle It

What is New York Times Newsgathering?

New York Times Newsgathering is The New York Times's content aggregator. Coders within NYT's newsroom collect public, non-copyright data, e.g. our U.S. Elections pages and Covid-19 trackers.

New York Times Newsgathering collects and redistributes content from across the web, so pages it can reach may be surfaced to audiences well beyond your own site. Aggregated copies also become part of the corpus AI systems draw on, which makes it worth knowing what New York Times Newsgathering takes and how often.

Like any automated client, New York Times Newsgathering consumes crawl budget and appears in your server and CDN logs. Reviewing those logs alongside your robots.txt rules helps you keep automated traffic deliberate and easy to reason about.

Want to see every AI bot hitting your site? Promptwatch turns your server and CDN logs into a live view of AI crawler and agent traffic, so you can watch ChatGPT, Claude, Perplexity, Gemini, and others crawl your pages and connect those visits to real citations and revenue. Learn more in AI crawler logs.

See every AI bot hitting your site

Promptwatch turns your server and CDN logs into a live view of AI crawler and agent traffic. Watch ChatGPT, Claude, Perplexity, Gemini, and more crawl your pages in real time, see exactly what they take, and connect every crawl to the citations and revenue it drives.

How to handle New York Times Newsgathering

Allow New York Times Newsgathering if you want your content distributed through the feeds and apps it supplies. Disallow it if you would rather people reach that content only on your own site.

New York Times Newsgathering does not publish a stable user-agent token, so identify it by the request patterns and source addresses in your logs before deciding whether to allow or block it.

The New York Times does not publish a robots.txt commitment for New York Times Newsgathering, so confirm how it behaves by watching your access logs.

Examples

A publisher checks how often New York Times Newsgathering pulls new articles and whether the aggregated version links back to the original.
An editor keeps New York Times Newsgathering allowed so new posts reach the readers of the apps it supplies.