What is YGS Group Falconer Scraper?
YGS Group Falconer Scraper supports Falconer, a coverage discovery product presented by YGS Content Licensing. The supplied description limits the scraper to partners that have given permission for their sites to be scraped. This makes the expected scope contractual and targeted, rather than an open crawl of unrelated domains.
Falconer repeatedly checks selected publishers for new stories about a customer's brand. Its product page says machine learning scores the findings for sentiment and relevance, after which the service prepares briefs and can deliver them into Salesforce. The scraper supplies material to that monitoring workflow.
Cloudflare's bot directory records the full user agent as ygs-scraper-bot/1.0. Repeated requests to recent article pages can fit Falconer's stated discovery process, especially on an approved publisher domain. Requests outside the agreed host or content area should be compared with the partner arrangement instead of being accepted merely because the name looks familiar.
This traffic can affect what a Falconer customer sees in its media coverage feed. There is no supplied evidence that the scraper contributes to a public AI search engine or trains a general-purpose model. Calling it an AI crawler describes the machine-learning-supported workflow, not a documented training-data pipeline.
Robots.txt behavior is not established as cooperative. The bot metadata leaves respectsRobotsTxt unknown, and Cloudflare's bot directory marks followsRobotsTxt as false. A robots rule can record a site's preference, but permission scope and enforced access rules are the dependable controls.
Cloudflare's bot directory lists a Web Bot Auth directory at https://bot-signature.gregoryscottdev.com/.well-known/http-message-signatures-directory. Validating an HTTP Message Signature against that directory can establish that a request came from the registered bot infrastructure. It does not prove that a particular URL is covered by a publisher's agreement, so authorization still needs a separate check.
