Promptwatch Logo

MotoMinerBot

MotoMinerBot moves vehicle detail pages from dealership websites into MotoMiner's search index.
MotominerMotoMinerBot
Aggregator

What is MotoMinerBot?

MotoMinerBot moves vehicle detail pages from dealership websites into MotoMiner's search index. MotoMiner says it focuses on dealer sites and does not crawl listing services such as AutoTrader, Cars.com, CarGurus, or Craigslist.

The index is a conventional vehicle search service. MotoMiner does not say that MotoMinerBot gathers language-model training data or supplies a generative answer engine. Its direct effect is whether dealership inventory can be found through MotoMiner, not whether the dealer appears in AI search.

Once indexed, a vehicle can appear in MotoMiner search with information about the listing and a deep link to the dealer's page. The crawler also revisits the web for new sites, changed inventory, new detail-page URLs, and dead links so the index can be updated.

MotoMiner designed the crawler to limit what it downloads. It supports gzip, does not load scripts or unnecessary images, and may fetch the primary vehicle image to create a cached thumbnail. The user agent includes MotoMinerBot and a link to the operator's bot page; MotoMiner also publishes the crawler's current IP address.

Indirectly relevant

Is MotoMinerBot relevant for AI search?

Indirectly. MotoMinerBot has no AI product of its own, but its output can end up in the systems that AI answers draw on.

MotoMinerBot collects content from many sites and redistributes it through its own product. Aggregated copies can end up in datasets that AI systems later learn from, and some aggregators are themselves sources that AI answer engines draw on.

How to handle MotoMinerBot

Dealers that want MotoMiner referrals should allow the public vehicle detail pages and their primary images. A complete block can keep new stock out of the index and prevent MotoMiner from noticing that an old vehicle URL is dead.

MotoMiner explicitly follows robots.txt. Its documented full block is:

User-agent: MotoMinerBot
Disallow: /

Use narrower rules for sections outside the inventory, or set Crawl-delay when request pacing is the problem. For a stricter allowlist, compare the source address with the current IP published on MotoMiner's bot page rather than trusting the user agent alone.

Examples

  • A dealer publishes a used vehicle and later sees MotoMinerBot request the detail page and its primary image for a search result thumbnail.
  • A hosting provider for several dealerships uses `Crawl-delay` to reduce request pressure without removing vehicle pages from MotoMiner.

Frequently asked questions about MotoMinerBot

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

It looks for vehicle detail pages on dealership websites. MotoMiner says it does not crawl the named vehicle listing and classified services.

Related bots

AirsoftdbBot

Airsoftdb is a search engine for airsoft prod.

Aggregator

Artsdata Crawler

Web crawler that collects publicly available LOD for arts and culture in Canada.

Aggregator

BestChange Bot

The BestChange bot downloads exchange rate information from 600 websites every 5 seconds.

Aggregator

BoardGamePrices Bot

Price comparison site for board games. Need to crawl store pages for participating stores. All stores give permission to be crawled.

Aggregator

Capital One Bot

Capital One Bot crawls dealer websites for getting the usage information for Capital One lead navigator button.

Aggregator

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard