Promptwatch Logo

Lumar

Lumar runs cloud-based crawls for sites selected by its customers and turns the fetched page data into private website analytics.
SEOLumar
SEO

What is Lumar?

Lumar runs cloud-based crawls for sites selected by its customers and turns the fetched page data into private website analytics. The service was previously named Deepcrawl, so current traffic may still carry that older name. It does not crawl the open web for a public search index.

A project can discover pages through site links or supplied sitemaps, render JavaScript when configured, and select a search-engine, browser, or custom user agent. Lumar says its own identifier remains in the request even when the crawler emulates another agent. Logs may therefore contain lumar, deepcrawl, or one of those strings appended to a longer browser-like header.

Customers set the crawl rate inside Lumar. The operator does not support the Crawl-delay directive, so changing that line in robots.txt will not slow the bot. If a crawl is putting pressure on the origin, the project owner should reduce its configured rate, while an unaffiliated site can use normal traffic controls.

Lumar now sells GEO analysis as part of its platform, but the crawler described here still gathers site data for the customer's reports. A fetch does not itself submit the page to an AI answer engine or a training corpus. Any later recommendation produced inside Lumar is separate from public indexing or citation.

Indirectly relevant

Is Lumar relevant for AI search?

Indirectly. Lumar has no AI product of its own, but its output can end up in the systems that AI answers draw on.

Lumar is an SEO auditing crawler. It has no direct effect on search rankings or AI answers, but the reports it feeds are used to fix crawlability and content issues that do affect how search and AI systems see your site.

How to handle Lumar

Leave Lumar available when your team expects a scheduled or one-off project crawl. If no authorized project should reach the site, cover both the present and legacy product tokens:

User-agent: lumar
Disallow: /

User-agent: deepcrawl
Disallow: /

Lumar says it obeys robots.txt, and this bot marks support as confirmed. The product can use an alternate robots configuration for an authorized test, so the person running the audit should keep its settings consistent with the site's policy.

Do not add Crawl-delay; Lumar explicitly says it is unsupported. Ask the project owner to lower the crawl rate or enforce a rate limit at the edge. For firewall allowlisting, consult Lumar's current official address list rather than copying an address from an old log.

Examples

  • An engineering team schedules a Lumar crawl during a quieter period and sets a rate that its origin can handle.
  • A long-standing customer sees `deepcrawl` at the end of a Googlebot-like header after the product's rename to Lumar.
  • A site that no longer uses Lumar blocks both documented product tokens so a legacy project cannot keep crawling.

Frequently asked questions about Lumar

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Deepcrawl was the service's previous name. Lumar keeps the legacy identifier in some user agents to avoid breaking customer configurations.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard