Promptwatch Logo

Marfeel Flowcards Crawler

Marfeel's crawler that fetches content for Flowcards that load directly from specific URLs.
Marfeel
Preview

What is Marfeel Flowcards Crawler?

Marfeel Flowcards Crawler retrieves content for a Flowcard configured to load from a particular URL. Marfeel's crawler documentation identifies this traffic with mrfCompass-Jukebox/1.0 inside a mobile browser-style user agent.

This is a targeted fetch tied to a Flowcard, not open-web discovery. Marfeel says the Flowcards crawler uses the origin's cache-control header to decide when to fetch again. Its wider crawler policy also says Marfeel visits canonical URLs and their AMP counterparts, caches assets centrally, and does not proactively search sites for new content.

A successful request lets the configured Flowcard obtain the source it needs. It has no documented role in general AI search, citations, or foundation-model training. Blocking it can leave that Flowcard without current content, but it does not opt a site out of unrelated AI systems.

The bot record says Marfeel Flowcards Crawler respects robots.txt. Marfeel publishes a reverse and forward DNS verification procedure for addresses under crawler.marfeel.com; use that check before making an allowlist exception. The readable crawler name in this file is not the token sent in requests.

Indirectly relevant

Is Marfeel Flowcards Crawler relevant for AI search?

Indirectly. Marfeel Flowcards Crawler has no AI product of its own, but its output can end up in the systems that AI answers draw on.

Marfeel Flowcards Crawler fetches pages to build link-preview cards. It does not feed an AI index, but it reads the same Open Graph and structured metadata that AI systems parse to understand your pages, so clean preview metadata doubles as AI-friendly metadata.

How to handle Marfeel Flowcards Crawler

If your site supplies a Marfeel Flowcard, allow the exact public paths that card reads and return useful cache headers. A complete robots.txt block for the token in Marfeel's current documentation is:

User-agent: mrfCompass-Jukebox
Disallow: /

The bot record marks this crawler as respecting robots.txt. If a required Flowcard remains stale, check the canonical URL, response status, cache policy, and WAF logs before opening broader access.

For a firewall allowlist, verify the source with Marfeel's published reverse and forward DNS method. Do not exempt private routes just because a request contains mrfCompass-Jukebox.

Examples

  • A publisher configures a Flowcard to read a live story URL, and `mrfCompass-Jukebox` fetches that source when the card needs content.
  • A page returns a longer `cache-control` lifetime, so Marfeel can reuse the fetched Flowcard content before checking it again.
  • An operations team verifies `crawler.marfeel.com` with forward-confirmed reverse DNS before allowing the crawler through its WAF.

Frequently asked questions about Marfeel Flowcards Crawler

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

It fetches a specific URL used as the direct content source for a Marfeel Flowcard. Marfeel does not describe it as a general discovery crawler.

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard