Promptwatch Logo

Marfeel Social Crawler

Marfeel's crawler used for social experiences (Facebook, X/Twitter, Telegram, Reddit, LinkedIn).
Marfeel
Social MediaPreview

What is Marfeel Social Crawler?

Facebook, X, Telegram, Reddit, and LinkedIn experiences inside Marfeel use Marfeel Social Crawler to retrieve page content. Marfeel documents the identifying token as mrfCompass-Social/1.0 within a Linux Chrome-style user agent.

This request comes from Marfeel's social workflow, not directly from the named social network. Marfeel says these social experiences use its public crawler addresses. Its general crawler rules limit work to URLs with active users, prefer canonical URLs and AMP counterparts, and reuse cached assets across services.

Blocking mrfCompass-Social can stop Marfeel from obtaining the source needed for those experiences. It does not set a policy for Facebook, X, or any other platform's own crawler. Each outside service may make separate requests under a different identity.

The crawler has no stated AI search or model-training purpose. Its effect is confined to Marfeel's social presentation workflow. this bot says it respects robots.txt, while Marfeel's documentation provides reverse and forward DNS verification through crawler.marfeel.com for stronger identification.

Indirectly relevant

Is Marfeel Social Crawler relevant for AI search?

Indirectly. Marfeel Social Crawler has no AI product of its own, but its output can end up in the systems that AI answers draw on.

Marfeel Social Crawler fetches pages to build link-preview cards. It does not feed an AI index, but it reads the same Open Graph and structured metadata that AI systems parse to understand your pages, so clean preview metadata doubles as AI-friendly metadata.

How to handle Marfeel Social Crawler

Sites using Marfeel social experiences should leave their intended public articles reachable and make canonical metadata available in the initial response. To refuse this crawler, target Marfeel's documented token:

User-agent: mrfCompass-Social
Disallow: /

The bot record marks Marfeel Social Crawler as following robots.txt. A rule for this token does not block the native crawlers operated by Facebook, X, Telegram, Reddit, or LinkedIn.

When granting a WAF exception, confirm that reverse DNS points to crawler.marfeel.com and that a forward lookup returns the source address. Do not use the user-agent text alone as proof.

Examples

  • A Marfeel customer prepares a LinkedIn experience, and `mrfCompass-Social` retrieves the article's canonical URL.
  • A publisher blocks Marfeel Social Crawler while leaving the separate native Facebook crawler untouched.
  • An analyst separates a Marfeel social fetch from traffic sent by Reddit because the request carries `mrfCompass-Social/1.0`.

Frequently asked questions about Marfeel Social Crawler

Learn about AI visibility monitoring and how Promptwatch helps your brand succeed in AI search.

Marfeel lists social experiences for Facebook, X, Telegram, Reddit, and LinkedIn. The request itself is made by Marfeel.

Related bots

Marfeel Audits Crawler

Marfeel's audit crawlers that periodically re-crawl traffic-receiving URLs to detect structured data, meta tags, and HTML issues.

SEO

Marfeel Flowcards Crawler

Marfeel's crawler that fetches content for Flowcards that load directly from specific URLs.

Preview

Marfeel Preview Crawler

Marfeel's previewer crawler used to render preview experiences for both mobile and desktop views.

Preview

Buffer Link Preview Bot

Helps Buffer users create better social media posts by generating rich previews when they share links

Preview

Chrome Privacy Preserving Prefetch Proxy

Chrome's Privacy Preserving Prefetch Proxy service that fetches /.well-known/traffic-advice to enable privacy-preserving prefetch hints.

Preview

Be the brand AI recommends

Monitor your brand's visibility across ChatGPT, Claude, Perplexity, and Gemini. Get actionable insights and create content that gets cited by AI search engines.

Promptwatch Dashboard