What it does

The "Prevent duplicate posts" setting in the Moderate and Filter panel detects and removes posts with nearly identical text across different sources in your feed. When duplicates are found, Juicer keeps one version and hides the rest.

How duplicates are detected

Juicer uses two methods to detect duplicates:

1. Text similarity matching

Two posts are considered duplicates when their text content is 90% or more similar (after stripping HTML and normalizing whitespace). This is the primary detection method and works across different social media platforms.

2. Same post from the same platform

If the same post appears through multiple sources on the same platform (e.g., the same Instagram post pulled in via two different Instagram sources), Juicer automatically detects it as a duplicate—even if the post has no text.

⚠️ Important limitation

Text similarity matching works on text content only. Posts without text (image-only or video-only posts) are not checked for text-based duplicates. Juicer does not compare images or videos. However, identical posts from the same platform are still caught by the external ID check described above.

Which post is kept?

When duplicates are found, Juicer decides which post to keep based on the deduplication strategy set for your feed:

Prioritize top source (default)

Keeps the post from the highest-priority source. Source priority is determined by the order of your sources in the Social Media Sources panel—sources at the top have higher priority. You can drag and drop sources to change the order.
Balance across sources

Instead of always favoring the top source, this strategy keeps the version from whichever source currently has fewer visible posts in your feed. This helps ensure a more even mix of content from all your sources.

Expected behavior when cross-posting

If you post the same content to multiple social media channels (e.g., Facebook, Instagram, and LinkedIn), and you have all three as sources in your Juicer feed, the deduplication feature will keep only one version of each cross-posted item. This is expected behavior.

You cannot show the same post from all three sources and also prevent duplicates—these are mutually exclusive goals. The feature is specifically designed to hide the redundant copies.

When does it run?

Deduplication runs when you save your moderation settings or when posts are revalidated. It checks the most recent 100 posts in your feed. Since it processes a limited batch, running it multiple times may catch additional duplicates.