Skip to main content
Cookbook SEO

Find and Fix Duplicate Content Issues with AI

Spot near-duplicate and thin pages that split your rankings, then canonicalize, noindex, or merge them safely.

Difficulty Intermediate
Time ~20 min
Tools run_wp_cli, rest_api

Prerequisites

A connected site and a recent backup before approving any merges or deletions.

The prompt
Find duplicate and near-duplicate content on [your-site-url] that may be splitting my search rankings. Start with diagnosis only. Do not change or delete anything yet.

1. Inventory my posts, pages, tags, and archives, and give me a list of pages that are near-duplicates or thin overlaps of each other. For each pair, show the URLs and say briefly why they look duplicative.

2. For each one, recommend the right fix: set a canonical tag from the weaker page to the one I want to rank, add noindex to a page that should stay out of search but remain for visitors, or merge two pages into one. Explain your choice.

3. Wait for my approval before doing anything. When I approve, apply the reversible fixes first (canonical tags and noindex). After each, re-check the live page and confirm the canonical or noindex tag is actually there.

4. Handle any merges or deletions one at a time, only after I confirm which page survives. Never delete a page without asking me first, and set up a redirect from any removed URL to its replacement.

I will take a full backup before approving any merges or deletions. Show me every change so I can spot-check it.

Already connected to WPVibe?

Skip the copy-paste. Just ask your AI for the “Find and Fix Duplicate Content Issues with AI” recipe, or describe the task, and WPVibe runs these steps on your own site.

Over years of publishing, sites accumulate pages that say almost the same thing: two service pages that overlap, a tag archive that mirrors a category, printer-friendly or parameter versions of the same post. Search engines then have to guess which one to rank, so they split the authority between them and often rank none of them well. You can feel the symptom (pages that should rank do not) without seeing the cause, because the duplicates are scattered across posts, pages, tags, and archives that you would never think to compare side by side.

Connected to your site, the AI inventories your content and flags pages that are near-duplicates or thin overlaps, then recommends the right fix for each: point a canonical tag from the weaker page to the one you want to rank, add noindex to a page that exists for visitors but should stay out of search, or merge two pages into one. It shows you the full list and its reasoning first and changes nothing until you approve each action. Canonical and noindex changes are reversible; merging or deleting is not, so it treats those as the careful case and asks before removing anything.

Take a backup before you run the fixes, because consolidating content can involve deleting or redirecting pages and you want a clean restore point. Start by asking only for the diagnosis and read the list before approving anything, since the “duplicate” it finds might be a page you deliberately keep separate. Apply canonicals and noindex first (they are safe and reversible), and handle any merges or deletions one at a time so you can confirm the surviving page is the right one.

Outcome

Duplicate pages are consolidated with canonical tags, noindex, or merges, each reversible fix verified in the live page output.