Performance and Duplication
Duplicate Content Find It Fix It Prevent It
Duplicate content wastes crawl budget and splits ranking signals across multiple URLs, and most of it on a typical site is created accidentally through technical configuration rather than copied text.
Reading time · unlocks the next lesson
0:00 / 5:00 · pausedHow duplicate content typically arises
The most common source is technical, not editorial: URL parameters for tracking or sorting, separate mobile subdomains serving the same content as the main domain, HTTP and HTTPS both resolving without a redirect, and www versus non-www versions both being live. Ecommerce sites also commonly generate duplicates through faceted navigation, where filter combinations create near-infinite URL variants of the same underlying product list.
Editorial duplication also happens, most often through syndicating the same article to multiple publications or internal sections without any canonical or attribution signal pointing back to the original source.
Fixing each type of duplication
For protocol and subdomain duplicates (HTTP/HTTPS, www/non-www), implement a single sitewide 301 redirect rule so only one canonical version is ever reachable; this is a server-configuration fix, not a per-page one. For parameter-driven duplicates, use canonical tags pointing to the clean URL and configure the platform to avoid generating indexable parameterised URLs in the first place.
For syndicated content, always include a canonical tag on the syndicated copy pointing back to the original article's URL, which tells Google which version should rank and avoids the syndicated copy competing with the source.
- Force a single protocol and subdomain via sitewide redirect
- Canonicalise parameterised and faceted-navigation URLs
- Point syndicated content's canonical back to the original
- Use robots.txt or meta robots to block low-value filter combinations
Preventing new duplication
Configure the CMS or platform so that new URL variants are not created and indexed by default, for example by disabling automatic tag or attachment archive pages that duplicate post content, or by setting faceted navigation filters to noindex beyond a defined depth. Review the XML sitemap periodically to confirm it only lists canonical, indexable URLs, since including duplicate or non-canonical URLs in the sitemap sends a contradictory signal to Google.
Finding duplicates in RankAudit
RankAudit's Duplicate Content report clusters crawled pages by text similarity above a configurable threshold and separately flags protocol, subdomain and parameter-based technical duplicates found during the crawl. Resolve technical, server-level duplicates first, since a single redirect rule fix there often eliminates hundreds of duplicate URLs in one pass.
Key takeaways
- ✓Most duplication is technical: protocols, parameters, subdomains
- ✓Force one canonical version with a sitewide redirect rule
- ✓Canonicalise syndicated content back to the original source
- ✓Keep the XML sitemap limited to canonical, indexable URLs
Why this lesson matters
This lesson belongs to Performance and Duplication, the part of On-Page SEO where the goal is: diagnose the page-experience and duplication issues that quietly suppress rankings sitewide.
Read it once, then do it straight away on a real site inside RankAudit. Nothing here is theory for its own sake — every step produces something you can show a client.
Do it now
- 1Open RankAudit with sample data already loaded, so you are not stuck on setup.
- 2Crawl a site and triage the issue list.
- 3Run RankAudit's Core Web Vitals and duplicate content scans across the full site and clear every red-flagged page before your next audit cycle.