Key takeaways
- Duplicate content is the same content at several URLs. Google says some duplication is normal and does not break its spam policies.
- The real cost is that Google picks one version and splits signals between copies, not an automatic penalty.
- Typical causes are technical: parameters, http and https, www, printer pages and product copy from the manufacturer.
- Fix it by choosing one main version and pointing to it with a 301, rel=canonical and internal links, or by writing unique copy.
Duplicate content shows up in almost every technical SEO audit I run, especially on online stores with thousands of products and sites with many city pages. It is rarely serious by itself, but it makes Google spend time on copies and show the wrong URL.
What is duplicate content in SEO?
Duplicate content is identical or very similar content that can be opened at more than one URL. It can be internal, when your own site shows the same page at several addresses, or external, when another site publishes your text or you use someone else's. It matters because Google usually shows only one version of each piece of content.
Is there a duplicate content penalty?
Not an automatic one. Google says some duplicate content on a site is normal and does not violate its spam policies. Google groups the copies and picks one URL to show. Trouble starts when you copy other sites without adding anything, or create near-identical pages on purpose to manipulate results, such as doorway pages.
This comes from Google's guide to URL canonicalization. The line is drawn in the spam policies: scraped content with no added value and doorway pages, such as several pages aimed at different cities that funnel to one place, are violations.
| Situation | Spam problem? | What happens in practice |
|---|---|---|
| The same page with and without www | No | Google picks one; better to unify |
| Category filters and sort orders | No | Many similar URLs waste crawling |
| Product copy from the manufacturer | Not by itself | Hard to stand out against hundreds of identical stores |
| City pages with only the name swapped | Can be (doorway pages) | Real risk if they exist only to rank |
| Copying other sites' articles | Yes, without added value | Can lead to a manual action |
What causes duplicate content?
Mostly technical issues: URL parameters from filters or campaigns, the site opening on both http and https or with and without www, trailing slashes, printer-friendly pages, visible staging sites and messy pagination. On the content side, it comes from product descriptions copied from the manufacturer and location pages where only the city name changes.
Google lists similar cases: region variants, device variants, protocol variants (http and https), site functions such as sorting and filtering, and accidental variants such as a demo site left open to crawlers.
Parameters
?color=red, ?utm_source=email or ?sort=price create new URLs for the same page.
http and https
If both versions load without a redirect, Google sees two identical sites.
www and non-www
example.com and www.example.com should resolve to one address.
Printer pages
A /print/ page with the same text is another copy.
Manufacturer copy
The same text on hundreds of stores sets you apart from none.
City pages
Swapping only "Dallas" for "Houston" creates near-identical pages.
How do I check my site for duplicate content?
Start with Search Console: the page indexing report shows pages marked as duplicates or where Google chose a different canonical. Then copy a unique sentence from your page and search it in quotes on Google to see whether it appears at other URLs or sites. A crawler such as Screaming Frog helps find repeated titles and text.
- Open your site with http, https, www and non-www: all should end at the same URL.
- In Search Console, review the "Duplicate" and "Google chose different canonical" reasons.
- Search a sentence from a product page or article in quotes.
- Check whether filters, internal search or campaign tags create indexable URLs.
- Compare two city pages: what is genuinely different between them?
How do you fix duplicate content?
Choose one main version of each piece of content and make everything point to it. If the copy does not need to exist, use a 301 redirect. If it must exist, like a filtered variant, add rel=canonical pointing to the main page. Always link internally to the main version and, when the problem is the text itself, write unique copy.
Google explains in its guide to specifying a canonical URL that redirects and rel=canonical are strong signals and sitemap inclusion is a weak one, and that they work better combined. The redirects guide covers 301s. The step by step for canonical tags, with examples and common mistakes, lives in redirects, 404 errors and canonicalization.
| Case | Fix |
|---|---|
| http, https, www and trailing slash | 301 redirect to one version |
| Filters, sorting and campaign parameters | rel=canonical to the clean URL, and do not link the parameters |
| Printer page | rel=canonical to the normal page, or remove it |
| Two near-identical articles | Merge into one and 301 the other |
| Manufacturer product copy | Rewrite at least your best-selling products |
| Identical city pages | Add real local information or merge them |
What should I do about manufacturer descriptions and city pages?
Start with the pages that sell or get searched the most. For stores, rewrite those product pages with what your team knows: uses, sizing, common questions and comparisons. For city pages, add real information about each area, such as coverage, timing, prices or examples. If you have nothing different to say, one page is better.
Google asks for content made for people in its helpful content guide, and that applies here: a page that only repeats another one helps nobody. For big catalogs, see SEO for large e-commerce catalogs, and for sites with many city pages, what programmatic SEO is. If several pages compete for the same search, that is a different problem: keyword cannibalization. Rewriting product and city pages is part of my SEO content writing work. As your SEO consultant, I can review your site in a free diagnosis: book it here.
Frequently asked questions
How much text can I repeat across pages?
There is no official percentage. Repeated legal text or shipping blocks are normal; what matters is that each page's main content is its own.
Does posting my article on LinkedIn or Medium create duplicate content?
It can. Publish on your site first and, where the platform allows it, link back to the original.
Is translated content duplicate content?
No. A version in another language is different content; connect the versions with hreflang.
What if another site copies my content?
Google usually identifies the original. If it hurts you, ask for removal or file a copyright request.
Does noindex fix duplicate content?
It removes a page from results, but if you want to consolidate signals into one version, a 301 or canonical is better.
About the author
Juan José Giraldo is an SEO consultant in Medellín, Colombia, with 5+ years of experience. He works on technical and local SEO for 600+ US car dealerships at Reunion Marketing, an Inc. 5000 agency, and supervises the SEO of 18 US online stores with more than 3 million products at Prontomowers. Read more · LinkedIn.
Want to see these guides first? Choose JJ SEO Colombia as a preferred source on Google, and my articles are more likely to show up for you in Top Stories.
Follow on GoogleAdd as a preferred source