ShipworkSite inspection
Checks

Crawlability

PaginationAre paginated pages set up right?Internal searchIs site search eating crawl budget?URL parametersAre parameters creating duplicates?Log analyserWhat does Googlebot actually crawl?Robots builderNeed a robots.txt file?Soft 404sAre pages “not found” but returning 200?JavaScriptCan crawlers see it without running JS?FreshnessIs my site quietly going stale?Robots.txtDoes robots.txt say what I think?

Indexing

Sitemap lastmodAre my sitemap dates valid?SitemapIs my sitemap actually fetchable?IndexingIs Google allowed to index my pages?CanonicalsIs Google indexing the wrong URL?Index signalsDo sitemap and index signals agree?Sitemap generatorNeed a sitemap.xml for my site?Bulk URL statusWhere does each of these URLs really land?Redirect builderNeed the redirect rules?RedirectsAre my URLs answering directly, over HTTPS?

On-page

Keyword ideasWhat are people searching for?SERP previewHow does my page look in Google?Content qualityAre your pages too thin or too alike?Image weightAre images slowing the page?CannibalizationAre pages competing with each other?On-page checkDoes the page use its target phrase?ImagesAre my images accessible and loading?Meta tag builderWhat should my title and share tags say?DuplicatesDo my pages compete for one query?

Links

Orphan pagesWhich pages can no link reach?Link graphHow deep do your pages sit?Anchor textDo links say what they point at?Outbound linksAre external links still alive?Broken linksAre internal links sending visitors nowhere?

Structured data

Rich resultsIs my markup eligible for a rich result?Structured dataIs my product schema valid?Schema coverageDo my key pages carry structured data?Social previewHow does my page look when shared?Schema vs pageDoes markup match the page price?Schema builderNeed valid JSON-LD?

International

Hreflang sitemapDo page and sitemap hreflang agree?HreflangDo my language versions link back?Hreflang builderNeed the hreflang tags?Page DoctorWhy is this page not doing well?Redirect planMy site has dead links — what redirects do I write?Sitemap diffIs anything missing from my sitemap?Robots simulatorWhat does my robots.txt actually block?Can Googlebot?Can Googlebot fetch this URL?
Every error, explainedGuides
Pricing Learn Error guides Run free audit

+1 free check

Welcome to Shipwork

Sign in free and your next check this month is on us.

Continue with GoogleContinue with email

We email you a 6-digit code. No password.

No card needed. Reports and watches follow you to any device.

Duplicate content: what it is, what it costs, what it does not

Duplicate content is feared far out of proportion. Google does not penalise it. It consolidates it: it picks one URL to rank and ignores the rest. The cost is not a punishment, it is that the pick is often not yours. Here is where store duplicates actually come from and which ones matter.

The penalty myth

There is no duplicate-content penalty. When Google finds identical content at several URLs, it chooses one canonical representative and filters the rest out of results. The cost is dilution, not damage: links and signals split across the duplicates instead of concentrating on the version you wanted, and the chosen URL may not be the one your navigation, your sitemap or your ads point at.

Where store duplicates come from

  • Template pages with thin differences: two products whose only difference is a size variant published as separate products; empty collections that render the same shell.
  • Descriptions copied from suppliers: the same paragraph as hundreds of other stores: duplicate across the web, not just your site, which weakens product matching.
  • Sort, filter and tag parameters multiplying one collection into many indexable URLs.
  • Legacy pages: an old landing page and a new one both live after a redesign, answering the same query.
ONE CANONICAL VERSIONall signals on one URLUNFILTERED DUPLICATESGoogle picks a winnermaybe not the one you wanted
Duplicate content is filtered, not penalised, but Google picks the representative, and its pick may not be your pick.

Which duplicates matter

Separate repeated metadata from repeated content. Two pages can share a title while describing different products; two URLs can have different titles yet serve the same article. Boilerplate shared across a template is normal. Review the useful main content and page purpose before choosing a structural fix.

The duplicate metadata finder compares exact titles and descriptions on sampled pages, ignoring letter case. It groups matching URLs; it does not crawl other websites for plagiarism or measure full-text similarity. A clear sample is not evidence that every page on your site is unique.

For a hypothetical store, imagine two distinct mugs imported with the title “Ceramic mug.” Keep both products and give each an accurate identifying title. By contrast, a campaign URL displaying the same product as its clean URL needs a canonicalization review. Those two observations lead to different actions.

Fix: consolidate or differentiate

  1. Duplicate titles and descriptions: rewrite them per page. Use accurate distinctions from the page, such as model or purpose. A title rewrite can remove a metadata collision without changing the underlying content.
  2. Genuinely duplicated pages: merge the content into one, 301 the rest, and point the sitemap at the survivor.
  3. Duplicate URLs that must remain accessible: review a canonical pointing to the preferred equivalent. Do not automatically canonicalize distinct product variants to a parent.
  4. Verify after fixing: inspect the changed metadata and declared canonical, then compare the same sampled URLs again. Search index changes need later evidence.

Google can use a meta description or page content to generate a snippet, so a unique description does not guarantee the text shown in results. See Google’s snippet guidance. For duplicate or very similar pages, review its canonicalization guidance and the worked canonical guide.

Run the free duplicate-content check to see which titles and descriptions collide on your site today. Related: fixing keyword cannibalization · canonical check

Find out if this is happening to you

Shipwork groups matching nonempty titles and meta descriptions on sampled pages. It does not compare every page or establish full-text duplication, plagiarism, or ranking loss. Free, no account, no signup. Paste your store address.

Find duplicate metadata

Questions

Does Google penalise duplicate content?
No. It filters duplicates to one representative URL and continues. The real cost is lost control over which version represents you, not a penalty.
Is duplicate content the same as keyword cannibalization?
No. Duplicates are identical or near-identical text; cannibalization is two different pages aiming at the same query. The fixes overlap: consolidate or differentiate both ways.
Are duplicate meta descriptions serious?
They can reveal generic template copy. Write useful descriptions for distinct pages, while remembering that Google may use page content for the actual snippet.
Should I noindex duplicate pages?
Do not use noindex merely to choose a preferred duplicate within a site. Review canonicalization for accessible duplicate URLs, or a relevant redirect when a redundant page is retired.

Keep reading