ShipworkSite inspection
Checks

Crawlability

PaginationAre paginated pages set up right?Internal searchIs site search eating crawl budget?URL parametersAre parameters creating duplicates?Log analyserWhat does Googlebot actually crawl?Robots builderNeed a robots.txt file?Soft 404sAre pages “not found” but returning 200?JavaScriptCan crawlers see it without running JS?FreshnessIs my site quietly going stale?Robots.txtDoes robots.txt say what I think?

Indexing

Sitemap lastmodAre my sitemap dates valid?SitemapIs my sitemap actually fetchable?IndexingIs Google allowed to index my pages?CanonicalsIs Google indexing the wrong URL?Index signalsDo sitemap and index signals agree?Sitemap generatorNeed a sitemap.xml for my site?Bulk URL statusWhere does each of these URLs really land?Redirect builderNeed the redirect rules?RedirectsAre my URLs answering directly, over HTTPS?

On-page

Keyword ideasWhat are people searching for?SERP previewHow does my page look in Google?Content qualityAre your pages too thin or too alike?Image weightAre images slowing the page?CannibalizationAre pages competing with each other?On-page checkDoes the page use its target phrase?ImagesAre my images accessible and loading?Meta tag builderWhat should my title and share tags say?DuplicatesDo my pages compete for one query?

Links

Orphan pagesWhich pages can no link reach?Link graphHow deep do your pages sit?Anchor textDo links say what they point at?Outbound linksAre external links still alive?Broken linksAre internal links sending visitors nowhere?

Structured data

Rich resultsIs my markup eligible for a rich result?Structured dataIs my product schema valid?Schema coverageDo my key pages carry structured data?Social previewHow does my page look when shared?Schema vs pageDoes markup match the page price?Schema builderNeed valid JSON-LD?

International

Hreflang sitemapDo page and sitemap hreflang agree?HreflangDo my language versions link back?Hreflang builderNeed the hreflang tags?Page DoctorWhy is this page not doing well?Redirect planMy site has dead links — what redirects do I write?Sitemap diffIs anything missing from my sitemap?Robots simulatorWhat does my robots.txt actually block?Can Googlebot?Can Googlebot fetch this URL?
Every error, explainedGuides
Pricing Learn Error guides Run free audit

+1 free check

Welcome to Shipwork

Sign in free and your next check this month is on us.

Continue with GoogleContinue with email

We email you a 6-digit code. No password.

No card needed. Reports and watches follow you to any device.

Which pages are about the same thing?

Two pages that describe the same subject compete for one query, and search engines choose only one of them. The loss is not a penalty, it is a split: neither page collects the signals a single focused page would.

Runs the Near-duplicate content check against a set of key pages, from outside your network. Nothing is stored.

What this check inspects

Shipwork reads the title and meta description of a set of sitemap pages, embeds them, and clusters the vectors by cosine similarity. It reports each cluster of pages that are about the same thing, with the peak similarity between them, and says when the site is clear.

What a failure means

A cluster of pages above the similarity threshold is a warning. It does not mean the pages are identical, only that their titles and descriptions describe the same subject, which is enough to set them against each other.

How to fix it

  1. Decide which page should win for the topic and consolidate the others into it, or differentiate them clearly.
  2. Give each page a title and description that states what makes it distinct, usually the attribute that differs.
  3. Link the related pages to each other so a crawler understands the relationship instead of seeing two rivals.
  4. Watch for template-generated descriptions. If every collection page gets the store tagline, they will all cluster.

A typical failure, worked through

The setupA store has four collection pages for colour variants: red running shoes, blue running shoes, black running shoes and running shoes. All four use the same description template with only the colour substituted.

What the check reportsThe check groups the four pages as near-identical because their embedded text is almost the same, and reports the cluster with the similarity percentage.

The pointA template with one word swapped is not differentiation. Either merge them or write descriptions that describe the actual difference.

Questions

Is similar content a penalty?
Not a penalty. It is dilution: two pages about one subject split the links and engagement that would have made one of them strong.
How similar is too similar?
There is no official number. The practical rule is that if two titles describe the same query, the pages are competing and should either merge or be made clearly distinct.
Does a canonical fix this?
A canonical helps when the pages are genuine duplicates. When they are distinct pages about similar topics, the fix is differentiation or consolidation, not a canonical.

Related checks and guides