ShipworkSite inspection
Checks

Crawlability

PaginationAre paginated pages set up right?Internal searchIs site search eating crawl budget?URL parametersAre parameters creating duplicates?Log analyserWhat does Googlebot actually crawl?Robots builderNeed a robots.txt file?Soft 404sAre pages “not found” but returning 200?JavaScriptCan crawlers see it without running JS?FreshnessIs my site quietly going stale?Robots.txtDoes robots.txt say what I think?

Indexing

Sitemap lastmodAre my sitemap dates valid?SitemapIs my sitemap actually fetchable?IndexingIs Google allowed to index my pages?CanonicalsIs Google indexing the wrong URL?Index signalsDo sitemap and index signals agree?Sitemap generatorNeed a sitemap.xml for my site?Bulk URL statusWhere does each of these URLs really land?Redirect builderNeed the redirect rules?RedirectsAre my URLs answering directly, over HTTPS?

On-page

Keyword ideasWhat are people searching for?SERP previewHow does my page look in Google?Content qualityAre your pages too thin or too alike?Image weightAre images slowing the page?CannibalizationAre pages competing with each other?On-page checkDoes the page use its target phrase?ImagesAre my images accessible and loading?Meta tag builderWhat should my title and share tags say?DuplicatesDo my pages compete for one query?

Links

Orphan pagesWhich pages can no link reach?Link graphHow deep do your pages sit?Anchor textDo links say what they point at?Outbound linksAre external links still alive?Broken linksAre internal links sending visitors nowhere?

Structured data

Rich resultsIs my markup eligible for a rich result?Structured dataIs my product schema valid?Schema coverageDo my key pages carry structured data?Social previewHow does my page look when shared?Schema vs pageDoes markup match the page price?Schema builderNeed valid JSON-LD?

International

Hreflang sitemapDo page and sitemap hreflang agree?HreflangDo my language versions link back?Hreflang builderNeed the hreflang tags?Page DoctorWhy is this page not doing well?Redirect planMy site has dead links — what redirects do I write?Sitemap diffIs anything missing from my sitemap?Robots simulatorWhat does my robots.txt actually block?Can Googlebot?Can Googlebot fetch this URL?
Every error, explainedGuides
Pricing Learn Error guides Run free audit

+1 free check

Welcome to Shipwork

Sign in free and your next check this month is on us.

Continue with GoogleContinue with email

We email you a 6-digit code. No password.

No card needed. Reports and watches follow you to any device.

What does a crawl of your sitemap actually find?

A single page can look fine while the set of pages contradicts each other. This reads your sitemap the way a crawler would, then compares the pages against one another for duplicates and gaps.

Runs the Sitemap crawl check on the address you enter, from outside your network. Nothing is stored.

What this check inspects

Shipwork reads the URLs from your sitemap, following up to eight same-host child sitemaps when it finds an index, and checks a set of pages. For each it records the status, title, meta description, canonical and whether that canonical points elsewhere, the number of H1 tags, a noindex flag and the html lang attribute. It then groups the pages it checked by title and by description to find duplicates.

What a failure means

Pages in the sitemap that return 404 or cannot be fetched are an error. Pages in the sitemap that are noindexed are an error: the two signals disagree. Duplicate titles across pages are an error, and pages with no title at all are an error. Canonicals pointing elsewhere, missing descriptions, missing H1s and long titles are warnings.

How to fix it

  1. Remove dead URLs from the sitemap instead of leaving them for a crawler to discover.
  2. Resolve noindex and sitemap conflicts in one direction: either the page belongs in the sitemap and should be indexable, or it should not be listed.
  3. Give every page a unique title and description. Template defaults that repeat across products are the usual source of duplicates.
  4. Add a single H1 to any page that is missing one.

A typical failure, worked through

The setupA Shopify store generates a sitemap index whose first child is a one-URL discovery file. A tool that reads only the first child sees one page and reports the catalogue as nearly empty.

What the check reportsThis check follows every same-host child, so it reads real products and collections, then reports that 4 of 12 pages checked share a title because the collection template appends only the store name.

The pointA sitemap index needs every child read, not just the first. The duplicate titles it finds are the real, fixable problem.

Questions

Is this a full site crawl?
No. It reads the sitemap and checks a set of pages, so a finding is real but absence of a finding is not proof the whole site is clean.
Why do pages in my sitemap 404?
Usually a stale sitemap that still lists products or collections you deleted, or a handle change without a redirect.
Why is a sitemap URL noindexed?
A template default caught a page type you did not mean to list, such as a filtered collection or a thank-you page. Remove it from the sitemap or make it indexable, but not both.

Related checks and guides