ShipworkSite inspection
Checks

Crawlability

PaginationAre paginated pages set up right?Internal searchIs site search eating crawl budget?URL parametersAre parameters creating duplicates?Log analyserWhat does Googlebot actually crawl?Robots builderNeed a robots.txt file?Soft 404sAre pages “not found” but returning 200?JavaScriptCan crawlers see it without running JS?FreshnessIs my site quietly going stale?Robots.txtDoes robots.txt say what I think?

Indexing

Sitemap lastmodAre my sitemap dates valid?SitemapIs my sitemap actually fetchable?IndexingIs Google allowed to index my pages?CanonicalsIs Google indexing the wrong URL?Index signalsDo sitemap and index signals agree?Sitemap generatorNeed a sitemap.xml for my site?Bulk URL statusWhere does each of these URLs really land?Redirect builderNeed the redirect rules?RedirectsAre my URLs answering directly, over HTTPS?

On-page

Keyword ideasWhat are people searching for?SERP previewHow does my page look in Google?Content qualityAre your pages too thin or too alike?Image weightAre images slowing the page?CannibalizationAre pages competing with each other?On-page checkDoes the page use its target phrase?ImagesAre my images accessible and loading?Meta tag builderWhat should my title and share tags say?DuplicatesDo my pages compete for one query?

Links

Orphan pagesWhich pages can no link reach?Link graphHow deep do your pages sit?Anchor textDo links say what they point at?Outbound linksAre external links still alive?Broken linksAre internal links sending visitors nowhere?

Structured data

Rich resultsIs my markup eligible for a rich result?Structured dataIs my product schema valid?Schema coverageDo my key pages carry structured data?Social previewHow does my page look when shared?Schema vs pageDoes markup match the page price?Schema builderNeed valid JSON-LD?

International

Hreflang sitemapDo page and sitemap hreflang agree?HreflangDo my language versions link back?Hreflang builderNeed the hreflang tags?Page DoctorWhy is this page not doing well?Redirect planMy site has dead links — what redirects do I write?Sitemap diffIs anything missing from my sitemap?Robots simulatorWhat does my robots.txt actually block?Can Googlebot?Can Googlebot fetch this URL?
Every error, explainedGuides
Pricing Learn Error guides Run free audit

+1 free check

Welcome to Shipwork

Sign in free and your next check this month is on us.

Continue with GoogleContinue with email

We email you a 6-digit code. No password.

No card needed. Reports and watches follow you to any device.

Does every URL in your sitemap live up to the promise?

A sitemap is a promise that each URL is a final, indexable page. This check reads the sitemap, crawls the listed pages, and tests each one against that promise, so a stale entry does not quietly teach the crawler to distrust the file.

Runs the Sitemap hygiene check against a set of key pages, from outside your network. Nothing is stored.

What this check inspects

Shipwork builds the site map from the sitemap a set of pages at a time, follows a sitemap index where there is one, and reads each listed URL. For every entry it records the status, whether the URL redirected, whether the page asks not to be indexed, and whether its canonical points somewhere else. It deduplicates the list, reports how many URLs were checked, and says when it stopped early to stay inside its time budget.

What a failure means

A listed URL that returns 404, returns a server error, or cannot be reached at all is an error, because the sitemap entry is not a working page. A listed URL that is set to noindex is also an error, since a page that asks not to be indexed must not be advertised in the sitemap. A listed URL that redirects, or that points its canonical at a different page, is a warning: the sitemap should list the final, canonical address rather than a detour. With no sitemap found at all, the check warns rather than errors, because a sitemap is optional.

How to fix it

  1. Remove entries that 404 or error, or correct the address if the page still exists.
  2. Replace a redirecting entry with the URL it lands on, so the sitemap lists final addresses only.
  3. Remove a noindexed URL from the sitemap, or remove the noindex if the page belongs in search.
  4. List the canonical address for any URL whose canonical currently points somewhere else.

A typical failure, worked through

The setupA store migrates its collection URLs and redirects the old addresses to the new ones, but the sitemap is regenerated from a cache that still holds the old handles.

What the check reportsThe check reports several sitemap URLs that redirect to the new addresses, and one that now 404s because the old collection was deleted. Every entry still loads for the team as a redirect.

The pointA redirect hides the stale entry from a browser and not from a crawler. The sitemap has to list the final address, which is what the check tests for.

Questions

How many sitemap URLs are checked?
The whole sitemap is resolved, but the pages are fetched from a set of pages so the check stays fast. It reports how many were checked and whether it stopped early.
Why is a noindexed sitemap URL an error rather than a warning?
The two signals disagree outright: the sitemap says fetch and index this, the page says do not index it. One of them has to change, and the check treats the contradiction as a must-fix.
Is a redirecting sitemap URL really a problem?
It works today, but it adds a hop and leaves the sitemap describing a detour instead of the final page. Pointing the entry at the destination is the durable fix.

Related checks and guides