ShipworkSite inspection
Checks

Crawlability

PaginationAre paginated pages set up right?Internal searchIs site search eating crawl budget?URL parametersAre parameters creating duplicates?Log analyserWhat does Googlebot actually crawl?Robots builderNeed a robots.txt file?Soft 404sAre pages “not found” but returning 200?JavaScriptCan crawlers see it without running JS?FreshnessIs my site quietly going stale?Robots.txtDoes robots.txt say what I think?

Indexing

Sitemap lastmodAre my sitemap dates valid?SitemapIs my sitemap actually fetchable?IndexingIs Google allowed to index my pages?CanonicalsIs Google indexing the wrong URL?Index signalsDo sitemap and index signals agree?Sitemap generatorNeed a sitemap.xml for my site?Bulk URL statusWhere does each of these URLs really land?Redirect builderNeed the redirect rules?RedirectsAre my URLs answering directly, over HTTPS?

On-page

Keyword ideasWhat are people searching for?SERP previewHow does my page look in Google?Content qualityAre your pages too thin or too alike?Image weightAre images slowing the page?CannibalizationAre pages competing with each other?On-page checkDoes the page use its target phrase?ImagesAre my images accessible and loading?Meta tag builderWhat should my title and share tags say?DuplicatesDo my pages compete for one query?

Links

Orphan pagesWhich pages can no link reach?Link graphHow deep do your pages sit?Anchor textDo links say what they point at?Outbound linksAre external links still alive?Broken linksAre internal links sending visitors nowhere?

Structured data

Rich resultsIs my markup eligible for a rich result?Structured dataIs my product schema valid?Schema coverageDo my key pages carry structured data?Social previewHow does my page look when shared?Schema vs pageDoes markup match the page price?Schema builderNeed valid JSON-LD?

International

Hreflang sitemapDo page and sitemap hreflang agree?HreflangDo my language versions link back?Hreflang builderNeed the hreflang tags?Page DoctorWhy is this page not doing well?Redirect planMy site has dead links — what redirects do I write?Sitemap diffIs anything missing from my sitemap?Robots simulatorWhat does my robots.txt actually block?Can Googlebot?Can Googlebot fetch this URL?
Every error, explainedGuides
Pricing Learn Error guides Run free audit

+1 free check

Welcome to Shipwork

Sign in free and your next check this month is on us.

Continue with GoogleContinue with email

We email you a 6-digit code. No password.

No card needed. Reports and watches follow you to any device.

Is your sitemap a valid map or a pile of guesses?

A sitemap is a hint that saves a crawler time. It only works when it is well-formed XML, full of absolute URLs on your own host, and inside the limits. A broken one teaches the crawler to distrust the whole signal.

Runs the XML sitemap check against a set of key pages, from outside your network. Nothing is stored.

What this check inspects

Shipwork fetches your sitemap from outside your network, trying /sitemap.xml and /sitemap_index.xml unless you give a specific path. It checks whether the response is a urlset or a sitemapindex, extracts every loc and reports the count. For a urlset it flags more than 50,000 URLs, duplicate loc entries, loc values that are not absolute URLs, and locs pointing at a different host than the sitemap.

What a failure means

If the response is not XML with a urlset or sitemapindex element, it is reported as not a sitemap at all, which usually means a catch-all page, a login wall or an error page is answering instead. Relative locs are an error because crawlers require absolute URLs. Cross-host and duplicate entries are warnings that waste the crawl budget the file exists to protect.

How to fix it

  1. Serve XML, not HTML. A 404 handler that returns a styled page with status 200 is the usual cause of a sitemap that reads as a normal web page.
  2. Make every loc an absolute https URL on the same host as the sitemap.
  3. Split past 50,000 URLs into a sitemap index of child sitemaps rather than one giant file.
  4. Remove duplicates before publishing. They add nothing and make the file slower to read.

A typical failure, worked through

The setupA store moves to a new CDN. The origin no longer has /sitemap.xml, and the CDN answers unknown paths with its marketing 404 page, returned as 200.

What the check reportsThe check finds no urlset or sitemapindex and reports that the response is not a sitemap. Search Console reports it could not fetch the file while it still loads perfectly in your browser.

The pointThe failure is the status and content type, not the URL. Fix the route or submit the path the platform actually serves.

Questions

Where should my sitemap live?
At the site root, /sitemap.xml, and referenced from robots.txt. Shopify and most platforms serve one there automatically.
Do I need a sitemap if my site is small?
It is optional, but it is cheap and it tells crawlers the last modified date. For a store whose products change often, the lastmod values are the useful part.
What is a sitemap index?
A sitemap that lists other sitemaps. Platforms use it to split a large catalogue by type, for example products, collections and pages, each with its own file.

Related checks and guides