Crawl the whole site, not a sample
A free check samples a handful of pages. The deep crawl reads every URL your sitemap declares and reports the problems that only show up at scale — dead pages, noindex entries, duplicate titles and thin content across the whole site.
Crawls up to 100 URLs by default, from outside your network. This is the resource-heavy check; nothing is stored.
How this check works
Shipwork reads every URL in your sitemap (up to the limit) and fetches each one, then aggregates: dead or unreachable pages, sitemap URLs that redirect, pages set to noindex, missing and duplicate titles, missing descriptions and thin content. It is time-budgeted and reports how far it got.
Questions
- How is this different from the free audit?
- The free audit samples a bounded number of pages. The deep crawl reads the whole sitemap, which is the only way to see site-wide problems like duplicate titles or a dead page buried at position 400.
- How many URLs does it crawl?
- Up to 100 by default, and up to 500 on request. Very large sites need the whole-catalogue crawl, which is a paid, longer-running job.
- Is it heavy?
- Yes — it makes one request per URL, so it is rate-limited and time-budgeted. Run it when you want the full picture, not on every check.