What Sitebulb does well
Sitebulb crawls at scale, explains over three hundred hints in plain words, compares audits over time, and produces client-ready PDF reports. For a consultant who needs depth and a deliverable, it is strong.
Where a crawler stops
A crawl reads pages. It does not open a TLS connection, resolve DNS or email records, read Merchant Center disapprovals, or ask whether GPTBot is allowed in robots.txt. And when you run it from your own machine, you see your site from your own network, which is the one place a bot-protection failure never shows.
What Shipwork does instead
- Free and account-free, so it is the first pass before you decide to pay for depth.
- Outside-network reachability, plus TLS, DNS, email auth and AI crawler access.
- Merchant Center product data and a feed-file check for the fields a crawl cannot see.
- A printable report and a daily watch, so a snapshot becomes a record.
Which should you use?
Use Sitebulb when you need a deep, exportable, client-ready crawl. Run the free Shipwork audit first to find where the problem is and whether it is outside-network, then go deeper.
- Run the free auditOne crawl, every applicable check, from outside your network.
- Printable reportA branded, print-ready report of the audit.
- AI crawler accessWhether ChatGPT, Claude and others may read your site.
- Every check, explainedThe full list, each with what it inspects and the fix.
- The free audit checklistWhat an outside-network audit covers.