ShipworkSite inspection
Checks

Crawlability

PaginationAre paginated pages set up right?Internal searchIs site search eating crawl budget?URL parametersAre parameters creating duplicates?Log analyserWhat does Googlebot actually crawl?Robots builderNeed a robots.txt file?Soft 404sAre pages “not found” but returning 200?JavaScriptCan crawlers see it without running JS?FreshnessIs my site quietly going stale?Robots.txtDoes robots.txt say what I think?

Indexing

Sitemap lastmodAre my sitemap dates valid?SitemapIs my sitemap actually fetchable?IndexingIs Google allowed to index my pages?CanonicalsIs Google indexing the wrong URL?Index signalsDo sitemap and index signals agree?Sitemap generatorNeed a sitemap.xml for my site?Bulk URL statusWhere does each of these URLs really land?Redirect builderNeed the redirect rules?RedirectsAre my URLs answering directly, over HTTPS?

On-page

Keyword ideasWhat are people searching for?SERP previewHow does my page look in Google?Content qualityAre your pages too thin or too alike?Image weightAre images slowing the page?CannibalizationAre pages competing with each other?On-page checkDoes the page use its target phrase?ImagesAre my images accessible and loading?Meta tag builderWhat should my title and share tags say?DuplicatesDo my pages compete for one query?

Links

Orphan pagesWhich pages can no link reach?Link graphHow deep do your pages sit?Anchor textDo links say what they point at?Outbound linksAre external links still alive?Broken linksAre internal links sending visitors nowhere?

Structured data

Rich resultsIs my markup eligible for a rich result?Structured dataIs my product schema valid?Schema coverageDo my key pages carry structured data?Social previewHow does my page look when shared?Schema vs pageDoes markup match the page price?Schema builderNeed valid JSON-LD?

International

Hreflang sitemapDo page and sitemap hreflang agree?HreflangDo my language versions link back?Hreflang builderNeed the hreflang tags?Page DoctorWhy is this page not doing well?Redirect planMy site has dead links — what redirects do I write?Sitemap diffIs anything missing from my sitemap?Robots simulatorWhat does my robots.txt actually block?Can Googlebot?Can Googlebot fetch this URL?
Every error, explainedGuides
Pricing Learn Error guides Run free audit

+1 free check

Welcome to Shipwork

Sign in free and your next check this month is on us.

Continue with GoogleContinue with email

We email you a 6-digit code. No password.

No card needed. Reports and watches follow you to any device.

Are the files other systems expect actually there?

Some dependencies are not pages at all. ads.txt gates programmatic ad revenue. security.txt gives a researcher somewhere to send a vulnerability. sellers.json declares who sells your inventory. Their absence is a business problem, not a technicality.

Runs the Well-known files check on the address you enter, from outside your network. Nothing is stored.

What this check inspects

Shipwork requests /ads.txt, /app-ads.txt, /security.txt, /.well-known/security.txt, /sellers.json and /humans.txt, with a total time budget so a slow host cannot hold the request open. For ads.txt it also parses the lines and counts how many are malformed, since each line needs a domain, a publisher id and a relationship.

What a failure means

A missing ads.txt is a warning: if you sell programmatic ads, unauthorised resellers can sell your inventory and you may not be paid for it. An empty ads.txt is a warning for the same reason. Malformed lines are a warning because they are ignored. A missing security.txt is informational.

How to fix it

  1. If you sell programmatic inventory, publish a valid ads.txt with one line per authorised seller.
  2. Check every ads.txt line has exactly the three fields it needs, in the right order.
  3. Publish security.txt, at the root or under /.well-known, with a contact and an expiry.
  4. Keep sellers.json in step with who is actually allowed to sell your inventory.

A typical failure, worked through

The setupA publisher adds ads.txt by copying a partner file, but one line is missing the relationship field.

What the check reportsThe check reports ads.txt present, then reports that one of the lines is malformed. That line is ignored, so the seller it was meant to authorise is not authorised.

The pointA present-but-wrong file produces no error anywhere. Only parsing it reveals that a line does nothing.

Questions

Does every site need ads.txt?
No. Only sites that sell programmatic advertising inventory. A store that does not run ads can ignore it.
What should security.txt contain?
At least a contact method and an expiry date, so a researcher who finds a vulnerability knows who to tell and until when the file is valid.
Why is sellers.json separate from ads.txt?
ads.txt says who may sell your inventory. sellers.json says who the sellers in a bid request actually are. Together they let buyers verify the chain.

Related checks and guides