ShipworkSite inspection
Product pages

Crawlability

PaginationAre paginated pages set up right?Internal searchIs site search eating crawl budget?URL parametersAre parameters creating duplicates?Log analyserWhat does Googlebot actually crawl?Robots builderNeed a robots.txt file?Soft 404sAre pages “not found” but returning 200?JavaScriptCan crawlers see it without running JS?FreshnessIs my site quietly going stale?Robots.txtDoes robots.txt say what I think?

Indexing

Sitemap lastmodAre my sitemap dates valid?SitemapIs my sitemap actually fetchable?IndexingIs Google allowed to index my pages?CanonicalsIs Google indexing the wrong URL?Index signalsDo sitemap and index signals agree?Sitemap generatorNeed a sitemap.xml for my site?Bulk URL statusWhere does each of these URLs really land?Redirect builderNeed the redirect rules?RedirectsAre my URLs answering directly, over HTTPS?

On-page

Keyword ideasWhat are people searching for?SERP previewHow does my page look in Google?Content qualityAre your pages too thin or too alike?Image weightAre images slowing the page?CannibalizationAre pages competing with each other?On-page checkDoes the page use its target phrase?ImagesAre my images accessible and loading?Meta tag builderWhat should my title and share tags say?DuplicatesDo my pages compete for one query?

Links

Orphan pagesWhich pages can no link reach?Link graphHow deep do your pages sit?Anchor textDo links say what they point at?Outbound linksAre external links still alive?Broken linksAre internal links sending visitors nowhere?

Structured data

Rich resultsIs my markup eligible for a rich result?Structured dataIs my product schema valid?Schema coverageDo my key pages carry structured data?Social previewHow does my page look when shared?Schema vs pageDoes markup match the page price?Schema builderNeed valid JSON-LD?

International

Hreflang sitemapDo page and sitemap hreflang agree?HreflangDo my language versions link back?Hreflang builderNeed the hreflang tags?Page DoctorWhy is this page not doing well?Redirect planMy site has dead links — what redirects do I write?Sitemap diffIs anything missing from my sitemap?Robots simulatorWhat does my robots.txt actually block?Can Googlebot?Can Googlebot fetch this URL?
Every error, explainedGuides
Pricing Learn Error guides Run free audit

+1 free check

Welcome to Shipwork

Sign in free and your next check this month is on us.

Continue with GoogleContinue with email

We email you a 6-digit code. No password.

No card needed. Reports and watches follow you to any device.

All errorsProduct page unavailable

When the page loads for you but returns an error to Google

What the error means

Google could not fetch your landing page. The item is disapproved even though the page opens perfectly in your own browser.

Why Google rejects it

This is almost always the crawler being refused rather than the page being broken: bot protection, a firewall rule, or rate limiting triggered by fetching many URLs quickly. You see the site from your own network, warmed and often whitelisted. Google does not.

ALLOWEDYour browser: 200 OKBLOCKEDCrawler: 500 error
Same URL, two verdicts: the gap is the whole failure.

How to fix it

  1. Check what an outside request actually receives, rather than what your browser shows.
  2. Look at bot-protection settings if you are behind a CDN or WAF, and allow legitimate crawlers.
  3. Check whether the errors cluster in time rather than on particular products. That pattern points at rate limiting, not a bug.

Common causes

Bot protection or WAF rules

Security products that challenge unknown visitors, block data-centre IP ranges or rate-limit bursts of requests can answer Google's crawler with a 403, a CAPTCHA page or a timeout while your browser sees a normal page.

Rate limiting during feed verification

Merchant Center fetches many landing pages in a short window. If errors appear in batches on a few days rather than on the same products every time, the server or CDN is throttling the crawler.

Country or IP blocking

Geo-blocking rules that allow only your home country can block Google, which crawls mostly from the United States. The page is fine for customers and unavailable to the one visitor that approves your listings.

Slow or failing server responses

Pages that take many seconds to respond, or return 5xx errors under load, time out for the crawler. Heavy apps and uncached product pages are the usual cause.

Password or maintenance mode

A storefront password, a coming-soon plugin or a maintenance page left on for one domain or subdomain makes every landing page unavailable to anyone who is not logged in.

Fix it on your platform

On Shopify

  1. Confirm the storefront password is off under Online Store > Preferences for the domain in your feed.
  2. If a third-party CDN or proxy sits in front of Shopify, check its firewall and bot settings and allow verified search engine crawlers.
  3. Check that the domain in the feed is the primary domain or redirects to it cleanly, not to a password page.
  4. Remove apps that block visitors by country if you advertise in countries they block.

On WooCommerce

  1. Check security plugins (login protection, firewall, country blocking) for rules that block Googlebot or data-centre IPs.
  2. Look at the server access log for requests with the Googlebot user agent and the status codes they received.
  3. Enable page caching for product pages so crawler bursts do not overload PHP.
  4. Disable maintenance or coming-soon mode for the public site.

On other platforms

  1. In your CDN or WAF, allow verified search engine bots and avoid challenge pages for them.
  2. Check server logs for 403, 429 and 5xx responses to Googlebot in the window when errors appeared.
  3. Make sure product pages respond in a few seconds without JavaScript.

How to confirm it is fixed

  1. Run the product page check on an affected URL to see the status an outside request receives.
  2. Use URL Inspection's live test in Search Console on the same URL; a successful live test means Googlebot can fetch it now.
  3. Re-run the check at a different time of day to catch rate limiting that only appears under load.
  4. Once fetches succeed, wait for Merchant Center to recrawl or request a review of the affected items.

Questions

Why does Merchant Center say my page is unavailable when it loads fine?
Your browser and Google's crawler are treated differently. Security rules, rate limits and country blocks often apply to automated visitors from data centres but not to a normal browser. Check what an outside request receives to see the page as Google does.
Does Cloudflare block Googlebot?
Cloudflare generally treats verified search engine bots as allowed, but custom firewall rules, country blocks or aggressive security settings can still block or challenge them. Review your custom rules and check your logs for blocked Googlebot requests.
How do I know if rate limiting is causing the errors?
Look at the pattern. If different products fail on different days and succeed when checked again later, the problem is usually rate limiting or server load, not the pages themselves. Server logs showing 429 or 503 responses to Googlebot confirm it.
Will fixing the block restore my products automatically?
Once Google can fetch the pages, affected items are rechecked on the next crawl, and many recover without further action. If they stay disapproved, request a review in Merchant Center.
Can a slow website cause landing page errors?
Yes. If a page takes too long to respond, the crawler can give up and report it as unavailable. Caching product pages and removing heavy apps improves response times for both Google and shoppers.
Find out if this is happening to you

Shipwork requests your product pages from outside your network the way a crawler would, and reports exactly what came back. Free, no account, no signup. Paste your store address.

Check my store for Product page unavailable

Go deeper: Landing page requirements

See the check: What a crawl of your sitemap finds

Other errors like this