ShipworkSite inspection
Checks

Crawlability

PaginationAre paginated pages set up right?Internal searchIs site search eating crawl budget?URL parametersAre parameters creating duplicates?Log analyserWhat does Googlebot actually crawl?Robots builderNeed a robots.txt file?Soft 404sAre pages “not found” but returning 200?JavaScriptCan crawlers see it without running JS?FreshnessIs my site quietly going stale?Robots.txtDoes robots.txt say what I think?

Indexing

Sitemap lastmodAre my sitemap dates valid?SitemapIs my sitemap actually fetchable?IndexingIs Google allowed to index my pages?CanonicalsIs Google indexing the wrong URL?Index signalsDo sitemap and index signals agree?Sitemap generatorNeed a sitemap.xml for my site?Bulk URL statusWhere does each of these URLs really land?Redirect builderNeed the redirect rules?RedirectsAre my URLs answering directly, over HTTPS?

On-page

Keyword ideasWhat are people searching for?SERP previewHow does my page look in Google?Content qualityAre your pages too thin or too alike?Image weightAre images slowing the page?CannibalizationAre pages competing with each other?On-page checkDoes the page use its target phrase?ImagesAre my images accessible and loading?Meta tag builderWhat should my title and share tags say?DuplicatesDo my pages compete for one query?

Links

Orphan pagesWhich pages can no link reach?Link graphHow deep do your pages sit?Anchor textDo links say what they point at?Outbound linksAre external links still alive?Broken linksAre internal links sending visitors nowhere?

Structured data

Rich resultsIs my markup eligible for a rich result?Structured dataIs my product schema valid?Schema coverageDo my key pages carry structured data?Social previewHow does my page look when shared?Schema vs pageDoes markup match the page price?Schema builderNeed valid JSON-LD?

International

Hreflang sitemapDo page and sitemap hreflang agree?HreflangDo my language versions link back?Hreflang builderNeed the hreflang tags?Page DoctorWhy is this page not doing well?Redirect planMy site has dead links — what redirects do I write?Sitemap diffIs anything missing from my sitemap?Robots simulatorWhat does my robots.txt actually block?Can Googlebot?Can Googlebot fetch this URL?
Every error, explainedGuides
Pricing Learn Error guides Run free audit

+1 free check

Welcome to Shipwork

Sign in free and your next check this month is on us.

Continue with GoogleContinue with email

We email you a 6-digit code. No password.

No card needed. Reports and watches follow you to any device.

llms-full.txt: the whole site in one file

llms.txt is a short index of links. llms-full.txt is a companion convention: one Markdown file with the full content of those pages, so an AI tool can read everything in a single request. It is most useful for documentation.

Published

How it differs from llms.txt

llms.txtllms-full.txt
ContentsSite summary and a list of links with descriptionsThe full text of the listed pages, in Markdown
SizeUsually a few kilobytesCan be hundreds of kilobytes or more
UseLets a reader pick what to fetchLets a reader load everything at once

Neither file is an official web standard, and AI providers have not committed to reading either. llms-full.txt spread mainly through documentation platforms, where developers paste a docs site into a coding assistant.

When it helps

  • Documentation and APIs: developers and coding agents can load the full docs in one go.
  • Small, stable sites: a full copy is easy to keep accurate.
  • Not for large stores or news sites: a file of every product or article goes stale quickly and becomes too large to be useful.

How to build one

  1. Start from the page list in your llms.txt.
  2. Convert each page’s main content to Markdown, without navigation, footers or cookie banners.
  3. Join them under H2 headings with the source URL for each section.
  4. Generate it at build time so it stays in step with the pages, and serve it at /llms-full.txt as plain text.

Start with llms.txt; the generator builds it in a minute. Add llms-full.txt only if people actually load your content into AI tools.

Find out if this is happening to you

Shipwork checks whether /llms.txt exists and is served as text, alongside AI crawler access in robots.txt. Free, no account, no signup. Paste your store address.

Generate an llms.txt

Questions

Do I need llms-full.txt?
Usually not. It mainly helps documentation sites. Start with llms.txt.
Where does llms-full.txt go?
At the site root, next to llms.txt, served as plain text.
Is llms-full.txt part of the llms.txt proposal?
It is a companion convention that grew up around the proposal, popularised by documentation tools, rather than part of a formal standard.

Keep reading