Crawlability vs Indexability: What's the Difference?
Crawlability is whether a search bot can access a page at all; indexability is whether that page can be stored and shown in results.
· By Rogier Bruggeman, Founder of KinetixSEO
Crawlability vs indexability: the core distinction
Crawlability is whether a search engine's bot can access and read a page at all, governed by robots.txt, server responses, and the links pointing to it, while indexability is whether that page is then allowed to be stored and shown in search results, governed by noindex tags, canonical tags, and content quality. A page can have one without the other. Crawlability is an access question — can Googlebot even reach the page and fetch its content? Indexability is a permission question that only applies once the bot has already succeeded — is this page allowed to go into the index it draws search results from? Confusing the two leads teams to fix the wrong problem: adding a noindex tag to a page that was never crawled does nothing, and disallowing a crawl path on a page you actually want ranked will keep it out of search entirely.
Check your own site
Want to see this on your own site?
Use your own site as the evidence. Get a free SEO and AI-citation readiness baseline, then monitor what changes.
| Attribute | Crawlability | Indexability |
|---|---|---|
| Core question | Can the bot access and read the page? | Can the page be stored and shown in results? |
| Governed by | robots.txt, server responses, inbound links | noindex tags, canonical tags, content quality |
| Failure example | Blocked by robots.txt, never fetched | Fetched fine, but tagged noindex |
| Can still appear in search? | Sometimes, via link signals only, with no snippet | No, deliberately excluded on instruction |
A concrete example of each
The clearest way to see the split is to picture two pages with opposite problems. One is blocked in robots.txt, the other carries a noindex tag, and they fail for entirely different reasons:
- Blocked but still visible: A page disallowed in robots.txt is not crawlable — the bot never fetches its content. It can still sometimes appear in search results anyway, with just a URL and no snippet, if enough external links point to it. Google is inferring relevance from link signals alone, without ever reading the page.
- Crawled but excluded: A page the bot fetches without issue, but which carries a noindex tag, is crawlable yet deliberately kept out of the index. Google read it fine and chose, on instruction, not to store it for search.
Both pages are "missing" from normal search visibility, but the fix is opposite in each case: one requires removing a robots.txt block, the other requires removing or reconsidering a noindex tag.
Why the distinction matters for an audit
Diagnosing a missing page correctly means checking crawlability before indexability, because indexability signals are irrelevant until access is confirmed. Google Search Console's URL Inspection tool reports both stages separately for exactly this reason — it will tell you whether a page was crawled, and separately, whether it was indexed. Skipping straight to "is there a noindex tag?" wastes time if the real blocker is a robots.txt disallow rule, a server error, or no discovered path to the page at all. This same layered logic extends into how answer engines and other AI systems decide what content to draw on: a page has to be accessible before any downstream quality or relevance judgment about it means anything.
For the mechanics behind each half of this distinction, see the glossary entries on robots.txt directives and noindex tags — the two control points that actually govern crawlability and indexability respectively. Understanding how Googlebot crawls a site, including crawl budget and what causes it to waste time on the wrong pages, is a useful next step once you've confirmed a page is reachable at all.
Check your own site
See how your own site scores on SEO and AI-search visibility — free report, no signup.
Use your own site as the evidence. Get a free SEO and AI-citation readiness baseline, then monitor what changes.