What is indexability?

Indexability is whether a crawled page is eligible to be stored in a search engine’s index. A page can be perfectly crawlable and still be left out of the index because a signal tells the engine not to store it.

This is why some pages are crawled regularly but never appear in results. The crawler reached them, but something made them ineligible. Indexability is a core part of technical SEO.

Why indexability matters

If a page is not in the index, it cannot rank or earn traffic. Just as damaging, pages that should not be indexed sometimes are, which spreads your signals across thin or duplicate URLs and weakens the pages that matter.

Getting indexability right means two things: the pages you want ranked are eligible, and the pages you do not want ranked are cleanly excluded.

What controls indexability

  • Noindex tags. A noindex directive tells engines not to store the page. It is the most common reason a good page is missing from the index, often left over from a staging site. See Google’s guide to blocking indexing with noindex.
  • Canonical tags. A canonical tag points to the preferred version of a page. If it points somewhere else by mistake, the page you want indexed can be dropped in favor of another URL.
  • Content quality. Thin, duplicate, or near-empty pages may be crawled but judged not worth indexing.
  • Robots.txt vs noindex. Blocking a page in robots.txt stops crawling but does not reliably remove it from the index. To keep a page out of the index, allow crawling and use noindex.

How to fix indexation problems

  1. In Google Search Console, open the Pages report and review the excluded reasons, such as “Crawled, currently not indexed” or “Excluded by noindex tag.”
  2. Inspect affected URLs to see the exact reason and the canonical Google selected.
  3. Remove stray noindex tags from pages that should rank.
  4. Correct canonical tags so each important page points to itself unless you intend otherwise.
  5. Improve thin pages so they are worth indexing, or consolidate them.

Common indexability mistakes

  • Shipping a site with the staging noindex tag still in place.
  • Canonical tags that point to the home page or the wrong URL across a template.
  • Trying to remove a page from the index with robots.txt alone, which can leave it indexed without a snippet.
  • Publishing many thin pages that compete with each other.

Key takeaways

  • Indexability decides whether a crawled page can be stored and ranked.
  • Noindex tags and canonical tags are the most common causes of missing pages.
  • To keep a page out of the index, allow crawling and apply noindex, rather than blocking it in robots.txt.

Frequently asked questions

Why is my page crawled but not indexed?
Common causes are a noindex tag, a canonical pointing to another URL, or content the engine judged too thin to store. Inspect the URL in Search Console to see the specific reason.

How long does indexing take?
It varies from days to weeks depending on the site’s authority and how often it is crawled. Requesting indexing in Search Console and strong internal links can speed it up.

Part of our Technical SEO guide. For help, see our Technical SEO service.