Indexing: how Google stores (and uses) your pages

Indexing is what happens after crawling. Googlebot visits your page (crawling); if it likes the page, it stores it in its index (indexing).

Only indexed pages can appear in search results.

Crawling vs. indexing

• Crawling: discovery (Googlebot visits the page)
• Indexing: storage and evaluation (Google decides whether the page belongs in the index and what it’s about)

A page can be crawled without being indexed.

What prevents indexing

• noindex tag or X-Robots-Tag header
• robots.txt blocking the page
• canonical pointing to a different URL
• soft 404 behavior
• duplicate content without a clear canonical
• extremely low-quality or thin content

If your page isn’t showing up, don’t immediately assume a penalty. Start with these basics.

How to check index coverage

Google Search Console → URL Inspection Tool or Index Coverage report shows you:

• which pages are indexed
• which are excluded and why
• any errors preventing indexing

You can also use site: queries, but they’re less precise.

Link back to the glossary

Quick glossary definition: Indexing.

Related wiki terms

• Crawling
• Googlebot
• Canonical