Crawled vs Indexed: What the Difference Actually Means
You look at Search Console and see a status for one of your pages. It reads “Crawled – currently not indexed,” and you stare at it, unsure what it actually means. Didn’t Google already look at this page? Why isn’t it showing up in search results then? The confusion almost always comes down to one thing: not understanding crawled vs indexed status.
This confusion is one of the most common in all of SEO. It comes from treating crawling and indexing as the same step. They are not. Understanding crawled vs indexed status is a useful piece of knowledge. It helps you diagnose almost any visibility problem your website has.
Most beginner explanations of SEO gloss over this distinction entirely, which is exactly why it trips people up later. You read that Google “crawls the web” in one explanation and “indexes pages” in another. The two phrases blur together until they sound like the same event. In practice, they represent two entirely separate decisions, made at two different points in time, sometimes days or weeks apart. Every troubleshooting step in this guide flows from keeping that separation clear in your head.
This guide breaks down exactly what each term means and how they relate to each other. It also covers what to do when a page gets stuck between the two.
Table of Contents
- What crawling actually means
- What indexing actually means
- Why a page can be crawled but not indexed
- Crawled vs indexed: the four possible states every URL can be in
- How to check your crawled vs indexed status
- What to do about each state
- Frequently asked questions
What Crawling Actually Means
Crawling is the discovery step. Googlebot, Google’s automated crawler, visits a URL and downloads its content. It then follows the links on that page to find more URLs. Think of crawling as Google’s way of reading a page for the first time.
Crawling alone does not guarantee anything about search visibility. Google can crawl a page and then decide the page does not belong in search results at all. That decision depends on what it finds during the crawl. Crawling is simply the act of looking, not a judgment about quality or relevance.
Google’s official documentation on how search works describes crawling as the process that feeds everything else. Without crawling, indexing cannot happen at all, since Google has to see a page before it can evaluate it.
What Indexing Actually Means
Indexing is the evaluation and storage step. After crawling a page, Google analyzes its content and determines what the page is about. It then checks the page against quality and relevance signals and decides whether to add it to the index. The index is the enormous database Google actually searches through when someone types a query.
A page that makes it into the index becomes eligible to appear in search results. A page that Google crawls but declines to index never becomes eligible. It makes no difference how good its target keyword is or how much effort went into writing it.
This is why indexing, not crawling, is the step that determines whether your content can ever be found on Google. Crawling gets your page noticed. Indexing gets it stored somewhere searchers can actually reach it.
Why a Page Can Be Crawled but Not Indexed
This gap surprises most website owners because it feels counterintuitive. If Google already visited the page, why would it choose not to include it? A few common reasons explain this pattern.
Content quality concerns
Google may judge a page as thin, low-value, or too similar to other content already in its index. When that happens, Google can still crawl the page successfully but decide not to store it. This is one of the most frequent reasons behind the “Crawled – currently not indexed” status. It gets a full walkthrough in How to Diagnose “Crawled – Currently Not Indexed”.
Duplicate or near-duplicate content
Your page might closely resemble another page, whether on your own site or elsewhere on the web. When that happens, Google may still crawl it but choose a different URL as the canonical version to index instead.
Crawl budget and prioritization
Large websites in particular can run into a delay between crawling and indexing. Google crawls the page normally but takes a long time to decide on indexing. This usually happens simply because it is prioritizing other, higher-value URLs first.
Recency and trust signals
A brand new page on a brand new domain sometimes gets crawled quickly but waits longer for indexing. This delay happens because Google has not yet built up enough trust signals about the site as a whole. Without that trust, Google is slower to prioritize adding every page immediately.
Crawled vs Indexed: The Four Possible States Every URL Can Be In
Every page on your website falls into one of four combinations of crawled and indexed status. Understanding these four crawled vs indexed states clarifies exactly where the real problem sits.
1. Not crawled, not indexed
Google has not discovered the page yet at all. This is common for brand-new pages and orphaned pages with no internal links pointing to them. It also happens with pages blocked entirely by robots.txt.
2. Crawled, not indexed
Google found and visited the page but chose not to add it to the index. This is the state behind the confusing “Crawled – currently not indexed” message. It is usually tied to content quality, duplication, or canonicalization decisions.
3. Not crawled, but indexed
This sounds contradictory, but it can happen briefly. Google sometimes indexes a URL based on external signals, such as links pointing to it. That can happen before fully crawling the page’s actual content. This state is usually temporary and resolves once a real crawl occurs.
4. Crawled and indexed
This is the goal state. Google has visited the page, evaluated it, and added it to the index. That addition makes the page eligible to appear in search results based on relevance and ranking factors.
How to Check Your Crawled vs Indexed Status
Google Search Console gives you a direct answer rather than requiring guesswork.
Open the URL Inspection tool and enter the exact URL you want to check. Look at two separate pieces of information. The crawl status tells you when Google last visited the page. The indexing status tells you whether the page made it into the index. Together, these two data points reveal the page’s true crawled vs indexed status. Google Search Console is free and remains the only source that reflects exactly what Google itself sees.
A result showing both a recent crawl date and “URL is on Google” confirms the ideal state. The page might instead show a crawl date without the “URL is on Google” confirmation. In that case, it is stuck between crawled and indexed. No crawl history at all means Google has not found the page yet.
Crawled vs Indexed: What to Do About Each State
Once you know your crawled vs indexed state, the fix becomes much clearer.
If a page is not crawled at all, check your robots.txt file for accidental blocks. Add internal links pointing to the page from already-indexed content. Also submit the URL through Search Console’s sitemap or Request Indexing feature.
If a page is crawled but not indexed, focus on content quality first. Add genuine depth, remove duplication, and make sure the page offers something a similar, already-indexed page does not. Then request indexing again once the improvements are live.
If a page shows indexed without a recent crawl, usually no action is needed. Google will crawl it in due course, and the temporary state typically resolves on its own within a short window.
If a page is both crawled and indexed but still not ranking, the problem has shifted. It has moved from an indexing issue to a ranking issue. Ranking depends on a different set of factors, like content relevance, backlinks, and competition.
A Real-World Example
A software company published a detailed comparison article between two tools in its category. Two weeks after publishing, the marketing team checked Search Console and found the page listed as crawled but not indexed.
On closer review, the article closely mirrored the structure of three other comparison posts already live on competing websites. It even echoed some of their phrasing. Google had crawled the page fine but likely judged it too similar to existing indexed content. As a result, it declined to add another near-duplicate version to its index.
The team rewrote the article to include original testing notes and screenshots from their own trial of both tools. They also built a comparison table from their own criteria rather than a generic template. After requesting indexing again, the page moved into the index within eleven days. It began ranking for its target terms shortly after.
This example illustrates the core lesson well. Crawled but not indexed is rarely a technical block. It is far more often Google’s way of saying a page has not yet proven itself. The page has not shown it deserves a spot next to everything else already competing for the same search.
Why This Distinction Trips Up So Many Website Owners
Part of the confusion comes from language. Search Console uses the word “crawled” in a status message. It is natural to assume that once Google crawled something, the job is done. But crawling is closer to a librarian picking up a book and skimming the cover. Indexing, by contrast, is the decision to actually shelve it where readers can find it. A librarian can pick up a book, skim it, and decide it does not belong on the shelf at all.
The other source of confusion is that most SEO advice focuses on the indexed side of the equation. That focus exists since that is where rankings and traffic live. Crawling gets treated as a technical footnote rather than a distinct stage with its own failure points. That framing leaves site owners unequipped when a page gets stuck specifically at the boundary between the two. That boundary is a more common failure point than either extreme.
How Site Size Changes This Equation
The relationship between crawling and indexing shifts depending on how large your website is. A small business site with twenty pages rarely runs into crawl budget issues. Google can crawl a site that size quickly and repeatedly. Indexing delays on a small site almost always trace back to content quality or a technical block. They rarely happen simply because Google ran out of time to look.
Large websites with thousands or tens of thousands of pages face a different reality. Google allocates a finite crawl budget to every site, and that budget has to stretch across every URL. On sites this size, some pages may sit uncrawled for extended periods because Google has not gotten to them yet. Nothing is necessarily wrong with the page itself. Prioritizing your most valuable content in your internal linking and sitemap structure becomes essential at this scale. Doing so signals to Google which pages deserve crawl budget first.
Common Myths About Crawled vs Indexed Status
A few misconceptions about crawled vs indexed status circulate widely enough that they are worth addressing directly.
Myth: A recent crawl date means the page is indexed. A crawl date only confirms Google visited the page. It says nothing about whether that visit resulted in indexing. Always check the actual indexing status separately.
Myth: Resubmitting your sitemap fixes a crawled vs indexed gap. Sitemaps help Google discover URLs it does not yet know about. They do nothing to change a decision Google already made. Google may have crawled that page but chosen not to index it.
Myth: More content automatically fixes “Crawled – currently not indexed.” Volume alone rarely solves this. Google’s decision usually comes down to whether the page offers something genuinely different from what already exists in its index. Length has little to do with it.
Myth: Crawled vs indexed status is permanent once set. Google re-evaluates pages continuously. A page stuck as crawled but not indexed today can move into the index next month if you improve it. Likewise, a currently indexed page can just as easily drop out later. This scenario is covered in Why Google Indexed Your Page and Then Removed It.
Frequently Asked Questions
What does crawled vs indexed actually mean in simple terms?
Crawled means Google visited and read the page. Indexed means Google decided to store that page in its searchable database. A page can be crawled without ever being indexed, which is the core of the crawled vs indexed distinction.
Does every crawled page eventually get indexed?
No. Google can permanently decide not to index a page it considers low-value, duplicate, or irrelevant. This can happen regardless of how many times the page gets crawled.
How often does Google recrawl a page that is not indexed?
This varies significantly based on site authority and crawl budget. Some pages get recrawled within days. Others may wait weeks or longer without any explicit action from the site owner.
Can I speed up the gap between crawling and indexing?
You cannot force indexing directly. But improving content quality and building relevant internal links both help. Requesting indexing through Search Console increases the odds further that Google indexes the page sooner.
Is a high crawl frequency a good sign?
Frequent crawling generally indicates Google considers your site worth revisiting often, which is a positive signal. However, frequent crawling alone does not guarantee indexing if content quality concerns exist.
Should I resubmit my sitemap if a page stays crawled but not indexed for weeks?
Resubmitting the sitemap rarely changes anything on its own, since Google already knows the page exists. Improving the page’s content is a more effective use of your time. So is requesting indexing directly through the URL Inspection tool.
Is checking crawled vs indexed status something I should do for every page on my site?
For a small site, checking every important page periodically is manageable and worthwhile. For larger sites, focus first on your highest-value pages, such as top landing pages and cornerstone content. Then expand your monitoring using a bulk crawl tool rather than checking URLs one at a time in Search Console.
Building a Habit Around Crawled vs Indexed Monitoring
Most site owners only think about crawled vs indexed status after traffic already dropped. By that point, a page may have sat in a problematic state for weeks. Building a lightweight monitoring habit catches these issues much earlier.
A simple approach works well for most small and medium-sized sites. Once a month, open the Pages report in Google Search Console and scan the excluded URLs list for anything unexpected. Pay particular attention to any page that recently moved from indexed to excluded. That shift often points to a specific, fixable change rather than a gradual quality decline.
Some pages matter to your business, such as a top service page, a cornerstone guide, or a high-converting landing page. Check the crawled vs indexed status of each one right after publishing and again about two weeks later. This two-check habit catches the majority of indexing problems while they are still easy to diagnose. It happens well before they show up as a mysterious traffic drop months down the line.