Pages Not Indexed in Google Search Console? How to Fix It in 2027

Fix pages not indexed in Google Search Console in 2027: see which statuses to leave alone, how to fix noindex, 404, and crawled not indexed errors, and how to ship CMS or code fixes.

As seen in

  • Fox News
  • ABC News
  • CBS
  • NBC
  • Associated Press
  • USA Today
  • Bloomberg
  • HuffPost
Otto the beaver next to the Google Search Console logo
On this page6

To fix pages not indexed in Google Search Console in 2027, first check the 'Why pages aren't indexed' table in the Page Indexing report and leave normal exclusions—such as 'Alternate page with proper canonical tag' or 'Page with redirect'—alone when the canonical target is indexed. For important pages blocked by a 'noindex' tag, a robots.txt rule, a 404 or soft 404, or 'Crawled/Discovered - currently not indexed', fix the page itself, run a Live Test in the URL Inspection tool, and request indexing or submit an updated sitemap.

Why 'Not indexed' in Google Search Console is not always an error (and when it blocks AI Overviews)

Google Search Console marks a URL as 'Not indexed' whenever Google does not include that address in its search index. As documented in Google Search Console Help (Page indexing report), pages listed under 'Not indexed' have not been indexed, and not always because of an error. Aiming for every URL in the report to be indexed is the wrong goal: sites routinely generate tracking parameters, mobile or desktop alternates, and 301 redirects pointing to one canonical URL. Google does not serve duplicate pages, so seeing alternate URLs excluded when your canonical URL is indexed means canonicalization is working as intended.

Non-indexing is a real problem when canonical URLs—your homepage, service pages, booking flows, or blog posts—are excluded. In Google's AI optimization guide, Google states that to be eligible to appear in generative AI features on Google Search like AI Overviews and AI Mode, a page must be indexed and eligible to be shown in Google Search with a snippet, and that reducing duplicate content prevents search engines from wasting crawling resources on URLs you do not care about. Otto structures websites, schema, listings, and reviews so search engines and AI assistants can read and understand the business, though neither Google nor Otto promises search rankings, Map Pack placement, or AI citations. Pairing weekly checks with an Otto AI SEO Agent for weekly technical SEO and Search Console hygiene protects core URLs and connects how SEO indexing powers AI Overviews visibility to your site.

Triage first: which 'Why pages aren't indexed' statuses to leave alone vs. which to fix

The 'Why pages aren't indexed' table in Google Search Console Help (Page indexing report) groups excluded URLs by reason. Separate normal exclusions from technical blockers before editing templates:

StatusMeaning in Search Console HelpAction
Alternate page with proper canonical tagAlternate page pointing to an indexed canonical URL.Leave alone when canonical is indexed.
Page with redirectNon-canonical URL redirecting to another URL.Leave alone if target is indexed.
Duplicate without user-selected canonicalDuplicate without canonical tag; Google picked another URL.Leave alone or mark preferred canonical.
Not found (404)Returned HTTP 404 without explicit request or sitemap.Leave alone if deleted; 301-redirect if moved.
URL marked 'noindex'Google encountered a 'noindex' tag or header.Leave alone if intentional; remove to index.
Duplicate, Google chose different canonical than userGoogle indexed a different canonical than declared.Fix rel="canonical" to match similar content.
URL blocked by robots.txtBlocked by robots.txt (still indexable if linked).Unblock to index; use noindex to hide.
Soft 404Shows "not found" view with HTTP 200 status.Return HTTP 404 or add real content.
Server error (5xx)Server returned a 500-level error on request.Fix server, database, or plugin errors.
Redirect errorLong chain, redirect loop, empty or overlong URL.Debug in Lighthouse; use one 301 hop.
Blocked due to unauthorized request (401)Blocked by HTTP 401 authorization prompt.Remove login gate or verify Googlebot.
Blocked due to access forbidden (403)Returned HTTP 403; Googlebot sends no credentials.Allow unauthenticated access for public pages.
URL blocked due to other 4xx issueServer returned another 4xx client error.Inspect URL to debug the 4xx code.
Crawled - currently not indexedCrawled by Google, not indexed.Expand unique content and internal links.
Discovered - currently not indexedFound, crawl rescheduled to avoid server overload.Add internal links and cut crawl waste.

How to fix explicit indexing blocks: noindex, robots.txt, 404s, soft 404s, redirects, and 5xx errors

When an important page sits under a technical blocker in Google Search Console Help (Page indexing report), follow these five steps:

  1. Remove accidental 'noindex' directives. Inspect the URL and check Coverage > Indexing > Indexing allowed?. Remove <meta name="robots" content="noindex"> or the X-Robots-Tag: noindex HTTP header, run Test live URL to confirm under Availability > Indexing > Indexing allowed? that it is gone, and click Request Indexing.
  2. Stop using robots.txt to hide pages. Google Search Console Help (Page indexing report) notes that a robots.txt block does not stop a linked page from being indexed, and prevents Googlebot from reading a noindex tag. Remove the Disallow rule to index the page, or unblock crawling and use noindex to exclude it.
  3. 301-redirect moved 404s and flatten redirect errors. Googlebot crawls deleted 404 URLs less often over time, so leave removed pages with no replacement as 404s. Add a 301 redirect for moved pages, and replace redirect chains or loops with a direct 301 hop.
  4. Fix soft 404 responses. Run a live test and click View tested page to inspect Google's rendered screenshot. Return a real 404 HTTP status code for removed pages, or add substantial content for valid pages.
  5. Clear 401, 403, other 4xx, and 5xx errors. Check 401 and 403 URLs in incognito mode and allow non-signed-in requests, since Googlebot never sends credentials. For 5xx errors, fix the server, plugin, or database failure.

How to fix 'Crawled - currently not indexed' and 'Discovered - currently not indexed'

In Google Search Console Help (Page indexing report), 'Discovered - currently not indexed' means Google found the URL and rescheduled the crawl to avoid overloading the site, leaving the last crawl date empty. 'Crawled - currently not indexed' means Google crawled the page and chose not to index it.

Service or location pages usually hit these statuses due to weak internal links, slow mobile loads, or duplicate boilerplate across city and bilingual pages—such as in Puerto Rico, where ottowebmaster.com publishes both default English and Spanish /es/* locales. Per Google's AI optimization guide, reducing duplicate content saves crawl resources and supports Search snippet eligibility:

For example, say your clinic has three branch pages and two sit under 'Crawled - currently not indexed' because only the town name changes:

  1. For example, on each hypothetical branch page, replace shared copy with that clinic's clinicians, equipment, parking details, and local reviews.
  2. Link all three branch pages in your header and footer menus, compress photos, and run a Live Test in URL Inspection.

Otto is built for service businesses and small teams—including clinics, law firms, studios, cafés, agencies, gyms, and salons—that need their site, search, and ads kept current without hiring a full-time marketer or paying an agency retainer for routine work.

How to verify fixes with the URL Inspection Live Test, Request Indexing, and XML sitemaps

After shipping your fix, inspect the URL in Search Console and click Test live URL. Google Search Console Help (URL Inspection tool) explains that the live test cannot detect all page conditions or predict indexing with complete confidence, so URL is available to Google can still fail at indexing time. The live test does not evaluate:

  • Canonical and duplicate statuses: Alternate page with proper canonical tag, Duplicate without user-selected canonical, Duplicate, Google chose different canonical than user, and Duplicate, submitted URL not selected as canonical.
  • Crawled - currently not indexed and Discovered - currently not indexed.
  • Blocked by page removal tool (check Temporary Removals) and Page indexed without content.

For a few URLs, click Request Indexing. Per Google Search Central's guide to ask Google to recrawl your URLs, you need owner or full-user permissions, individual URLs have a submission quota where repeated requests do not speed up crawling, recrawling takes a few days to a few weeks, and requesting a crawl does not promise inclusion. For many URLs, build and submit an XML sitemap via the Sitemaps report, the Search Console API, or robots.txt as a crawl hint:

Sitemap: https://example.com/my_sitemap.xml

How to diagnose Search Console indexing and ship the website fix with Otto

Otto Webmaster is built by IslaIntel in San Juan, Puerto Rico, as an AI digital webmaster and marketing teammate with a 227-tool Model Context Protocol (MCP) server across 15 integrations—including Google Ads, Meta Ads, LinkedIn Ads, X Ads, ChatGPT Ads, Google Search Console, GA4, PageSpeed Insights, Google Business Profile, WordPress, Shopify, Instagram, Facebook Pages, LinkedIn Pages, and YouTube. Unlike ad-only tools, Otto also fixes the landing page in the same workflow by opening a GitHub pull request or WordPress draft.

You connect Google Search Console to Otto once via OAuth. Otto MCP runs over HTTP at https://otto.islaintel.com/api/mcp with a single bearer token prefixed otto_mcp__, so OAuth secrets never leave Otto's server. Supported AI clients include Claude, ChatGPT, Cursor, Claude Code, OpenClaw, and Hermes, plus WhatsApp, web app, and email. You can connect Claude to Otto MCP for read-only diagnostics across Google Analytics 4, Google Search Console, Google Ads, Google Business Profile, YouTube, Google Sheets, Shopify, and PageSpeed Insights with no spend or configuration changes:

Use Otto's Search Console and GA4 tools to list service pages with dropped impressions over the last 28 days, run psi_analyze_url on each mobile URL, and stage a WordPress draft or GitHub pull request to fix any accidental noindex tags or thin boilerplate.

Otto is not a website builder; with Otto AI Website Manager for draft-first WordPress and GitHub pull request updates, he works on the site you already have, proposes what to change, and ships changes only after you approve:

  • On WordPress, Otto provides 29 tools (15 read and 14 write), and new posts and pages stay drafts until you publish.
  • On GitHub and Vercel, every change opens as a pull request with a preview deployment.
  • Checkout, contact, and legal pages always require human approval in Otto core, otto_get_change_log records deploys, and you can approve changes from WhatsApp or review automated weekly SEO reports.

Approved clients on ottowebmaster.com include Enzo Maverick Pilates, Sensory Pilates & Wellness, Wyn Wellness, Complex Physical Therapy & Performance, Urban Boxing, and Tapper Training, with public Google reviews from Enrique Gomez, Derek Davison, and Kevin Bonet. Enrique Gomez, Owner of Enzo Maverick Pilates and Experiences Sensory, said: "Otto has been pivotal for us. The ease of making website changes on the fly lets us sharpen our brand and revise as fluidly as we need.".

Otto's blog runs Funnel-track workflows led by team members like Head of Growth & Marketing Guillermo Marti and SEO-track guides bylined to Otto Team. Otto performs the weekly execution retainers cover—site updates, SEO maintenance, ad checks, and reporting—with your approval on every change. Otto offers a $1 trial for 3 days (a trial of Pro: website updates, SEO, and read-only ads and socials, with a homepage redesign included with your $1 trial), Pro at $199/mo or $99/mo billed annually, and Master at $3,500/mo or $3,000/mo billed annually, cancel anytime. Otto MCP uses the same plans. As an honest limitation, write access to ads and socials requires the Master plan, and white-label agency portals are limited. Start $1 trial.

Written by

Otto Team

Editorial & SEO Team at Otto

Practical website, SEO, paid ads, and analytics playbooks for small businesses from the Otto team.