LocalSEOFlow

Free Indexability Checker: Bulk Test Noindex, Robots.txt and Canonicals Online

🔒 No login100 URLs per run🤖 robots.txt tester✅ Plain fixes

Loading tool…

Was this tool helpful?

Rate it in one click. No sign-up, one rating per person.

One Hidden Tag Can Keep a Page Out of Google

Most pages that never index are blocked by something small the owner never saw.

  • A leftover noindex

    A staging setting or SEO plugin toggle that went live with the site.

  • A robots.txt rule

    One Disallow line written for a folder that also catches your real pages.

  • A canonical pointing away

    A theme or plugin that sets every page's canonical to the home page.

  • A header you cannot see

    An X Robots Tag noindex sent by the server, invisible in the page source.

Sample verdicts
/services/Indexable
/locations/dallasnoindex in meta
/blog/old-postRedirect in sitemap
/shop/?sort=priceBlocked by robots.txt
/aboutIndexable

An indexability checker finds that blocker in seconds, before you waste weeks waiting.

What Free Means on This Indexability Checker

It is free with no account and no Google login.

You get

  • Up to 100 URLs per run, pasted or from a sitemap
  • Status code and every redirect hop
  • Meta robots and X Robots Tag reading
  • robots.txt match with the exact line
  • Canonical and sitemap conflict checks
  • A robots.txt tester and CSV export

You don't get

  • Live index status from Google
  • Pages behind a login
  • JavaScript rendering of the page
  • Firewall or IP based bot blocks
  • More than 60 runs a day per connection

You check up to 100 URLs per run, and a run stops at about 22 seconds so it never hangs.

If a big batch hits the time limit, the tool marks the result as partial. Run the unchecked URLs again in a smaller group.

How the Bulk Indexability Check Works

Our server fetches each URL the way a crawler would, one hop at a time, and reads the signals Google uses to decide if a page may be indexed.

  1. Add URLs or a sitemap

    Paste up to 100 URLs, one per line, or enter a sitemap address. Index sitemaps and gzip files work.

  2. Follow the redirects

    Each hop is recorded up to five. Longer chains or loops are flagged as errors.

  3. Read robots.txt

    The rules are matched for Googlebot using Google's documented logic, with the line number shown.

  4. Read the page head

    The tool checks meta robots, the X Robots Tag header and the canonical tag.

  5. Compare against the sitemap

    It checks if each URL appears in your sitemap and flags signals that fight each other.

  6. Get a verdict

    Each row says Indexable, Warning or Not indexable, with a plain fix. Export it all to CSV.

The Signal Conflicts Other Checkers Miss

Many tools check each signal alone.

Disallow plus noindex

Google cannot read the noindex on a blocked page, so the URL may still be indexed without a snippet.

Noindex in the sitemap

The sitemap asks for indexing while the page says no.

Error page in the sitemap

A 404 or 5xx URL listed as if it were live.

Redirect in the sitemap

The sitemap should list the final URL, not the old one.

Canonical elsewhere, still listed

List only the canonical version in your sitemap.

Blocked but listed

A sitemap URL that robots.txt stops crawlers from fetching.

This one also flags when two signals send Google opposite messages.

Fixing conflicts often clears a whole group of Search Console warnings at once.

Where Blockers Usually Hide on Each Platform

The checker works on any public site in any country.

WordPress

Common source of the blocker
Settings, Reading, the box that discourages search engines, or a Yoast or Rank Math setting per page

Shopify

Common source of the blocker
robots.txt.liquid edits and theme code that adds noindex to collections or tags

Wix and Squarespace

Common source of the blocker
Page SEO settings that hide a page from search results

Custom builds

Common source of the blocker
Server headers, staging rules copied to production, or canonical tags in a template

PDF files

Common source of the blocker
X Robots Tag noindex set at the server for documents

Here is where to look once it finds something.

A sitewide noindex after a launch is the classic mistake. If every row comes back Not indexable, look at the global setting first, not each page.

Indexability Checker vs Search Console vs Desktop Crawlers

Each tool answers a different question.

Search Console

Google URL Inspection

  • Real index status from Google
  • Rendered page view
  • One URL at a time, owned sites only

Desktop crawlers

Screaming Frog and similar

  • Whole site audits
  • JavaScript rendering
  • Install and setup, paid past free limits

This tool

Free and online

  • 100 URLs in one run, any site
  • Conflict checks with plain fixes
  • No live index status

Use this one to find blockers fast, Search Console to see what Google decided, and a crawler for a full site audit.

This tool reads the raw HTML and does not run JavaScript. If your site adds a noindex or canonical with JavaScript, confirm the rendered result in URL Inspection.

You can also check competitor pages here, which Search Console never allows.

How to Fix the Most Common Indexability Errors

Most fixes take a few minutes in your CMS or server settings.

noindex found in the meta tag or header.

Remove it in your SEO plugin or page settings, or ask your host to drop the X Robots Tag header.

Blocked by robots.txt.

Narrow or remove the Disallow line the tool shows. Test the edit in the robots.txt tester tab first.

Redirect chain with more than one hop.

Point the old URL straight at the final page with a single 301.

Canonical points to another URL.

Make the canonical point to the page itself if you want this page indexed.

Recheck the URL after each change.

Once the page passes, push it with our free IndexNow tool and request indexing in Search Console.

What an Unchecked Blocker Costs You

A page that cannot be indexed earns zero search traffic, no matter how good it is.

Weeks of waiting

People wait for Google when the page was never allowed in.

Wasted content spend

Writing and links pointed at a page Google cannot keep.

Sitewide mistakes

One robots.txt line can block hundreds of pages at once.

For a local business, that might be the one city page that brings in calls.

My own view is that indexed pages start ranking sooner. When I launched two new sites, a plain sitemap submit got both indexed in about 12 hours.

That only works when the pages are open to crawlers in the first place. Build or fix your sitemap with our XML sitemap generator.

Who Uses a Free Bulk Indexability Checker

Anyone who launches, migrates or fixes pages and wants a fast second opinion.

Local business owners

Check new service and location pages before you promote them.

SEO agencies

Audit a client sitemap in one run and send the CSV as proof.

Developers

Confirm staging rules did not reach production after a launch.

Store owners

Make sure product and category pages are not blocked by filters or tags.

What We Fetch and What We Keep

The check reads only public pages, and results are sent back to your browser.

Public pages only

We fetch the URLs you enter plus their robots.txt and sitemap. Private and internal addresses are refused.

No account

Nothing ties a check to your name or email.

Honest user agent

Requests identify as the LocalSEOFlow checker, so a firewall may treat it differently from Googlebot.

Your report

The CSV is built in your browser and saved only where you choose.

Indexability Checker FAQ

10 answers about limits, results and how the tool works.

What is an indexability checker?

An indexability checker tests whether anything technical stops a search engine from indexing a page. It looks at the status code, redirects, noindex tags and headers, robots.txt rules and the canonical tag. If all of those allow indexing, the page is indexable. Whether Google actually indexes it is a separate decision.

Does this tool tell me if Google has indexed my page?

No. It checks for blockers, not live index status. It does not query Google. For that, use URL Inspection in Search Console, which shows what Google decided. Run this checker first so you know nothing technical is in the way before you ask Google to look again.

Can Google index a page blocked by robots.txt?

Yes. robots.txt stops crawling, not indexing. If other sites link to a blocked URL, Google may index it without a snippet, because it could never read the page. To keep a page out of results, allow crawling and add a noindex tag. The checker flags this exact conflict.

What is the difference between noindex and robots.txt?

Noindex tells search engines not to show a page in results. robots.txt tells crawlers not to fetch it. Use noindex for thank you pages and thin tag pages. Use robots.txt to save crawling on endless filter URLs. Never use both on the same page, or Google cannot see the noindex.

How do I find an X Robots Tag header?

You will not see it in the page source, because the server sends it with the response. Browser developer tools show it under the network tab. This checker reads response headers for every URL, so a hidden noindex header appears right next to the meta tag result.

How many URLs can I check at once?

Up to 100 URLs per run. Paste them one per line or enter a sitemap address, and the tool reads the first 100 URLs from it. For bigger sites, split your sitemap by section, like posts and pages, and check each one. You can run the tool up to 60 times a day.

Why does my page pass here but still not index?

Passing means nothing technical blocks it. Google may still skip a page it sees as thin, duplicate or low priority, which Search Console shows as crawled, currently not indexed. Improve the content, add internal links from strong pages, and request indexing again. Give it a few weeks.

Is the robots.txt tester accurate for Googlebot?

It follows Google's documented matching rules. The most specific rule wins, Allow beats Disallow on a tie, and wildcards work. You can test as Googlebot, Bingbot, GPTBot or any user agent. It cannot see firewall rules that block bots by IP, so a page can pass here and still fail.

Does a canonical to another page stop indexing?

Usually. Google treats the canonical as a strong hint. If your page points its canonical elsewhere, Google will most likely index the other URL and drop yours. If you want this exact page in results, set its canonical to itself and list that same URL in your sitemap.

Does it work for Shopify and WordPress sites?

Yes. It works on any public URL in any country, whatever platform built it. WordPress, Shopify, Wix, Squarespace and custom sites all return the same signals. The tool only reads public responses, so you never connect an account or install a plugin.

Find the Blocker Before You Ask Google to Look

Check status codes, robots rules, canonicals and your sitemap in one run.

Free Tool Workflow

Next Step: Free Tools in This Workflow

Continue your workflow with these related free tools. No login required.

🔒 All tools are 100% free · No login required · Files never leave your device