Meta Robots Checker: noindex and X-Robots tag check
Free individual check · without registration
See which robots rules a URL delivers, where they come from, and which ones apply to Google web search. Contradictions are explained with the appropriate next step.
Result of test
Ready
- Checked final URL
- —
- HTTP status
- —
- Noindex for Googlebot
- —
- Nofollow for Googlebot
- —
What should you do next?
Robots Rules and Their Sources
The assignment refers to Googlebot for web search. The result proves no inclusion in the Google index; robots.txt and JavaScript are not checked here.
| Source | Scope of application | Rule found | Google web search |
|---|
snapshot of the retrieved response. No JavaScript rendering, no access to Google index data.
noindex found: What should you change?
First, set whether the checked page should appear in Google Search. A public performance page needs a different setting than an internal search results page. The checker shows technical rules, not actual Google index data.
The page should appear on Google
Remove unintentional noindex or none from the listed sources for Googlebot. Check the page’s SEO setting, template and HTTP header on the server or CDN. An additional index Does not repeal another noindex rule.
The site should remain excluded
An intended noindex rule does not need to be removed. Google must be able to read them when they are called up. A lock in robots.txt can prevent this. Confidential content is protected with access control; noindex is not access protection.
Example: Conflicting Sources
<meta name="robots" content="index, follow">
X-Robots-Tag: googlebot: noindexThe second line is an HTTP header. For Googlebot, noindex remains effective here. If you want the page to appear, correct the header configuration. If it is to remain excluded, clean up the misleading index in the HTML.
Example: Exclude only Google News
<meta name="googlebot-news" content="noindex">This rule applies to Google News. The checker shows it as a different scope and therefore does not automatically report noindex for the Google web search.
After the correction
If necessary, empty page and CDN caches. Check the same final URL again and then check the URL check in Search Console as Google sees it. Changes only take effect when Google recaptures them.
Basis: Google Documentary on Robots Meta Tags and X Robots Tag.
Frequently Asked Questions about Meta Robots
Does “no noindex found” mean that the page is indexed?
No. Only no corresponding rule was found in the read answer. HTTP status, other directives, robots.txt, canonical and Google’s selection can affect indexing. Check the actual state in the Search Console.
What does none mean?
None is equivalent to Noindex and Nofollow. The rule excludes the page from indexing and restricts the tracking of its links. The checker considers both effects for the appropriate bots.
Is robots.txt also checked?
No. This single check reads meta and HTTP headers of the URL. For crawl locks, you also use the Robots.txt Checker. JavaScript is not executed here.
Can I also check a PDF URL?
Yes. For a PDF, the HTTP headers are evaluated. A noindex rule can stand there as an X-Robots tag; HTML meta tags do not exist in a PDF response.