Skip to content
SeitenreportSEO & Website analysis since 2007
Free SEO checkCheck for free
EN
Choose language
Deutsch English
Menu

Technical indexability

Keep an eye on Noindex, Robots and Canonicals.

A page can look normal and still send false signals to search engines. Monitor the technical specifications of important URLs so that unintended changes are noticed.

From Pro · selected URLs · Checking with the regular website crawl.

After an update

An important page must not accidentally disappear.

The new performance page is online, the navigation works and everything looks right in the browser. In HTML, however, there is still a noindex note from the preparation. Or the template sets the same canonical on all product pages. Such errors are difficult to detect with mere clicking through.

The indexability monitoring of the SEO Suite checks selected URLs for new noindex statements, robots locks and modified canonicals. This makes sense especially for pages whose findability is important for your business.

Making a conscious choice

  • Central performance and category pages.
  • Important guides and campaign pages that should appear in the search.
  • Landing pages after a relaunch or URL change.
  • Example pages of templates whose SEO output has just been changed.

Shopping cart, internal search or other deliberately excluded areas do not automatically belong in the same selection. First, specify which URLs should actually be indexable.

Technical classification

Robots, Noindex and Canonical perform different tasks.

Robots.txt: Can the crawler retrieve?

A robots rule controls access for suitable crawlers. A blocked URL is therefore not reliably removed from the search index. If Google cannot retrieve the page, it cannot read out a noindex statement there. Google explains this difference.

Noindex: Should the page be excluded from the search?

A noindex statement can be in the meta-robots tag or in the HTTP header X-robots tag. For an important entry page, you should check a newly recognized statement. For an intentionally excluded area, however, the same value may be correct.

Canonical: Which version is preferred?

A canonical refers to the preferred URL of a content. A change is not automatically wrong, but must fit the page structure. In particular, check if an important detail page suddenly points to the homepage, a category, or another domain. Google considers canonicals as a signal; the indication does not guarantee the selection of this URL. Foundations for Canonization.

After an Accuracy

First check the delivered condition.

Checking the affected URL

Open the message and check the URL and time of measurement. Then see which instructions the website currently delivers. In the case of a template error, it is worth the counter-rehearsal with a second side of the same type.

Correct the cause where it arises: for example, in the page properties of the CMS, in the template output or in the server configuration. After the change, check again whether the desired condition is actually shipped.

Complement the Google Perspective

Technical indexability is a prerequisite, not a confirmation of indexation. With this monitoring, the suite does not query the Google index status of your URLs. For this, use the URL check and the indexing report of your Search Console.

Even after a correction, retrieval and processing by Google do not have to be carried out immediately. Therefore, do not accept a technically corrected result as a blanket statement “listed again on Google”.

Supervision from Pro

Check important URLs in the rhythm of your website crawls.

The monitoring is included in the SEO suite from Pro, for 39 € net per month with monthly payment, plus VAT. You activate them in the project and select the landing pages and your email messages.

When the data are renewed

The exam is tied to the crawl: weekly in Pro, daily in Business and Agency. It collects the selected URLs that can be checked within the quota. Missing measurement data is not a confirmation that a page is okay.

Examine a single URL immediately

For a point-by-point technical examination, use the Indexability Checker. If you only want to know which information a page currently delivers, this is the direct entry. The suite complements the recurring observation.

Good to know

Issues related to indexability monitoring

Does monitoring show if a URL is indexed on Google?

No. It controls technical information on your website. Examine the actual Google index status in the Search Console. A technically indexable page is not automatically indexed.

Are noindex statements from HTTP headers also taken into account?

Yes. Monitoring uses both captured meta-robots noindex statements and X-robots tag noindex from the HTTP response. The decisive factor is which data is available in the crawl for the landing page.

Can I consciously monitor excluded sites?

Select the landing pages according to your desired state. An intentionally noindexed page can otherwise produce expected anomalies. Monitoring does not independently assess which pages for your business model should appear in the search.

When does a resolved anomaly become visible?

After a renewed, successful capture of the affected URL in the intended check sequence. Pro crawls weekly, business and agency daily. Whether Google has already processed a correction is independent of this.

Appropriate next steps

Checking related technical signals