Crawling and Website Audit
Find the errors that remain hidden when clicking through.
Defective links, conflicting SEO information or an error in the page template: The SEO crawler examines your website and makes the affected URLs traceable in the audit.
The check examines retrievable HTML. For dynamic content and user processes, supplement the check in the browser.
Website instead of single URL
What a crawler finds while walking through your website.
The start page works, the browser does not show an error message – and still links from older posts lead to the void. Such connections are rarely recognized if you only open the most important pages individually. An SEO crawler automatically retrieves URLs and evaluates the answers as well as the delivered HTML.
Seitenreport combines this inventory with a website audit. You will get results on the tested URLs and hints on what you can change. The crucial thing is not to collect as many warnings as possible, but to recognize recurring causes.
What you can look for in the result
- Accessibility: Erroneous responses and redirects on the collected URLs.
- SEO information: Page titles, meta descriptions, headlines and canonicals.
- Side connections: internal links and striking link destinations.
- Other HTML signals: technical advice on performance, accessibility and other test areas.
One mistake, many references
Start with the cause in the template.
Example: an outdated contact link
Suppose in the footer there is still a link to a deleted contact page on each subpage. In the audit, a corresponding number of references appear. Nevertheless, the work order is not "edit 80 pages", but "correct the contact link in the common footer".
If you have a finding, open several affected URLs. Do they have the same template, the same page type, or the same linked destination? This short counter-rehearsal helps to distinguish between an individual case and a systematic error.
Then the test becomes a task.
- Record the affected URL and the specific error.
- Check two or three other references before generalizing the cause.
- Implement the correction in the CMS, template or server configuration.
- After the change, check the same URLs again.
Selecting the scope of the test consciously
What the HTML crawl can see – and what you should complement.
The crawler evaluates the retrievable answers and the delivered HTML. It does not run a full browser session. Content that is only reloaded by JavaScript, as well as processes behind a login can therefore require additional checks in the browser.
Even a correctly delivered button does not yet say whether a form is successfully sent. Test central ways such as contact, registration and order by hand. Furthermore, a technical finding on a barrier is not a complete accessibility test.
Briefly clarify before the start
- Is this the public website you want to investigate?
- Is the selected URL quota large enough for a meaningful overview?
- Which page types must be represented in the result?
- Are there access rules or protection systems that restrict retrieval?
A statement about unrecorded URLs cannot be derived from the result. For important landing pages, it is therefore always worth taking a look at whether they are actually included in the crawl.
One-time check or regular crawl
The first crawl is free.
Enter your website address at the top. The free check checks up to 20 URLs without registration. This is enough for a first impression; for a larger website, it is not yet a complete inventory.
Completing a concrete project
For 99 € net plus VAT you can unlock a website audit for up to 2,500 URLs. Included are full results, exports and a follow-up audit of the same website within 90 days of payment. Both reports remain accessible until the end of this period; the follow-up audit does not extend it.
Observe changes permanently
The SEO Suite starts at 19 € net per month with monthly payment. Starter and Pro crawl weekly, business and agency daily. The URL quotas apply jointly to all projects per crawl round. Exports are included from Pro.
Good to know
Questions about Website Crawl
Do I need to install the first crawl software?
No. You enter the website address in the form. The analysis runs on the Seitenreport servers. For the free check up to 20 URLs no registration is required.
Is my entire website always being investigated?
The scope depends on the selected quota, the URLs found and their retrieval. In the result, check which URLs were actually captured. A free check up to 20 URLs cannot fully map an extensive website.
Does the crawler run JavaScript?
The current crawl works with HTTP responses and the delivered HTML. A complete browser rendering is not included. Check content that is only created by JavaScript, as well as interactive processes in the browser.
How do I control a correction?
Check the affected URLs again after implementation and pay attention to a comparable scope. The paid individual audit includes a follow-up audit of the same website within 90 days of payment. The suite complements regular crawls as per tariff.
Appropriate next steps
Continue working specifically after the crawl
- SEO quality assurance
Review findings before and after a publication.
- Creating SEO Reports
Comprehensively hand over results to customers and implementation teams.
- Shop monitoring
Sensibly check categories, products and filter areas.
- Audit scope of the audit
Get to know the available test areas and their limitations.