robots.txt.liquid, theme metadata and apps
Check individual robot snippets and SEO app rules in the active theme. A preview or test rule must not exclude a public product page.
Compare the public robots.txt with existing adjustments in the robots.txt.liquid template. This template replaces the standard output; changes must not accidentally lose required standard rules. Meta-robots are created separately in HTML.
Where to Check Settings in Shopify
Examine an existing robots.txt.liquid and the robots meta tags issued in the theme or through apps separately. When customizing the robots file, do not adopt a complete third-party template that unintentionally removes platform rules.
Example of this specific finding
Illustrative control case: The new offer page was taken over from a staging template and still bears noindex after publication.
follow-up audit in Shopify
Before and after the adjustment, test the same desired and still excluded paths. Don’t confuse a crawl ban with removing an HTML noindex.
Check page-related settings, templates and possible HTTP headers. After cleanup, check the public response without logged-in session.
Derogations and scope
A deliberately not yet released page may remain excluded. Importance and release must be clarified before the change.
Related: Shopify Online Store with Liquid-Theme. Hydrogen or other headless storefronts have their own rendering and hosting responsibilities.
Classify the general error
Definition, system-independent causes and further correction examples: Exclude a release brake from the test phase