robots.txt.liquid, theme metadata and apps
Distinguish variant, filter and tracking parameters based on their effect. Another parameter value can represent the same product page or an independent selection.
Compare the public robots.txt with existing adjustments in the robots.txt.liquid template. This template replaces the standard output; changes must not accidentally lose required standard rules. Meta-robots are created separately in HTML.
Where to Check Settings in Shopify
Examine an existing robots.txt.liquid and the robots meta tags issued in the theme or through apps separately. When customizing the robots file, do not adopt a complete third-party template that unintentionally removes platform rules.
Example of this specific finding
Illustrative control case: /shoes/? color=red shows a purposefully maintained red shoe collection; /shoes/? utm_source=newsletter shows unchanged content. Both types of parameters require different decisions.
follow-up audit in Shopify
Before and after the adjustment, test the same desired and still excluded paths. Don’t confuse a crawl ban with removing an HTML noindex.
For each parameter function, specify whether a useful search entry is created. Adapt internal links, sitemap, canonical and, if applicable, exclusions to this decision.
Derogations and scope
Indexable parameters are not fundamentally flawed. A blanket block can exclude independent filter landing pages from the search.
Related: Shopify Online Store with Liquid-Theme. Hydrogen or other headless storefronts have their own rendering and hosting responsibilities.
Classify the general error
Definition, system-independent causes and further correction examples: Evaluate parameters by function