ShelfHoundInstall on Shopify

Guides

How to check whether Shopify robots.txt is blocking Google

Read the public directives, identify the affected user agent and paths, and compare them with a known-good baseline.

The direct answer

Fetch the final public robots.txt response and inspect which user agent a disallow rule applies to. A global block is materially different from a rule scoped to a bot or a path Shopify intentionally protects.

What to inspect

Start with the smallest set of facts that can explain the shopper outcome. Keep configuration and public evidence separate so a setting that looks correct does not become a fabricated pass.

  • Final response after redirects
  • User-agent scope
  • Disallow path
  • Baseline change

A safe verification sequence

Work from the first upstream dependency toward checkout. When an earlier stage fails, later stages are unverified—not additional problems. Repeat material failures in an independent session before interrupting anyone.

  1. 01

    Save the exact directive

  2. 02

    Check the canonical domain

  3. 03

    Confirm a change independently

  4. 04

    Use Search Console for Google-specific follow-up

Common false positives

Storefront monitoring crosses CDNs, localization, theme logic, Shopify-managed services, and merchant intent. These conditions deserve context before they become findings.

  • Shopify manages default directives
  • Not every disallow harms product discovery
  • A temporary edge error is not a policy change

How ShelfHound treats the result

ShelfHound resolves expectation from explicit merchant intent, current Shopify configuration, and then a stable observed baseline. A meaningful first failure becomes a candidate. Confirmed, independently corroborated divergence can become an issue. A blocked or incomplete probe remains unverified.

Every result keeps the product, Market or country, URL, probe stage, expected outcome, observed outcome, and time. Recovery is also proven with passing evidence; it is not inferred because an alert became old.

Frequently asked

What should I do first?

Save the exact directive. Then preserve the exact product, country, URL, and time so the next check is comparable.

Does one failed request mean the store is broken?

No. One request can fail because of a timeout, challenge, rate limit, stale session, or probe limitation. Material alerts require repeatable evidence.

Will ShelfHound change the store?

No. ShelfHound is read-only. It observes Shopify intent and the public storefront, creates only ephemeral carts when needed, and never places an order.