Storebot-Google
Google · Google crawler for Google Shopping surfaces (Shopping tab, Google Shopping) with dedicated robots.txt token Storebot-Google
By Vinespire Editorial Team, Editorial ·
Update: Verified against Google operator documentation for Storebot-Google.
This page is the operator/profile guide for Storebot-Google. To paste a full robots.txt and check Storebot-Google plus other AI crawlers in one pass, use the Robots.txt AI Crawler Validator. Short definitional entries also live in the AI search glossary.
Related free utilities are in free AI SEO tools.
What is Storebot-Google?
Storebot-Google is documented in Google’s common crawlers list as the crawler whose robots.txt preferences affect all surfaces of Google Shopping, including the Shopping tab in Google Search and Google Shopping. HTTP user-agent strings include Storebot-Google/1.0 in desktop and mobile Chrome-like patterns. The robots.txt user-agent token is Storebot-Google. Like other common Google crawlers, it obeys robots.txt for automatic crawls. Storebot-Google is commerce infrastructure rather than a generative-training agent, but it matters for AI-era product discovery because Shopping inventory and product facts increasingly feed comparison and assistant-style experiences. It is separate from Googlebot (general Search), Google-Extended (Gemini training/grounding product token), and Google-CloudVertexBot (Vertex AI Agents). Merchants and ecommerce SEO teams should configure Storebot-Google intentionally when managing product URL crawl, feed alignment, and bot management exceptions. Confirm current strings and product impacts on Google’s common crawlers documentation and Merchant Center guidance.
How to block Storebot-Google
Add this group to robots.txt to disallow Storebot-Google. Path rules can be narrowed if you only need to protect parts of the site.
User-agent: Storebot-Google Disallow: /
How to allow Storebot-Google
For most public marketing and documentation sites, allowing well-behaved AI agents is the default recommended stance for AI visibility—while remaining a factual robots.txt Allow rule you can reverse later.
User-agent: Storebot-Google Allow: /
Should you block Storebot-Google?
Ecommerce sites that want full participation in Google Shopping generally allow Storebot-Google on product and related public URLs. Blocking can limit Shopping-surface crawl without being a Gemini training opt-out (use Google-Extended for that preference). If only certain catalogs should be shoppable, prefer path-level rules, Merchant Center configuration, and accurate product data over a blanket sitewide Disallow. Blocking Storebot-Google does not replace Googlebot policy for organic Search. Validate crawler identity with Google’s verification methods if traffic volume is high. Keep checkout and account areas authenticated regardless of robots.txt.
Category: Dataset / other
Official documentation (Google)
Last verified: . Re-check operator docs after major crawler announcements.
Related bots (Dataset / other)
- Google-ExtendedGoogleControls use of content for Gemini and Google AI features (not classic Googlebot search)
- CCBotCommon CrawlBuilds the Common Crawl open web dataset used by many AI researchers and companies
- Applebot-ExtendedApplePreferences for Apple Intelligence / generative features (related to Applebot)
Storebot-Google FAQ
- Yes. Google lists Storebot-Google among common crawlers that obey robots.txt for automatic crawls.