V/Vinespire

Google-CloudVertexBot

Google · Crawls sites when site owners request website data for building Vertex AI Agents; does not affect Google Search rankings

By Vinespire Editorial Team, Editorial ·

Update: Verified against Google operator documentation for Google-CloudVertexBot.

See our sourcing methodology →

This page is the operator/profile guide for Google-CloudVertexBot. To paste a full robots.txt and check Google-CloudVertexBot plus other AI crawlers in one pass, use the Robots.txt AI Crawler Validator. Short definitional entries also live in the AI search glossary.

Related free utilities are in free AI SEO tools.

What is Google-CloudVertexBot?

Google-CloudVertexBot is listed among Google’s common crawlers in Google’s official crawling infrastructure documentation. Google states that crawling preferences for Google-CloudVertexBot affect crawls requested by site owners for building Vertex AI Agents, and that this agent has no effect on Google Search or other products. The robots.txt user-agent token is Google-CloudVertexBot; Google also notes that Googlebot is an alternate matching token for some common crawlers, so rule design should be intentional. HTTP requests are identified by a User-Agent substring containing Google-CloudVertexBot. Like other common Google crawlers, automatic crawls obey robots.txt per Google’s common-crawler overview. This agent is enterprise-oriented: it appears when owners connect website content into Vertex AI Agent / generative app builder style workflows, not as a substitute for Googlebot Search crawl or for Google-Extended generative training preferences. Site owners evaluating AI data access should configure Google-CloudVertexBot separately from Google-Extended and from classic Googlebot. Verify current wording on Google’s common crawlers list and Vertex AI data-preparation docs when policies change.

How to block Google-CloudVertexBot

Add this group to robots.txt to disallow Google-CloudVertexBot. Path rules can be narrowed if you only need to protect parts of the site.

User-agent: Google-CloudVertexBot
Disallow: /

How to allow Google-CloudVertexBot

For most public marketing and documentation sites, allowing well-behaved AI agents is the default recommended stance for AI visibility—while remaining a factual robots.txt Allow rule you can reverse later.

User-agent: Google-CloudVertexBot
Allow: /

Should you block Google-CloudVertexBot?

Allow Google-CloudVertexBot when your organization intentionally uses Vertex AI Agents or related Google Cloud features that crawl your public site content under owner request. Blocking is reasonable if you do not use those products or if compliance requires limiting Google Cloud AI website ingestion—Google documents no Search ranking impact for this token. Do not confuse a CloudVertexBot block with Google-Extended (Gemini training/grounding preferences) or with Googlebot (Search). If you allow Googlebot broadly but want to limit Vertex website crawls, use an explicit Google-CloudVertexBot Disallow group and test that Googlebot rules still match your SEO intent. Authenticate private areas; robots.txt only expresses crawl preference. Re-check Google’s crawler list after Cloud AI product updates.

Category: Dataset / other

Official documentation (Google)

Last verified: . Re-check operator docs after major crawler announcements.

Related bots (Dataset / other)

Google-CloudVertexBot FAQ

  • Google lists Google-CloudVertexBot among common crawlers that obey robots.txt for automatic crawls. Use User-agent: Google-CloudVertexBot in robots.txt.