Live Browsing Agent

Definition

A live browsing agent is a user-agent that fetches pages on demand during an assistant conversation rather than bulk-training the open web.

By Vinespire Editorial Team, Editorial ·

See our sourcing methodology →

Crawlers & botsAI search glossary

This term is part of the full AI search glossary.

Full definition

Examples include ChatGPT-User, Claude-User, and Perplexity-User: traffic volume typically follows real user actions such as “open this URL” or tool-based retrieval mid-chat. These agents differ from training crawlers and search-indexing bots in purpose and often in robots.txt documentation.

Allowing live agents helps assistants ground answers in the current page when users ask about your docs or product. Blocking can break that workflow while leaving training policy unchanged if configured separately.

Always read the operator’s current bot docs—some live agents honor robots.txt only partially. See Training Crawler, Tool Use, and Grounding.

Example

A user asks ChatGPT to summarize https://example.com/pricing; the fetch is attributed to a live browsing user-agent, not GPTBot.

← All glossary terms