ClaudeBot
Definition
ClaudeBot is Anthropic’s crawler for collecting public web content that may support Claude model training and related improvements.
Full definition
Anthropic documents separate agents such as ClaudeBot, Claude-User, and Claude-SearchBot. Each can be allowed or blocked independently in robots.txt.
See AI Crawler and GPTBot for comparison of multi-agent policies.