TidyVoice 2026 Challenge Evaluation Plan

Read full text
Authors: Aref Farhadipour, Jan Marquenie, Srikanth R. Madikeri, Teodora Vuković, Volker Dellwo, Kathy Reid, Francis Morton Tyers, Ingo Siegert, Eleanor Chodroff
Cited by: 0

Abstract

The performance of speaker verification systems degrades significantly under language mismatch, a critical challenge exacerbated by the field's reliance on English-centric data. To address this, we propose the TidyVoice Challenge for cross-lingual speaker verification. The challenge leverages the TidyVoiceX dataset from the novel TidyVoice benchmark, a large-scale, multilingual corpus derived from Mozilla Common Voice, and specifically curated to isolate the effect of language switching across approximately 40 languages. Participants will be tasked with building systems robust to this mismatch, with performance primarily evaluated using the Equal Error Rate on cross-language trials. By providing standardized data, open-source baselines, and a rigorous evaluation protocol, this challenge aims to drive research towards fairer, more inclusive, and language-independent speaker recognition technologies, directly aligning with the Interspeech 2026 theme, "Speaking Together."

Fields of Study & Subjects

Speech Recognition and Synthesis Speech and Audio Processing Speech and dialogue systems

Publication details

Journal / source
arXiv (Cornell University)
Publication date
29 January 2026
Document type
Preprint