MC-LExt: Multi-Channel Target Speaker Extraction with Onset-Prompted Speaker Conditioning Mechanism

Read full text
Authors: Tongtao Ling, S. He, Pengjie Shen, Zhong-Qiu Wang
Cited by: 0
References: 44

Abstract

Multi-channel target speaker extraction (MC-TSE) aims to extract a target speaker’s voice from multi-speaker signals captured by multiple microphones. Existing methods often rely on auxiliary clues such as direction-of-arrival (DOA) or speaker embeddings. However, DOA-based approaches depend on explicit direction estimation and are sensitive to microphone array geometry, while methods based on speaker embeddings model speaker identity in an implicit manner and may degrade in noisy-reverberant conditions. To address these limitations, we propose multi-channel listen to extract (MC-LExt), a simple but highly-effective framework for MC-TSE. Our key idea is to prepend a short enrollment utterance of the target speaker to each channel of the multi-channel mixture, providing an onset-prompted conditioning signal that can guide TSE. This design allows the deep neural network (DNN) to learn spatial and speaker identity cues jointly in a fully end-to-end manner. Evaluation results on noisy-reverberant benchmarks, including WHAMR! and MC-Libri2Mix, show the effectiveness of MC-TSE.

Fields of Study & Subjects

Speech and Audio Processing Speech Recognition and Synthesis Music and Audio Processing

Publication details

Journal / source
ICASSP 2026 - 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Publisher
IEEE
Pages
18967–18971
Publication date
21 April 2026