MAGENTA: Magnitude and Geometry-Enhanced Training Approach for Long-Tailed Sound Event Localization and Detection

Read full text
Authors: Jun-Wei Yeow, Ee-Leng Tan, Santi Peksi, Woon‐Seng Gan
Cited by: 0
References: 62

Abstract

Deep learning-based Sound Event Localization and Detection (SELD) systems suffer severe performance degradation in real-world, long-tailed acoustic environments. Standard continuous regression objectives heavily bias learning toward frequent classes, causing rare events to be systematically under-recognized, an optimization bottleneck we term detection timidity. To overcome this, we propose MAGENTA (Magnitude And Geometry-ENhanced Training Approach), an architecture-agnostic loss framework that geometrically decomposes the regression error into orthogonal radial (activity) and angular (localization) components. Unlike standard methods that rely on static frequency weights, MAGENTA incorporates an intrinsic, difficulty-driven annealing mechanism. By decoupling the objective to independently modulate active detection and inactive suppression, the system can adaptively boost recall for difficult tail classes while modulating inactive penalties to prevent spurious rare-event detections. Evaluations on the STARSS23 dataset demonstrate that MAGENTA yields a 20.5% relative reduction in the aggregated SELD error, effectively recovering tail class performance without compromising head class precision. Code is available at: https://github.com/itsjunwei/MAGENTA

Fields of Study & Subjects

Music and Audio Processing Speech and Audio Processing Speech Recognition and Synthesis

Publication details

Journal / source
IEEE Transactions on Audio Speech and Language Processing
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
34
Pages
4159–4172
Publication date
1 January 2026
Language
EN