MOSAIC: A Unified Multilingual Deep Learning Framework for Detecting Manipulated Speech Audio Using Geometry-Aware Foundation Model Representations

View at publisher
Authors: Mohd Mujtaba Akhtar, Vikrant Bhateja
Cited by: 1
References: 19

Abstract

Audio deepfakes (AD) are increasingly used to spread misinformation, yet many detectors are evaluated in monolingual or narrowly multilingual settings and break under language mismatch. In this study, we take a step toward truly multilingual forensic audio deepfake detection (ADD). We conduct a systematic evaluation of pretrained speech encoders in multilingual settings. We observe that different pretrained encoders capture complementary spoofing cues arising from their distinct pretraining objectives. To leverage this complementarity, we propose MOSAIC, which fuses pretrained speech representations across multiple geometric spaces. MOSAIC performs gated additive fusion in hyperbolic, spherical, and Euclidean spaces, followed by self-attention for feature refinement. Experiments on large-scale multilingual benchmarks demonstrate strong crosslanguage generalization of the proposed framework. MOSAIC achieves SOTA performance, with MMS+PaSST attaining 0.02% EER on SpeechFake-MD and 0.07% on MLAAD. Through MOSAIC and complementary pretrained FMs, we attain top performance over individual FMs and standard fusion baselines. Such manipulated speech constitutes a form of audio misinformation that can mislead listeners across languages and platforms.

Fields of Study & Subjects

Digital Media Forensic Detection Speech Recognition and Synthesis Speech and Audio Processing

Publication details

Journal / source
2026 5th International Conference on Sentiment Analysis and Deep Learning (ICSADL)
Publisher
IEEE
Pages
661–667
Publication date
18 February 2026