Modulation-Based Backdoors: Leveraging Amplitude and Frequency Patterns to Attack Speaker Recognition

Read full text
Authors: Association for Artificial Intelligence 2026, Hanbo Cai, Hanting Chu, De De Li, Ying Luo, Yan XIAO, Pengcheng Zhang
Cited by: 0

Abstract

Deep neural networks (DNNs) are widely and successfully applied in the field of speaker recognition. However, recent studies reveal that these models are vulnerable to backdoor attacks, where adversaries inject malicious behaviors into victim models by poisoning the training process. Existing attack methods often rely on environmental noise or complex voice transformations, which are typically difficult to implement and exhibit poor stealthiness. To address these issues, this paper proposes two modulation-based backdoor attacks that leverage frequency modulation (FM) and amplitude modulation (AM) to construct audio triggers. In real-world scenarios, regular variations in frequency and amplitude are often imperceptible to human listeners, making the proposed attacks more covert. Experimental results show that our methods achieve high attack success rates in both digital and physical settings, while also demonstrating strong resistance to various state-of-the-art backdoor defenses. The code for reproducing main experiments is available at https://github.com/HanboCai/FSMA_ASMA.

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Speech Recognition and Synthesis Digital Media Forensic Detection

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN