Tri-View Collaborative Graph Learning for Robust Deepfake Speech Detection

View at publisher
Authors: Kuiyuan Zhang, Yuze Zhao, Zhongyun Hua, Yushu Zhang, Qing Liao, Wei Yong Jiang
Cited by: 0
References: 46

Abstract

With the rapid advancement of deep learning, text-to-speech and voice conversion systems can now generate synthetic speech, commonly known as deepfake speech, that sounds nearly identical to real human voices. This raises serious threats to public security, driving the urgent need for reliable detection methods. However, most existing approaches rely only on either raw waveform or spectrogram features, overlooking cross-view relationships that could reveal artifacts from unknown spoofing attacks. To address this gap, we propose a tri-view collaborative graph learning framework to enhance detection robustness. Our model integrates three complementary views: 1D waveform features, 2D spectral features, and linguistically derived features from an automatic speech recognition (ASR) system. To improve both discriminability and cross-view independence, we design a Tri-View Contrastive Learning (TVCL) framework, which employs cross-view contrastive loss to emphasize cross-view complementarity and intra-view contrastive loss to strengthen class separation within each view. We further introduce a Dynamic Graph Attention Network (DGAT) that captures temporal dependencies across the multi-view features. Through attention-based aggregation and a learnable weighting mechanism, the DGAT adaptively balances contributions from different views, suppressing noise and promoting complementary cooperation. Finally, the graph-level embeddings produced by the DGAT are used for classification. Extensive experiments on five benchmark datasets demonstrate the superiority of our approach, showing consistent improvements over state-of-the-art methods in cross-method, cross-dataset, and cross-language scenarios.

Fields of Study & Subjects

Speech Recognition and Synthesis Digital Media Forensic Detection Speech and Audio Processing

Publication details

Journal / source
IEEE Transactions on Dependable and Secure Computing
Volume
23
Issue
3
Pages
5954–5970
Publication date
3 February 2026