Future-Proofing Deepfake Detection by Integrating Audio, Video, and Text

Read full text
Authors: Pasquale Lisena, Kong Aik Lee, Yi Wang, Massimiliano Todisco, Chiara Galdi, Raphaël Troncy, Nicholas Evans, Weiwei Lin, Lap‐Pui Chau, Man‐Wai Mak
Cited by: 1
References: 41

Abstract

The rapid advancement of AI-generated content has made deepfakes increasingly realistic, posing serious risks to identity security, social trust, and public and democratic institutions. Existing detection systems, typically focused on single modalities such as video or audio, often fail to generalize to new manipulation techniques and cannot effectively detect hybrid or low-effort deepfakes. In this perspective letter, we advocate for a new paradigm in deepfake detection that emphasizes the integration of audio, video, and textual content. We examine the limitations of current systems, including their over-reliance on outdated datasets and limited adversarial robustness. We outline the technical motivations for integrating these modalities and highlight emerging research directions. By aligning detection strategies with the multimodal nature of AI-driven manipulation, we call for a new generation of systems that are more generalizable and trustworthy.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Adversarial Robustness in Machine Learning Digital Media Forensic Detection

Publication details

Journal / source
ACM AI Letters
Publisher
Association for Computing Machinery (ACM)
Volume
1
Issue
1
Pages
1–7
Publication date
26 March 2026
Language
EN