Evaluating and Defending against Adversarial Threats in Multimodal AI

Read full text
Authors: Mateusz Kowalczyk, Joanna Kołodziej, Mateusz Krzysztoń
Cited by: 1
References: 10

Abstract

Multimodal AI systems combine text, images, audio, video, and sensor data in a single pipeline. This design improves capability, but it also creates new attack surfaces and cross-modal failure modes. Existing work often studies attacks, defences, and benchmarks in isolation, making the field hard to compare systematically and leaving practical security choices unclear. This survey reviews adversarial threats, defence methods, and robustness evaluation in multimodal AI. The scope extends beyond standard vision-language models to multimodal agents and systems that use audio, depth, and thermal data. The survey introduces a defence taxonomy with two groups: proactive methods that improve robustness before deployment and reactive methods that detect or limit harmful behaviour at inference time. The survey also presents a practical view of robustness evaluation, covering task-aligned protocols, attack success metrics, repeated sampling, open-ended judging, benchmark roles, and a minimum reporting checklist. The main conclusion is simple: no single defence is sufficient. Secure multimodal AI requires layered defences and realistic evaluation.

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Emotion and Mood Recognition User Authentication and Security Systems

Publication details

Journal / source
Applied Cybersecurity & Internet Governance
Publisher
NASK National Research Institute
Publication date
12 May 2026