CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious Attacks

Read full text
Authors: Xu Zhang, Hao Li, Zhichao Lu
Cited by: 0

Abstract

Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak attacks.While existing work focuses on explicit attacks, where malicious content resides in a single modality, recent studies reveal implicit attacks, in which benign text and image inputs jointly express unsafe intent.Such joint-modal threats are difficult to detect and remain underexplored, largely due to the scarcity of high-quality implicit data.We propose ImpForge, an automated red-teaming pipeline that leverages reinforcement learning with tailored reward modules to generate diverse implicit samples across 14 domains.Building on this dataset, we further develop CrossGuard, an intent-aware safeguard providing robust and comprehensive defense against both explicit and implicit threats.Extensive experiments across safe and unsafe benchmarks, implicit and explicit attacks, and multiple out-of-domain settings demonstrate that CrossGuard significantly outperforms existing defenses, including advanced MLLMs and guardrails, achieving stronger security while maintaining high utility.This offers a balanced and practical solution for enhancing MLLM robustness against real-world multimodal threats.

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Topic Modeling Advanced Graph Neural Networks

Publication details

Journal / source
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Publisher
Association for Computational Linguistics
Pages
25693–25707
Publication date
1 January 2026