Securing Consumer Applications Against AI-Driven Misinformation: A Cross-Domain Multimodal Approach

View at publisher
Authors: Wei Luo, Zihang Yang, Yingjia Shang, Mohammad Shorfuzzaman, Yi Wu, Ahmed Ghoneim
Cited by: 1
References: 38

Abstract

Consumer platforms such as smart healthcare and digital wellness, smart education and online learning, and smart technology and consumer electronics are increasingly exposed to AI-driven misinformation. Typical attacks include machine-generated text that is misleading, manipulated images, and multimodal posts in which text and images are semantically inconsistent, which can erode user trust and disrupt critical decision-making. Most existing detection methods are developed for a single domain or modality and suffer from severe performance degradation under cross-domain distribution shifts and text-image inconsistencies. To address these challenges, this article proposes a cross-domain multimodal misinformation detection framework (CDMMD) for text–image posts on consumer platforms. CDMMD performs multi-perspective feature extraction and employs a domain-aware dual-expert network (D2EN) to refine shared and domain-specific knowledge. A partially parameter-shared recursive cross-modal attention mechanism is then used to progressively fuse global semantics with heterogeneous text–image features, and a lightweight MLP-induced adaptive convolution module reweights the fused knowledge to enhance robustness. Experiments on two Weibo-based benchmark datasets and the FineFake dataset, covering multiple consumer scenarios such as healthcare, education, and technology, demonstrate that CDMMD consistently outperforms strong baselines in cross-domain multimodal detection. Across these datasets, CDMMD improves accuracy by up to 1.8% points over the best competing methods, indicating its effectiveness in improving content credibility assessment on consumer platforms and providing reliable signals for downstream tasks such as propagation modeling and attacker tracking.

Fields of Study & Subjects

Misinformation and Its Impacts Adversarial Robustness in Machine Learning Hate Speech and Cyberbullying Detection

Publication details

Journal / source
IEEE Transactions on Consumer Electronics
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
72
Issue
1
Pages
1574–1583
Publication date
20 January 2026