A Cross-Modal Attention for Detecting Hidden Online Gambling Promotion in Multilingual Multimodal Watermarked Advertising Images

Read full text
Authors: Abdul Azzam Ajhari, Rizal Fathoni Aji, Aprinaldi Jasa Mantau, Wisnu Aryo Jatmiko, Mahardhika Pratama
Cited by: 1

Abstract

Abstract Online gambling operators increasingly evade regulation by concealing promotional content within watermarked advertising images across social media and compromised domains. Traditional text-centric monitoring fails in these scenarios, particularly in multilingual environments where visual obfuscation masks critical semantic cues. This paper proposes a robust hybrid multimodal framework that explicitly models fine-grained interactions between OCR-extracted text and visual structures. Our architecture leverages a Vision Transformer (ViT) for spatial feature encoding and XLM-RoBERTa for cross-lingual semantic representation, integrated via a text-guided cross-modal attention (CMA) mechanism. This allows the model to "attend" to specific image regions based on extracted textual tokens, effectively uncovering hidden promotional signals. Testing on a newly curated dataset of 4,485 manually verified multilingual screenshots, the framework achieves an Accuracy of 0.9947 and an F1-score of 0.9947, consistently outperforming late-fusion baselines while maintaining performance comparable to the strongest unimodal configuration. Our findings reveal that while visual cues provide strong complementary discriminative signals, CMA ensures robustness against OCR noise and linguistic variation. This study provides a scalable, high-precision solution for cross-border regulatory monitoring in adversarial digital ecosystems.

Fields of Study & Subjects

Multimodal Machine Learning Applications Hate Speech and Cyberbullying Detection Adversarial Robustness in Machine Learning

Publication details

Journal / source
Research Square
Publisher
Springer Science and Business Media LLC
Publication date
27 February 2026
Document type
Preprint