Detecting Sarcasm in Multiple Modalities by Leveraging Sarcasm Type Correlations

Read full text
Authors: Jeremy Chang, Chia-Yun Hsu, Chung-Hsien Wu
Cited by: 1
References: 24

Abstract

Sarcasm detection is essential for accurately interpreting communication in applications such as dialogue systems. However, most existing approaches treat sarcasm as a single phenomenon and ignore the linguistic distinction between illocutionary, embedded, and propositional sarcasm, each of which relies on different contextual and emotional cues. In this work, we propose a type-aware multimodal framework that explicitly models these three sarcasm types by training dedicated representations for each and combining them within a unified architecture. To encourage the learning of emotionally informative features, we incorporate explicit and implicit emotion prediction as auxiliary regularization tasks in a multitask learning setting. Experiments on the multimodal sarcasm dataset MUStARD++ show that our system achieves an F1 score of 82.65% in sarcasm detection. These results demonstrate that type-specific modeling improves multimodal sarcasm detection.

Fields of Study & Subjects

Sentiment Analysis and Opinion Mining Language Metaphor and Cognition Topic Modeling

Publication details

Journal / source
IEEE Access
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
14
Pages
3606–3617
Publication date
1 January 2026