Disentangled Instrumentalization Learning for Dialogue Emotion Detection

View at publisher
Authors: Weizhi Nie, Zixuan Peng, Yichen Wei, Weijie Wang, Anan Liu
Cited by: 1
References: 45

Abstract

Emotion detection is a pivotal research area spanning diverse fields. Despite advancements in existing methods enhancing detection accuracy and robustness through various research perspectives, the complexity of dialogue content and variability in dialogue conditions introduce significant challenges. These challenges often obscure the relationship between utterances and true emotions, leading to spurious correlations. To address these challenges, we proposeDisentangled Instrumentalization Learning (DIL), a disentangled instrumentalization learning model based on instrumental variables. Leveraging pre-extracted topic information from GPT-4 as an observable confounder, we disentangle it to learn the representation of required conditional instrumental variables. Our approach employs prior and posterior networks for covariate distribution inference, optimized via reconstruction techniques. Additionally, we introduce an instrumentalization learning method for conditional variables to effectively represent instrumental variables for emotion detection. We illustrate the variable relationships in our model using a causal Directed Acyclic Graph (DAG). Experimental results demonstrate that our model achieves a weighted-average F1-score of 69.0% with 69.4% accuracy on IEMOCAP, and a weighted-average F1-score of 67.6% on MELD, showing consistent improvements over strong baseline methods.

Fields of Study & Subjects

Emotion and Mood Recognition Speech and dialogue systems Speech Recognition and Synthesis

Publication details

Journal / source
IEEE Transactions on Affective Computing
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
17
Issue
2
Pages
1557–1569
Publication date
3 March 2026