Empathetic Response in Audio-Visual Conversations Using Emotion Preference Optimization and MambaCompressor

Read full text
Authors: Yeonju Kim, Se Jin Park, Yong Man Ro
Cited by: 0

Abstract

Chatbot research is advancing with the growing importance of chatbots in fields that require human interactions, such as customer support and mental health care. Despite these advancements, chatbots still face significant challenges in understanding subtle nuances and managing long conversation histories. To address these issues, our study introduces a dual approach: firstly, we employ Emotional Preference Optimization (EPO) to train chatbots not only with correct responses but also with counter-emotional responses-those that are contextually similar but emotionally divergent. This training enables the model to discern fine nuance distinctions between correct and counter-emotional responses, thereby enhancing the quality of its responses. Secondly, we introduce MambaCompressor to effectively compress and manage extensive conversation histories, significantly reducing time and memory complexities while improving the chatbot's contextual understanding. Our comprehensive experiments across multiple datasets demonstrate that our model significantly outperforms existing models in generating empathetic responses and efficiently managing lengthy dialogues.

Fields of Study & Subjects

Video Analysis and Summarization Social Robot Interaction and HRI Human Motion and Animation

Publication details

Journal / source
IEEE Transactions on Affective Computing
Volume
17
Issue
3
Pages
3610–3625
Publication date
26 June 2026
Language
EN