An LLM-based Simulation Framework for Embodied Conversational Agents in Psychological Counseling

Read full text
Authors: Association for Artificial Intelligence 2026, Jiangtao Gong, Yuchen Han, Qisen Pan, Yuanrong Tang, Tianhong Wang, Lixiu Wu, Lanxi Xiao, Xianyang Zhan, Chen Zhong
Cited by: 0

Abstract

Due to privacy concerns, open dialogue datasets for mental health are primarily generated through human or AI synthesis methods. However, the inherent implicit nature of psychological processes, particularly those of clients, poses challenges to the authenticity and diversity of synthetic data. In this paper, we propose ECAs (short for Embodied Conversational Agents), a framework for embodied agent simulation based on Large Language Models (LLMs) that incorporates multiple psychological theoretical principles. Using simulation, we expand real counseling case data into a nuanced embodied cognitive memory space and generate dialogue data based on high-frequency counseling questions. We validated our framework using the D$^4$ dataset. First, we created a public ECAs dataset through batch simulations based on D$^4$. Licensed counselors evaluated our method, demonstrating that it significantly outperforms baselines in simulation authenticity and necessity. Additionally, two LLM-based automated evaluation methods were employed to confirm the higher quality of the generated dialogues compared to the baselines.

Fields of Study & Subjects

Speech and dialogue systems Social Robot Interaction and HRI Emotion and Mood Recognition

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN