MIND: Empowering Mental Health Clinicians with Multimodal Data Insights through a Narrative Dashboard

Read full text
Authors: Ruishi Zou, Shiyu Xu, Margaret E. Morris, Jihan Ryu, Timothy D. Becker, Nicholas Allen, Anne Marie Albano, Randy Patrick Auerbach, Dan Adler, Varun Mishra, Lace Padilla, Dakuo Wang
+2 more Ryan S. Sultan, Xuhai "Orson" Xu
Cited by: 1
References: 115

Abstract

Advances in data collection enable the capture of rich patient-generated data: from passive sensing (e.g., wearables and smartphones) to active self-reports (e.g., cross-sectional surveys and ecological momentary assessments). Although prior research has demonstrated the utility of patient-generated data in mental healthcare, significant challenges remain in effectively presenting these data streams along with clinical data (e.g., clinical notes) for clinical decision-making. Through co-design sessions with five clinicians, we propose MIND, a large language model-powered dashboard designed to present clinically relevant multimodal data insights for mental healthcare. MIND presents multimodal insights through narrative text, complemented by charts communicating underlying data. Our user study (N=16) demonstrates that clinicians perceive MIND as a significant improvement over baseline methods, reporting improved performance to reveal hidden and clinically relevant data insights (p

Fields of Study & Subjects

Digital Mental Health Interventions Innovative Human-Technology Interaction Mental Health via Writing

Publication details

Journal / source
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Pages
1–26
Publication date
13 April 2026