"I Wouldn't Really Use It as a Practice Tool": Understanding Medical Students’ Perspectives and Needs on LLM-Enhanced Clinical Skills Training
Abstract
Large Language Models (LLMs) are expected to enhance medical education through personalized clinical skills training. However, their practical application from the student user experience perspective remains underexplored. This gap is critical because without understanding students’ needs, LLM-based tools risk poor adoption and suboptimal learning outcomes. This study explores medical students’ challenges and expectations when using LLM-based clinical skills training through a two-phase investigation involving 14 medical students. We integrated five Type 2 Diabetes cases into a probe platform and conducted probe-based studies followed by co-design workshops. We identified challenges across three categories: dialogue content (lack of realism, insufficient knowledge depth differentiation); dialogue presentation (information overload, single modality limitations); and dialogue interaction (inadequate guidance and feedback). Co-design workshops revealed expectations for enhanced patient modeling, personalized content delivery, structured presentation frameworks, and collaborative features. These findings provide design considerations for developing more effective, user-centered LLM-based medical education systems.
Fields of Study & Subjects
Artificial Intelligence in Healthcare and Education
Simulation-Based Education in Healthcare
Topic Modeling
Publication details
- Journal / source
- Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Pages
- 1–25
- Publication date
- 13 April 2026
- Language
- EN