Evaluating Large Language Model–Generated Clinical Summaries Through a Dual-Perspective Framework: Retrospective Observational Study
Abstract
Large language models (LLMs) are increasingly used by patients and families to interpret complex medical documentation, yet most evaluations focus only on clinician-judged accuracy. In this study, 50 pediatric cardiac intensive care unit notes were summarized using GPT-4o mini and reviewed by both physicians and parents, who rated readability, clinical fidelity, and helpfulness. There were important discrepancies between parents and clinicians in the realm of helpfulness, along with important insights by clinicians assessing clinical accuracy and parents assessing readability. This study highlights the need for dual-perspective frameworks that balance clinical precision with patient understanding.
Fields of Study & Subjects
Artificial Intelligence in Healthcare and Education
Genomics and Rare Diseases
Topic Modeling
Publication details
- Journal / source
- JMIR AI
- Publisher
- JMIR Publications Inc.
- Volume
- 5
- Pages
- e85221–e85221
- Publication date
- 2 February 2026
- Language
- EN