Readability, Accuracy, and Completeness of Urogynecology Health Information Provided Through Patient-Driven Interaction With an Artificial Intelligence Chatbot

View at publisher Summarise with VIRAT
Authors: N. Wood, D. O'Sullivan, E. Tunitsky-Bitton
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

INTRODUCTION: The readability, accuracy, and completeness of urogynecology health information provided by large language models (LLMs) has been found to be comparable to currently available education materials. However, LLM responses to patient-initiated questions have not yet been examined. OBJECTIVE: To investigate the accuracy, completeness, and readability of information provided to patients by an LLM in response to patient questions at the time of the first urogynecology consultation. METHODS: This is a secondary analysis of a randomized trial examining use of an LLM, Chat Generative Pre-trained Transformer (ChatGPT 4o; OpenAI) by patients at their initial urogynecology visit. Participants were recruited if they presented with prolapse, incontinence, or lower urinary tract symptoms (LUTS) and were English- or Spanish-speaking. They were randomized into one of three arms: use of ChatGPT prior to their appointment (Arm 1), use of ChatGPT following their appointment (Arm 2), or no use of an LLM (Arm 3). Participants in Arms 1 and 2 were provided ChatGPT on a tablet, and instructed to ask (typing or speaking) the program anything they’d like about their most important urogynecology problem, with up to five follow-up questions. English and Spanish ChatGPT transcripts were analyzed by two independent physician reviewers for accuracy, completeness, actionability/understandability [Patient Education Materials Assessment Tool (PEMAT)], and readability [Simple Measure of Gobbledygook (SMOG), Spanish Orthographic Length (SOL), Fry Readability Graph, Flesch-Kincaid (FK) Grade Level, Fernández Huerta (FH) Readability Index]. Significant results were declared at P

Fields of Study & Subjects

Artificial Intelligence in Healthcare and Education Health Literacy and Information Accessibility Patient-Provider Communication in Healthcare

Publication details

Journal / source
Obstetrics and Gynecology
Volume
147
Issue
4S
Pages
3S–4S
Publication date
20 March 2026
Language
EN