Optimizing ChatGPT: Applying prompt engineering to frequently asked questions in urologic oncology
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT Free to try with your Science Catalogs account.Abstract
INTRODUCTION: Patients rely on online searches for patient education materials (PEMs). PEMs are recommended to be written at or below a sixth-grade reading level but are regularly written at a college reading level. Using prompt engineering, we assess the information, misinformation, and readability of ChatGPT responses to urologic oncology questions. METHODS: Forty-five questions relating to prostate, bladder, and kidney cancer were presented to ChatGPT (version 4o, OpenAI). Quality of health information was assessed using DISCERN (1 [low] to 5 [high]). Understandability and actionability were assessed using PEMAT-P (0 [low] to 100% [high]). Misinformation was scored from 1 [no misinformation] to 5 [high misinformation]. Grade and reading level were calculated using the Flesch-Kincaid scale [5 (easy) to 16 (difficult), and 100-90 (5th grade level) to 10-0 (professional level), respectively]. Prompt engineering was then applied to responses and evaluated. RESULTS: ChatGPT answers are highly accurate but at too advanced a reading level and lacked explanations of benefits, risks, visual aids, actionability, and citations. Using prompt engineering, DISCERN (3.42-4.47, p
Fields of Study & Subjects
Artificial Intelligence in Healthcare and Education
Health Literacy and Information Accessibility
Social Media in Health Education
Publication details
- Journal / source
- Canadian Urological Association Journal
- Volume
- 20
- Issue
- 8
- Pages
- E313–E318
- Publication date
- 30 March 2026
- Language
- EN