Optimizing ChatGPT: Applying prompt engineering to frequently asked questions in urologic oncology

Read full text Summarise with VIRAT
Authors: Mark N. Alshak, Michelle I. Higgins, Craig Cronin, William S. Azar, Joseph Cheaib, Max Kates, Sunil H. Patel
Cited by: 0
References: 23

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

INTRODUCTION: Patients rely on online searches for patient education materials (PEMs). PEMs are recommended to be written at or below a sixth-grade reading level but are regularly written at a college reading level. Using prompt engineering, we assess the information, misinformation, and readability of ChatGPT responses to urologic oncology questions. METHODS: Forty-five questions relating to prostate, bladder, and kidney cancer were presented to ChatGPT (version 4o, OpenAI). Quality of health information was assessed using DISCERN (1 [low] to 5 [high]). Understandability and actionability were assessed using PEMAT-P (0 [low] to 100% [high]). Misinformation was scored from 1 [no misinformation] to 5 [high misinformation]. Grade and reading level were calculated using the Flesch-Kincaid scale [5 (easy) to 16 (difficult), and 100-90 (5th grade level) to 10-0 (professional level), respectively]. Prompt engineering was then applied to responses and evaluated. RESULTS: ChatGPT answers are highly accurate but at too advanced a reading level and lacked explanations of benefits, risks, visual aids, actionability, and citations. Using prompt engineering, DISCERN (3.42-4.47, p

Fields of Study & Subjects

Artificial Intelligence in Healthcare and Education Health Literacy and Information Accessibility Social Media in Health Education

Publication details

Journal / source
Canadian Urological Association Journal
Volume
20
Issue
8
Pages
E313–E318
Publication date
30 March 2026
Language
EN