Accuracy, readability, and content coverage of AI-generated responses to questions on functional appliances

Read full text
Authors: Serene Badran, Snigdha Pattanaik, Sarah Jumaah, Abdulrahman Salmeh, Meena Al‐Saadi, Taiba Al-Mizban, Nadia Al-Zaidi, Abdullah Hanifa, Mahmoud K. Al-Omiri
Cited by: 1
References: 31

Abstract

BACKGROUND: Patients increasingly rely on Large Language Models (LLMs) for health information, yet the accuracy and readability of AI-generated dental advice remain variable across different clinical domains and Artificial Intelligence (AI) models. This study therefore aimed to compare the readability, accuracy, and comprehensiveness of responses generated by four leading AI models (ChatGPT-4o Mini, ChatGPT-5, Google Gemini 2.5 Flash, and DeepSeek V3) to patient questions on functional appliances. METHODS: Thirty-eight frequently asked questions were identified using a structured Google search and categorized into three domains: "treatment fundamentals and general information," "lifestyle and practical concerns," and "appointments and long-term results". Each question was independently answered by the four AI models. Readability was assessed using the Flesch-Kincaid tools. Accuracy and comprehensiveness were independently rated by two blinded orthodontists. RESULTS: AI-generated responses were generally accurate and comprehensive but difficult to read, requiring college-level literacy. ChatGPT-5 produced the lowest readability scores (most difficult-to-read responses; P < .001). Although Gemini 2.5 Flash achieved the highest comprehensiveness scores across all three domains, these differences were not statistically significant. Treatment-related questions yielded lower readability scores than lifestyle-related queries across all models (P < .001). No single model demonstrated superior performance across all evaluated domains. CONCLUSION: AI-generated information on functional appliances was generally accurate and comprehensive but often exceeded recommended patient literacy thresholds. Readability must be considered alongside informational quality when deploying AI tools for patient education.

Fields of Study & Subjects

Artificial Intelligence in Healthcare and Education Health Literacy and Information Accessibility Dental Research and COVID-19

Publication details

Journal / source
BMC Oral Health
Publisher
Springer Science and Business Media LLC
Volume
26
Issue
1
Publication date
22 May 2026
Language
EN