Do ChatGPT and Gemini provide accurate answers to patient questions about glenohumeral arthritis?

Background Machine learning (ML), a subset of artificial intelligence, enables Large Language Models (LLMs) like ChatGPT and Gemini to analyze data, learn from context, and generate responses without explicit programming. While ML and LLMs show promise in orthopedic image analysis and patient education, it is unclear whether LLMs provide accurate responses to patient queries. Methods Our purpose was to evaluate the alignment of ChatGPT and Gemini's recommendations for managing glenohumeral arthritis with the American Academy of Orthopaedic Surgeons (AAOS) Evidence-Based Clinical Practice Guidelines (CPGs). Both ChatGPT and Gemini were asked questions based on strong- or moderate-strength recommendations from the AAOS CPG on management of glenohumeral arthritis. Responses were classified by two independent reviewers as, "Agree, "Neutral," or "Disagree" based on their alignment with the CPG recommendations. A Cohen's Kappa coefficient was used to assess inter-observer reliability, and Fisher's exact test was used to compare accuracy of responses between LLMs. Results Of the 12 recommendations of strong- or moderate-strength evidence, ChatGPT and Gemini provided responses that were in agreement for 6 (50%) and 9 (75%) of recommendations, respectively. There were no significant differences in performance between ChatGPT and Gemini. ChatGPT provided 6 study references, of which 4 were nonexistent or inappropriately cited. Gemini provided 32 study references, of which 5 studies were nonexistent or inappropriately cited. Conclusions Both ChatGPT and Gemini do not consistently provide responses that align with the AAOS CPG for management of glenohumeral arthritis. Responses frequently included confabulated details or inappropriately referenced articles. Consequently, physicians and patients should use these AI platforms with caution when seeking advice on management of glenohumeral arthritis.