Peer Review of “The Performance of DeepSeek R1 and Gemini 3 in Complex Medical Scenarios: Comparative Study”
Abstract
DeepSeek R1 and Gemini 3 in Complex Medical Scenarios: Comparative Study." Round 1 Review General CommentsThis paper [1] seeks to evaluate the accuracy of DeepSeek R1 in correctly identifying the primary medical diagnosis in the medical scenarios dataset portion of Massive Multitask Language Understanding Pro (MMLU-Pro) using an open-ended format.Some clarifications on the methods and results (especially around the roles of subject matter experts vs core team members in the publication), would be helpful in understanding how these results were derived.
Fields of Study & Subjects
Healthcare Technology and Patient Monitoring
Artificial Intelligence in Healthcare and Education
Spaceflight effects on biology
Publication details
- Journal / source
- JMIRx Med
- Volume
- 7
- Pages
- e96225–e96225
- Publication date
- 27 April 2026
- Language
- EN