Process over Skill: Testing Kasparov’s Law and Coordination Protocols in Hybrid Human–AI Decision-Making for Medical Diagnosis

Artificial intelligence (AI) is increasingly being integrated into Clinical Decision-Support Systems (CDSSs), shifting attention from algorithmic performance alone to the broader sociotechnical conditions that shape effective human–AI collaboration. In this study, we investigated whether nine displacement-based structured coordination protocols can improve the collective diagnostic decision-making of hybrid human–AI teams (16 board-certified radiologists and a simulated AI model) in a radiological double-reading task for vertebral fracture detection from X-ray images. Among the protocols tested, the Accuracy-Oriented, Confidence-Oriented, and Presumptuous strategies achieved the highest (balanced) accuracy overall, with up to 97% among strong clinicians and 92% among weak ones, significantly outperforming simpler methods like majority voting. Conversely, approaches optimized for a single metric (e.g., sensitivity or specificity) introduced performance trade-offs. Benefits were strongest among less proficient clinicians, which exhibited substantial and consistent improvements, while proficient clinicians showed limited gains and occasional declines. Critically, Kasparov’s Law emerged as a comparative framework for empirically evaluating coordination quality relative to the diagnostic task, clinical objective, and clinician proficiency by identifying situations in which less proficient clinicians supported by superior coordination protocols outperformed more proficient clinicians operating under inferior ones. These findings demonstrate that coordination design is a critical determinant of hybrid human–AI decision-making, highlighting that a well-structured process can be more relevant than individual components’ performance and support process-centered approaches to the development and evaluation of CDSSs.