Agent role structure and operating characteristics in large language model clinical classification: A comparative study of specialist and deliberative multi-agent protocols

Read full text
Authors: Callum Anderson
Cited by: 1
References: 14

Abstract

Large language models (LLMs) are increasingly considered in clinical decision support, yet the architectural effects of role decomposition within multi-agent systems remain poorly isolated. Prior comparisons of single-agent and multi-agent prompting often confound workflow structure with changes in model configuration, training, or decoding. We present a controlled study evaluating whether specialist and generalist multi-agent protocols produce different operating characteristics under fixed inference conditions. Two deterministic protocols, Generic Deliberative (GD) and Feature-Specialist (FS), are evaluated under identical base weights, decoding settings, computational budget, and adjudication logic. The primary comparison isolates role structure and information routing, while feature-assignment and model-scale ablations evaluate boundary conditions. On the UCI Cleveland Heart Disease and Pima Indians Diabetes benchmarks, altering role structure produces substantial operating-characteristic shifts. Under the primary configuration ( llama3.1:8b ), Cleveland FS achieves higher accuracy (0.72 vs. 0.65) and macro-F1 (0.71 vs. 0.65), with a specificity-favoring operating point, whereas Pima GD achieves higher accuracy (0.68 vs. 0.51) and macro-F1 (0.64 vs. 0.49), while FS induces pronounced class asymmetry. Feature-pair ablations show that specialist feature assignment is a design lever, with FS accuracy ranging from 0.41 to 0.72. A model-scale ablation ( qwen2.5:14b ) shows that protocol-level effects interact with base-model capacity. Overall, internal role decomposition should not be treated as safety-neutral: it can act as a feature-conditioned architectural bias that changes evidence aggregation and shifts class-wise error profiles, indicating that prompt structure and architectural configuration should be explicitly tuned, validated, and reported in safety-sensitive LLM-based clinical decision systems.

Fields of Study & Subjects

Clinical Reasoning and Diagnostic Skills Multi-Agent Systems and Negotiation Machine Learning and Algorithms

Publication details

Journal / source
Informatics in Medicine Unlocked
Publisher
Elsevier BV
Volume
64
Pages
101783–101783
Publication date
1 July 2026
Language
EN