Positive act of reporting negative results in large language model research: a call for transparency
Abstract
PURPOSE: To highlight the importance of reporting negative results in large language model (LLM) research, particularly as these systems are increasingly integrated into healthcare. POTENTIAL: LLMs offer transformative capabilities in text generation, summarization, and clinical decision support. Transparent documentation of both successes and failures can accelerate innovation, improve reproducibility, and guide safe deployment. CAUTION: Publication bias toward positive findings conceals model limitations, biases, and reproducibility challenges. In healthcare, underreporting failures risks patient safety, ethical lapses, and wasted resources. Structural barriers, including a lack of standards and limited funding for failure analysis, perpetuate this cycle. CONCLUSIONS: Negative results should be recognized as valuable contributions that delineate the boundaries of LLM applicability. Structured reporting, educational initiatives, and stronger incentives for transparency are essential to ensure responsible, equitable, and trustworthy use of LLMs in healthcare.
Fields of Study & Subjects
Artificial Intelligence in Healthcare and Education
Interpreting and Communication in Healthcare
Text Readability and Simplification
Publication details
- Journal / source
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Volume
- 33
- Issue
- 4
- Pages
- 926–929
- Publication date
- 16 January 2026
- Language
- EN