Positive act of reporting negative results in large language model research: a call for transparency

Read full text
Authors: Satvik Tripathi, Dana Alkhulaifat, Tessa S. Cook
Cited by: 2
References: 12

Abstract

PURPOSE: To highlight the importance of reporting negative results in large language model (LLM) research, particularly as these systems are increasingly integrated into healthcare. POTENTIAL: LLMs offer transformative capabilities in text generation, summarization, and clinical decision support. Transparent documentation of both successes and failures can accelerate innovation, improve reproducibility, and guide safe deployment. CAUTION: Publication bias toward positive findings conceals model limitations, biases, and reproducibility challenges. In healthcare, underreporting failures risks patient safety, ethical lapses, and wasted resources. Structural barriers, including a lack of standards and limited funding for failure analysis, perpetuate this cycle. CONCLUSIONS: Negative results should be recognized as valuable contributions that delineate the boundaries of LLM applicability. Structured reporting, educational initiatives, and stronger incentives for transparency are essential to ensure responsible, equitable, and trustworthy use of LLMs in healthcare.

Fields of Study & Subjects

Artificial Intelligence in Healthcare and Education Interpreting and Communication in Healthcare Text Readability and Simplification

Publication details

Journal / source
Journal of the American Medical Informatics Association
Publisher
Oxford University Press (OUP)
Volume
33
Issue
4
Pages
926–929
Publication date
16 January 2026
Language
EN