LLM-Assisted Replication as Scientific Infrastructure

View at publisher
Authors: So Kubota, Hiromu Yakura, Sho Yamada, Yuki Nakamura, Samuel Coavoux
Cited by: 0

Abstract

Large language models (LLMs) are rapidly accelerating scientific production, from literature synthesis to automated analysis. Yet this expansion risks creating a verification gap, in which the volume of scientific claims outpaces the community's capacity to check their reproducibility. We argue that the same LLM capabilities driving scientific output can be redirected toward scalable verification. As a concrete example, we demonstrate how an autonomous LLM-based agent can reproduce the core statistical results of a classic sociology paper, while identifying underspecified methodological details. This means that automated replication does not adjudicate scientific truth, but it localizes discrepancies and documentation gaps, lowering the cost of computational reproducibility checks. Thereby, we propose embedding LLM-assisted replication across the research lifecycle, such as pre-submission quality check, journal-integrated verification, post-publication audits, and forensic reconstruction of legacy studies. To prevent misuse and preserve trust, we call for transparent standards and community governance. If institutionalized responsibly, AI can serve not only to generate science, but to scale its self-correction.

Fields of Study & Subjects

Scientific Computing and Data Management Ethics and Social Impacts of AI Computational and Text Analysis Methods

Publication details

Publication date
17 February 2026
Language
EN
Document type
Preprint