Performance of Large Language Models in Title and Abstract Screening of Preclinical Systematic Reviews - Study Registration

2026 Preprint Open access

Read full text
Authors: Francisco Marques da Silva Neto, Matheus Gallas‐Lopes, Ana P. Herrmann, Olavo Bohrer Amaral
DOI: 10.17605/osf.io/rzju8
Cited by: 0

Abstract

This preregistered methodological validation study evaluates how well large language models perform title/abstract screening for preclinical systematic reviews from BRISA. We will compare LLM decisions against the reviews’ final full-text inclusion (gold standard), estimating sensitivity/specificity, efficiency gains, and test–retest reproducibility across multiple datasets.

Fields of Study & Subjects

Meta-analysis and systematic reviews Artificial Intelligence in Healthcare and Education Information Retrieval and Search Behavior

Publication details

Publication date
1 January 2026
Language
EN
Document type
Preprint