Evaluating the Capabilities of Large Language Models in the Literature Review Process
Abstract
We examined the effectiveness of the large language models GPT-5 and Gemini in conducting the literature search, literature relevance screening, and literature quality screening tasks for a literature review. Results showed that while these models are not yet ready to fully replace human involvement in the literature review process, they may be able to play a supporting role in these tasks, potentially reducing the workload of human reviewers. The utility of these models is likely to improve over time as the models improve, and thus future research should continue to evaluate various models’ abilities to support in literature review tasks.
Fields of Study & Subjects
Meta-analysis and systematic reviews
Computational and Text Analysis Methods
Topic Modeling
Publication details
- Journal / source
- OSF Preprints (OSF Preprints)
- Publication date
- 4 March 2026
- Language
- EN
- Document type
- Preprint