Multicurious: A Multidisciplinary Guide to Multiverse Analysis

Read full text
Authors: Cassie Ann Short, Nate Breznau, Maria Bruntsch, Micha Burkhardt, Niko A. Busch, Elena Čėsnaitė, Maximilian Frank, Carsten Gießing, Daniel Krähmer, Daniel Kristanto, Tina B. Lonsdorf, Claudia Neuendorf
+6 more Hung Hoang Viet Nguyen, Manuel Rausch, Xenia Schmalz, Andreas Schneck, Cem Tabakci, Andrea Hildebrandt
Cited by: 5
References: 70

Abstract

Multiverse analysis offers a comprehensive response to a core vulnerability in empirical research: the uncertainty of scientific conclusions arising from defensible yet flexible data-processing and -analysis decisions. By systematically mapping and computing all or a sample of all plausible data-processing pipelines, multiverse analysis reports the robustness of findings across analytical flexibility and increases transparency in the research process. As its adoption grows across disciplines, so too does the need for clarity on how to design, report, and interpret multiverse results responsibly. In this article, we provide interdisciplinary guidance on key procedural considerations, including defensibility and equivalence evaluations, preregistration, and computational demands. We aim to harmonize terminology, promote best practices, and foster conceptual cohesion across fields, supported by reference to domain-specific resources when appropriate. By doing so, we contribute to the broader movement toward more robust, reproducible, and transparent science, one that not only reports results but also interrogates the analytical pipelines that produce them.

Fields of Study & Subjects

Psychological and Educational Research Studies

Publication details

Journal / source
Advances in Methods and Practices in Psychological Science
Publisher
SAGE Publications
Volume
9
Issue
2
Publication date
1 April 2026
Language
EN