Many-Analyst Simulation Study

Authors: Mona Niethammer
Cited by: 0

Abstract

In this project, we conduct and report a many-analyst simulation study, that (i) addresses an interesting methodological question (ii) builds on experience from multi-analyst studies in applied research and implements different good research and open science practices and (iii) empirically quantifies the variability of results in light of researcher degrees of freedom that arise in methodological comparisons. We provide recommendations to allow other researchers to profit from our learnings regarding the organizational feasibility of multi-analyst simulation studies as a tool to improve the replicability of method comparisons.

Fields of Study & Subjects

Qualitative Comparative Analysis Research Mental Health Research Topics Psychometric Methodologies and Testing

Publication details

Journal / source
OSF Preprints (OSF Preprints)
Publication date
25 March 2026
Document type
Preprint