Using Classification Trees to Identify the Best Method in Monte Carlo Simulations: From Population Parameters to Observed Features

Read full text Summarise with VIRAT
Authors: Jeongwon Choi, Hao Wu
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Monte Carlo simulations are widely used to compare statistical methods, but their findings are often difficult to interpret and rarely translate into practical guidelines for method selection. This gap arises for two reasons. First, method performance often depends on complex interactions among simulation factors that are hard to detect with conventional summaries. Second, performance is typically evaluated against population values that are unknown in practice, whereas applied researchers only see features of their sample data. We propose a classification tree framework that addresses both problems, along with two pruning strategies tailored to the simulation context: a combined pruning procedure that accounts for equivalent representations of the same data, and effect-size-based pruning that prevents large numbers of replications from inflating tree complexity. We illustrate this framework by selecting among zero cell correction strategies for estimating tetrachoric correlations. In Example 1, we reanalyze results from Choi & Wu (2026) using the original simulation factors as predictors, yielding clear decision rules that still rely on population values. In Example 2, we generate data under continuous simulation factors and construct predictors directly from observed 2×2 contingency tables, allowing the resulting rules to be applied to real data. More broadly, the proposed framework provides a general approach for translating Monte Carlo comparisons of competing methods into practical method selection guidelines.

Fields of Study & Subjects

Simulation Techniques and Applications Statistical Methods and Bayesian Inference Statistical Methods and Applications

Publication details

Journal / source
PsyArXiv (OSF Preprints)
Publication date
27 March 2026
Language
EN
Document type
Preprint