[Comparison of missing data handling methods for AC1 coefficient estimation].
Abstract
OBJECTIVES: coefficient estimation through simulation studies. METHODS: Monte Carlo simulation was used to generate evaluation data under different missing mechanisms. The parameters generated included the number of raters, categories, sample size, disease prevalence, random rating probability, and missing proportion. Four missing data handling methods, by excluding subjects with zero ratings, excluding subjects with incomplete ratings, rater mode imputation, and subject mode imputation, were compared using bias and mean squared error (MSE) as metrics. RESULTS: coefficient estimation, resulting in a bias within ±0.10 and an MSE below 0.09; for a sufficient sample size and a missing proportion ≤30%, the MSE of this method was nearly zero. Rater mode imputation showed the worst performance across all these scenarios. Excluding subjects with incomplete ratings resulted in an acceptable error only in relatively simple settings (two raters and two categories) with low a missing proportion under MCAR/MAR, but showed a poor stability in other scenarios. CONCLUSIONS: estimates from multiple methods to allow assessment of result sensitivity.
Fields of Study & Subjects
Statistical Methods and Bayesian Inference
Reliability and Agreement in Measurement
Psychometric Methodologies and Testing
Publication details
- Journal / source
- PubMed
- Volume
- 46
- Issue
- 2
- Pages
- 466–472
- Publication date
- 20 February 2026
- Language
- ZH