Data harmonization via regularized nonparametric mixing distribution estimation
Abstract
Data harmonization is the process of developing an equivalence between two measurements of a common domain. Our problem is motivated by dementia research in which multiple neuropsychological tests have been used in practice to measure the same underlying cognitive ability, such as memory or attention. We connect this statistical problem to mixing distribution estimation common in empirical Bayes approaches. We introduce and study a nonparametric latent trait model, develop a method that enforces the uniqueness of the regularized maximum likelihood estimator, show how a nonparametric EM algorithm will converge weakly to its maximizer, and illustrate its superior computational efficiency to off-the-shelf solvers. Furthermore, we develop methods for model selection and assessing the goodness-of-fit for the measurement model, an area neglected in most mixing distribution estimation problems. We develop methods for score conversion with uncertainty quantification in order to draw inferences on a whole population with multiple score scales. We apply our method to the National Alzheimer’s Coordination Center Uniform Dataset and show that we can use our method to convert between score measurements and account for the measurement error. We show that this method outperforms standard techniques commonly used in dementia research.
Fields of Study & Subjects
Bayesian Methods and Mixture Models
Statistical Methods and Inference
Bayesian Modeling and Causal Inference
Publication details
- Journal / source
- The Annals of Applied Statistics
- Publisher
- Institute of Mathematical Statistics
- Volume
- 20
- Issue
- 1
- Pages
- 260-284
- Publication date
- 1 March 2026
- Language
- EN