Enhancing generalizability theory with mixed‐effects models for heteroscedasticity in psychological measurement: A theoretical introduction with an application from EEG data

Read full text
Authors: Philippe Rast, Peter E. Clayson
Cited by: 2
References: 38

Abstract

Abstract Generalizability theory (G‐theory) defines a statistical framework for assessing measurement reliability by decomposing observed variance into meaningful components attributable to persons, facets, and error. Classic G‐theory assumes homoscedastic residual variances across measurement conditions, an assumption that is often violated in psychological and behavioural data. The main focus of this work is to extend G‐theory using a mixed‐effects location‐scale model (MELSM) that allows residual error variance to vary systematically across conditions and persons. By modeling heteroscedasticity, we can extend the computation of condition‐specific generalizability () and dependability () coefficients to reflect local reliability under varying degrees of measurement precision. As an illustration, we apply the model to empirical data from an EEG experiment and show that failing to account for variance heterogeneity can mask meaningful differences in measurement quality. A simulation‐based decision study further demonstrates how targeted increases in measurement density can improve reliability for low‐precision conditions or participants. The proposed framework retains the interpretative character of classical G‐theory while enhancing its flexibility. We argue that it supports finer‐grained insights on conditions that influence reliability and better‐informed design decisions in psychological measurements. We discuss implications for individualized reliability assessment, adaptive measurement strategies, and future extensions to multi‐facet designs.

Fields of Study & Subjects

Psychometric Methodologies and Testing Neural and Behavioral Psychology Studies Mental Health Research Topics

Publication details

Journal / source
British Journal of Mathematical and Statistical Psychology
Publisher
Wiley
Publication date
18 January 2026
Language
EN