Pre-registration: Nomological consistency of various short-form scales relative to their full-form counterparts
Abstract
This pre-registration describes the planned validation of 93 short-form or abridged scales used in the New Zealand Attitudes and Values Study (NZAVS) by assessing their nomological consistency in an undergraduate sample (n=3,244). Nomological consistency is assessed using the absolute-agreement single-rater intraclass correlation (ICC) for a mixed-effects model comparing paired vectors of (z-transformed) bivariate correlations for each short-form and parent full-form scale with the same set of k=113 criterion variables. A short-form scale can be said to have nomological consistency to the extent that its measurements provide a pattern of correlations with a large set of diverse criterion variables (the nomological network) consistent with that observed when the full-form scale is correlated with that same criterion set. Thresholds indicating when results based on short-form scales should be comparable to those using their parent long-form are proposed. The analysis plan is described in full, and employs data from the scale validation dataset compiled by Sibley et al. (2024). This pre-registration provides the word-for-word introduction, method and analysis plan that will be submitted as part of the full manuscript once analyses have been conducted. This should ideally be the same version that is eventually published, pending any changes suggested by Reviewer 2, of course. CS predicted 50% of short-forms would have ICC > .90, and 80% would have ICC > .75. DO predicted 20% of short-forms would have ICC > .90, and 65% would have ICC > .75.
Fields of Study & Subjects
Psychometric Methodologies and Testing
Reliability and Agreement in Measurement
Psychological Testing and Assessment
Publication details
- Journal / source
- Open Science Framework
- Publication date
- 1 January 2026