Validity arguments for creating a short motivation scale through adaptation of the Japanese motivated strategies for learning questionnaire

Background The coronavirus disease pandemic has substantially altered the mode of medical education, transitioning it from in-person to online. Online learning requires a strong motivational foundation to support self-directed studying. In our previous study, an adapted 31-item Japanese motivation measurement scale using the motivational section from the Japanese version of the Motivated Strategies for Learning Questionnaire (J-MSLQ) was developed. The present study aimed to collect evidence on the validity of the motivation section of the J-MSLQ and clarify whether further revision was necessary. Methods The motivation section of the J-MSLQ comprises a seven-point Likert scale survey containing 31 items. Of 127 fourth-year Japanese medical students invited to participate, 112 responded. Confirmatory factor analysis with structural equation modeling (SEM) was performed using R and R studio for all data analysis. Results The initial SEM model that incorporated all 31 items exhibited inadequate goodness of fit metrics: χ 2 = 823.674 (p < 0.001), the comparative fit index (CFI) = 0.786, the root mean square error of approximation (RMSEA) = 0.093, the standardized root mean square residual (SRMR) = 0.112, the goodness of fit index (GFI) = 0.664, and the adjusted goodness of fit index (AGFI) = 0.602. We optimized the scale by eliminating 11 items with the standardized factor loading < 0.60. Improvements in the goodness of fit metrics of the optimized SEM model were observed, demonstrating moderate model fit: χ 2 = 246.651 (p < 0.001), CFI = 0.926, RMSEA = 0.073, SRMR = 0.067, GFI = 0.822, and AGFI = 0.758. Conclusions A compact 20-item version of the motivation scale was developed and validated, which alleviated the respondent burden and enabled the researchers to collect data in a shorter time.