Predicting Student Outcomes and Withdrawal Timing: A Robust, Interpretable Machine Learning Approach across Heterogeneous Educational Contexts

Read full text Summarise with VIRAT
Authors: Caroline Lourenço Alves, Marius Oechsner, Manoela Oliveira da Silva, Caprice Graciete Lima de Oliveira, Marie Anaïs Zottnick
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Digital learning environments generate detailed traces of student participation, yet predictive learning analytics often remain focused on static endpoint classification and rarely examine whether findings generalize across heterogeneous educational contexts. Using the Open University Learning Analytics Dataset (OULAD), this study develops and evaluates an interpretable dual-task framework to predict both four-class outcomes (Withdrawn, Fail, Pass, Distinction) and time-to-withdrawal among students who disengage. The primary novelty of the study lies in integrating multiclass outcome prediction, continuous modeling of withdrawal timing, and subgroup generalization analyses across course modules and UK regions within a single unified evaluation framework. Through this integrated design, the study moves beyond the global or binary prediction settings that dominate much of the prior literature. Engagement was operationalized through interpretable indicators of participation consistency, interaction breadth, and temporal redistribution of activity, alongside demographic and course-context variables. Models were trained with strict train/validation/test separation, repeated resampling, and explicit leakage-prevention procedures. For final outcome prediction, Random Forest achieved strong and balanced performance (macro-AUC OvR = 0.925), with reliable detection of withdrawal. For withdrawal timing, XGBoost explained substantial variance (test R² = 0.747; RMSE = 42.99 days). Performance also remained consistently high across diverse modules and regions, indicating that the identified engagement patterns are robust across instructional contexts. Permutation importance and partial dependence analyses indicated that sustained participation and broad interaction were most strongly associated with favorable outcomes, whereas withdrawal timing was primarily related to registration timing, late-phase activity, and active-day regularity. These findings extend predictive learning analytics toward temporally resolved and context-aware modeling, supporting targeted, interpretable, and time-sensitive intervention strategies in digital higher education.

Fields of Study & Subjects

Online Learning and Analytics Intelligent Tutoring Systems and Adaptive Learning AI and HR Technologies

Publication details

Journal / source
SocArXiv (OSF Preprints)
Publication date
28 March 2026
Language
EN
Document type
Preprint