Beyond Structural Equation Modeling: A Complementary ML-XAI Approach to Predicting and Interpreting Phishing Security Behavior
Abstract
Phishing remains one of the most prevalent cybersecurity threats, yet behavioral research has relied predominantly on Structural Equation Modeling, a method optimized for population-level explanation but limited for individual-level prediction. This study applies a complementary Machine Learning and Explainable AI framework to predict phishing-related email security behavior among 535 university students. Seven supervised classification algorithms were evaluated within a cross-validation pipeline; Random Forest achieved the strongest performance (accuracy = 0.8505; ROC-AUC = 0.920). Explainability techniques including SHAP, LIME, DiCE counterfactual analysis, and SHAP-value clustering revealed that insecure behavior primarily reflects a failure of behavioral activation rather than awareness deficit. Perceived importance emerged as the dominant behavioral driver, while cluster analysis identified four statistically validated behavioral profiles with distinct intervention requirements. These findings challenge information-deficit assumptions underlying conventional awareness programs and demonstrate how predictive modeling can enable personalized, activation-oriented phishing mitigation strategies.
Fields of Study & Subjects
Spam and Phishing Detection
Information and Cyber Security
Cybercrime and Law Enforcement Studies
Publication details
- Journal / source
- International Journal of Human-Computer Interaction
- Publisher
- Informa UK Limited
- Pages
- 1–48
- Publication date
- 24 June 2026
- Language
- EN