Tracing Mathematical Proficiency Through Problem-Solving Processes
Abstract
Knowledge Tracing (KT) aims to model student's knowledge state and predict future performance to enable personalized learning in Intelligent Tutoring Systems.However, traditional KT methods face fundamental limitations in explainability, as they rely solely on the response correctness, neglecting the rich information embedded in students' problemsolving processes.To address this gap, we propose Knowledge Tracing Leveraging Problem-Solving Process (KT-PSP), which incorporates students' problem-solving processes to capture the multidimensional aspects of mathematical proficiency.We also introduce KT-PSP-25, a new dataset specifically designed for KT-PSP.Building on this, we present StatusKT, a KT framework that employs a teacher-studentteacher three-stage LLM pipeline to extract students' Mathematical Proficiency (MP) as intermediate representation.In this pipeline, the teacher LLM first extracts problem-specific proficiency indicators, then a student LLM generates responses based on the student's solution process, and a teacher LLM evaluates these responses to determine mastery of each indicator.The experimental results on KT-PSP-25 demonstrate that StatusKT improves the prediction performance of existing KT methods.Moreover, StatusKT provides interpretable explanations for its predictions by explicitly modeling students' mathematical proficiency.Code is available here.
Fields of Study & Subjects
Intelligent Tutoring Systems and Adaptive Learning
Innovative Teaching and Learning Methods
Online Learning and Analytics
Publication details
- Journal / source
- Findings of the Association for Computational Linguistics: ACL 2026
- Publisher
- Association for Computational Linguistics
- Pages
- 19251–19269
- Publication date
- 1 January 2026