How Students Really Use Courseware: Visualizing Student Pathways in Integrated Chemistry Courseware

Integrated chemistry courseware such as REAL CHEM captures rich, fine-grained data on how students engage in the process of learning. Our early analyses show that students in the same course—and under identical policies—often navigate the materials in surprisingly different ways, with implications for both instruction and learning outcomes. To support instructors and researchers in interpreting these patterns, we developed an interactive visualization tool that displays each student’s sequence of interactions across units and modules, along with clustering methods that group students by behavioral similarity. Instructor use of the tool revealed substantial variation in engagement and highlighted cases where students were not using the courseware in the ways instructors intended. Some policies produced more consistent behavior, while others allowed wide divergence. These findings underscore the importance of using learning engineering to understand student pathways when designing courseware, interpreting learning data, and shaping course policies.