Piano Guide for XR
Abstract
Piano Guide for XR is an extended reality (XR) learning system designed to assist piano practice by overlaying interactive visual guidance directly onto a real or virtual keyboard. Using VR/AR pass-through, the system displays falling notes, key highlights, and real-time feedback aligned with the physical piano, allowing learners to focus on playing without shifting their gaze between sheet music and their hands. The project supports natural interaction through hand tracking and controllers, integrates MIDI/audio input for accurate timing and pitch feedback, and emphasizes immersive, user-centered design to improve learning efficiency and engagement. The goal is to explore how XR can enhance music education by reducing cognitive load and enabling more intuitive, embodied learning experiences.
Fields of Study & Subjects
Augmented Reality Applications
Diverse Music Education Insights
Music Technology and Sound Studies
Publication details
- Journal / source
- UR Research (University of Rochester)
- Publication date
- 1 January 2026
- Language
- EN