Piano Guide for XR

Read full text
Authors: Jiankun (Eric) Yang
Cited by: 0

Abstract

Piano Guide for XR is an extended reality (XR) learning system designed to assist piano practice by overlaying interactive visual guidance directly onto a real or virtual keyboard. Using VR/AR pass-through, the system displays falling notes, key highlights, and real-time feedback aligned with the physical piano, allowing learners to focus on playing without shifting their gaze between sheet music and their hands. The project supports natural interaction through hand tracking and controllers, integrates MIDI/audio input for accurate timing and pitch feedback, and emphasizes immersive, user-centered design to improve learning efficiency and engagement. The goal is to explore how XR can enhance music education by reducing cognitive load and enabling more intuitive, embodied learning experiences.

Fields of Study & Subjects

Augmented Reality Applications Diverse Music Education Insights Music Technology and Sound Studies

Publication details

Journal / source
UR Research (University of Rochester)
Publication date
1 January 2026
Language
EN