Virtual Air Drawing using Computer Vision and Real-time Captions

In the rapidly evolving digital education ecosystem, virtual classrooms require interactive and inclusive technologies to enhance teaching effectiveness. This paper presents Virtual Air Drawing using Computer Vision and Real-Time Captions, a system that enables instructors to draw in mid-air using hand gestures while simultaneously generating live captions from speech. The proposed approach utilizes computer vision–based hand tracking with MediaPipe to accurately capture gestures and render them onto a virtual canvas in real time. In addition, speech-to-text technology converts spoken content into captions, improving accessibility for learners with hearing impairments and language barriers. By integrating visual interaction with realtime textual support, the system enhances engagement, clarity, and inclusivity in online learning environments. The proposed solution is well suited for virtual classrooms, collaborative learning platforms, and interactive e-learning applications.