AI-Powered Smart Vision Mouse Interface for Touchless Human Computer Interaction

The AI-Powered Smart Vision Mouse Interface integrates deep learning, computer vision, and speech recognition technologies to bring touchless human-computer interaction into the modern age. This solution is primarily directed at ensuring accessibility, hygiene, and user comfort by enabling cursor manipulation and carrying out mouse operations through gestures of the hand and voice commands recorded in real-time by a webcam and microphone, respectively. While speech recognition enables natural language instructions to be executed through this interface, Media Pipe and Convolutional Neural Network-based models detect and classify gestures. It offers a cheap, hardware-neutral solution that can be exploited in many different contexts. Experimental results have been able to show exceptional efficiency and responsiveness during real-world scenarios, despite its average gesture detection accuracy being 95.3% and voice command accuracy being 89%.