Gesture-Driven and IoT-Integrated Laptop Control System for Touchless Human–Computer Interaction

Touchless human-computer interface systems are becoming more and more significant because these systems will be applied in the area of access, convenience, and hygienic computing environment. In this paper, a gesture-based and IoT-enabled laptop control system, which allows users to control their laptops by using gestures, will be presented. The proposed system has deployed ultrasonic sensors connected to an Arduino module that can detect the movements of hands and send them to a Java based control program to interpret the gestures and a command is executed. Various gesture patterns are mapped to navigation, media control and system level operations. Java based architecture enhances platform independence, modularity and execution stability in comparison to script implementations. Experimental testing proves to have good gesture recognition at reasonable response time and therefore the system can be used in applications of assistive computing and touchless interaction. General Terms Embedded Systems, Human-Computer Interaction. Keywords Gesture Recognition, Internet of Things, Arduino, Java, Touchless Computing.