AI - Powered Hand Tracker for SignLanguage Recognition

View at publisher Summarise with VIRAT
Authors: Padidapu Karthik, Surimalla Dileep, Kummaripalli Tirumalesh, Raavi Harika, Pragada Tejaswini, Vani Manikyam P
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Communication feels simple for most people, but for those who rely on sign language, it can quickly become difficult when others don’t understand their gestures. This project tries to reduce that gap by building an AI powered hand tracking system for sign language recognition. The system uses a webcam to capture live video. It then applies MediaPipe to detect hand landmarks, focusing only on important points like fingers and joints instead of the entire image. This makes the process lighter and more efficient. These landmarks are collected over multiple frames, because gestures change over time, and are then passed into a TensorFlow/Keras model for prediction.The model identifies the gesture and displays the result on the screen in real time. It also stores previous predictions, which makes the system feel more complete. The response is usually quick, though sometimes small delays or lighting changes can affect accuracy.The system currently supports a limited set of gestures, so it works best in controlled conditions. Still, it shows that combining hand tracking with deep learning can create a practical and usable solution. With more data and improvements, it can be extended further.Keywords:Sign Language Recognition, Hand Tracking, MediaPipe, Deep Learning, Gesture Recognition,Computer Vision, Real-Time System, TensorFlow

Fields of Study & Subjects

Hand Gesture Recognition Systems Human Pose and Action Recognition Gaze Tracking and Assistive Technology

Publication details

Journal / source
International Scientific Journal of Engineering and Management
Volume
05
Issue
03
Pages
1–9
Publication date
31 March 2026
Language
EN