AI Sign Language Translation System

Read full text
Authors: Avish Jhalani, Suryansh Lodha
Cited by: 0

Abstract

This preprint presents a real-time sign language translation system designed to bridge communication gaps between sign language users and non-signers. The system integrates two complementary deep learning approaches: a convolutional neural network (CNN) for image-based gesture classification and a MediaPipe-based multilayer perceptron (MLP) using hand landmark features. The application is deployed as a web-based platform using Flask, enabling real-time video streaming and live gesture recognition via standard webcams. Experimental results demonstrate that the CNN model achieves higher accuracy for complex gestures, while the MLP model provides faster inference and improved computational efficiency. The modular and extensible design allows easy expansion to additional sign vocabularies and supports future research in assistive and accessibility-focused technologies.

Fields of Study & Subjects

Hand Gesture Recognition Systems Human Pose and Action Recognition Hearing Impairment and Communication

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
15 January 2026
Language
EN