SIGN LANGUAGE TRANSLATOR FOR SPEECH IMPAIRED PEOPLE
Abstract
Sign language is a critical means of communication for the deaf and hard-of-hearing community.Translating sign language to speech can bridge the communication gap, fostering inclusivity.This work explores the use of Convolutional Neural Networks (CNNs) to develop a system that converts sign language gestures into spoken words.The process begins with data collection, involving videos or images of individuals performing sign language gestures, which are then preprocessed through frame extraction, normalization, data augmentation, and label encoding.A CNN model is designed with multiple convolutional and pooling layers to extract features, followed by fully connected layers for classification.The model is trained on a preprocessed dataset, with evaluation ensuring accuracy and generalization to new data.For real-time applications, a webcam captures video frames that the trained model processes to recognize gestures instantly.To convert recognized gestures into speech, the system maps predicted gestures to corresponding text labels, utilizing the pyttsx3 text-to-speech (TTS) library to vocalize the output.This dual-stage process of recognition and vocalization facilitates seamless communication.The proposed approach demonstrates the feasibility of using deep learning for sign language recognition and real-time translation to speech.This technology holds promise for enhancing communication accessibility, providing an essential tool for the deaf and hard-of-hearing community, and fostering greater social integration.
Fields of Study & Subjects
Subtitles and Audiovisual Media
Hand Gesture Recognition Systems
Speech Recognition and Synthesis
Publication details
- Journal / source
- International Research Journal of Modernization in Engineering Technology and Science
- Publication date
- 4 January 2026