SignBridge: An Offline Bidirectional Indian Sign Language Translation System

Read full text
Authors: Samruddhi Pramod Bangar, Prasad Sakharam Khose, Nikita Sandeep Ubhe, Sonali Dongare
Cited by: 0

Abstract

Communication barriers persist for hearing and speech-impaired individuals due to the lack of real-time, offline, bidirectional Indian Sign Language (ISL) translation tools. This paper presents SignBridge, an offline bidirectional system supporting Sign-to-Text/Speech and Text-to-Sign translation. MediaPipe is used for extracting hand and pose landmarks, while a TensorFlow-based hybrid CNN– Transformer model performs dynamic gesture recognition. A full-stack implementation using React.js and Flask ensures real-time interaction, and an avatar-based rendering module generates visual sign outputs. The system is designed for low- resource environments with improved privacy and reduced dependency on internet connectivity.

Fields of Study & Subjects

Hand Gesture Recognition Systems Hearing Impairment and Communication Assistive Technology in Communication and Mobility

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
1 January 2026
Language
EN