IoT Based Real-Time Sign Language Translator for Deaf People

View at publisher Summarise with VIRAT
Authors: Nur Batrisyia Busyra Badrisyam, Nur'aina Daud, Nurulhuda Noordin
Cited by: 0
References: 19

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

GloSign is an Internet of Things (IoT) based real-time sign language translation that is specially designed to support communication between deaf individuals and hearing people. The project was developed in response to ongoing communication barriers and social isolation experienced by the deaf community due to limited sign language understanding among hearing individuals. This project consists of integration between flex sensors that are attached to a glove with an Android mobile application through Bluetooth connectivity. The glove captures finger gestures which then translated into text and converted into speech using the Text-to-Speech feature. The system was built using the Mobile Application Development Life Cycle (MADLC). Firebase services are used to handle and support user authentication and cloud storage for translation history and saved favourites. The app also supports bilingual translation such as Bahasa Melayu and English. By having this feature, it enhances accessibility towards users. The system then tested with both deaf and hearing participants with feedback indicating a high usability testing with average score of 82.19. While system achieving their objective, several limitations exist and identified. For instance, bluetooth range, Android-only support, flex sensor calibration sensitivity and limited recognition of dynamic gestures due to absence of motion sensors. Despite having these challenges, GloSign still shows a strong potential as an assistive communication tool and lays the groundwork for future enhancements such as gesture recognition using machine learning, integration of accelerometers for dynamic gesture tracking and iOS compatibility.

Fields of Study & Subjects

Hand Gesture Recognition Systems Assistive Technology in Communication and Mobility Hearing Impairment and Communication

Publication details

Journal / source
International Conference on Cognitive Systems and Computer Interaction (ICoSCI)
Pages
1–6
Publication date
15 January 2026
Language
EN