Perancangan Alat Penerjemah Bahasa Isyarat Ke Suara Berbasis Sensor Flex, Sensor Mpu6050, Dan Raspberry Pi

Read full text
Authors: Zauqy Launu Hayya, Farady Alif Fiolana, Diah Arie Widhining
Cited by: 0

Abstract

Communication is a fundamental human need for conveying information and ideas. However, individuals who are deaf and mute face difficulties in communicating with the broader community that does not understand sign language. This study aims to design and implement a real-time static sign language translator into speech using five flex sensors, an MPU6050 sensor, a Raspberry Pi Pico, an ADS1115 ADC module, and a DFPlayer Mini module as the audio output medium. Testing results show that the device successfully recognizes finger movements and hand orientation. The system is capable of playing audio output corresponding to recognized gestures, with the shortest latency recorded at 1.1 seconds and the longest at 2.8 seconds, achieving a detection accuracy rate of 75% based on 60 tests across 12 sign words. This device supports the translation of 12 simple sign words. The implementation demonstrates potential as an assistive communication tool, although further development is needed to improve accuracy, expand vocabulary, and conduct trials directly with deaf or mute users.

Fields of Study & Subjects

Hand Gesture Recognition Systems IoT-based Control Systems Computer Science and Engineering

Publication details

Journal / source
Uranus Jurnal Ilmiah Teknik Elektro Sains dan Informatika
Volume
3
Issue
4
Pages
127–141
Publication date
5 January 2026