SignSinhala: A Hybrid Machine Learning Model for English-to-Sinhala Sign Language Translation

Read full text
Authors: Pathumi Ahinsa, Sanduni Thrimahavithana, Kasun Thejitha Karunanayaka
Cited by: 0

Abstract

This paper presents SignSinhala, a hybrid machine learning framework designed to translate English text into Sinhala Sign Language. This system integrates natural language processing, neural gesture prediction, and video synthesis for sign language generation. Our novel approach incorporates grammar-aligned text preprocessing, synonym searching for out-of-vocabulary tokens, and a fingerspelling dataset leveraged to improve translation robustness. Experimental evaluation demonstrates strong semantic preservation and token filtering performance in preprocessing, laying the groundwork for effective sign generation. This research addresses a critical gap in sign language technology, fostering accessibility and inclusive communication for the deaf community.

Fields of Study & Subjects

Hand Gesture Recognition Systems Natural Language Processing Techniques Hearing Impairment and Communication

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
8 January 2026