Introducing a Bangla Sentence – Gloss Pair Dataset for Bangla Sign Language Translation and Research

Read full text
Authors: Neelavro Saha, Rafi Shahriyar, Nafis Ashraf Roudra, S M Nazmuz Sakib, Annajiat Alim Rasel
Cited by: 0

Abstract

Bangla Sign Language (BdSL) translation represents a low-resource NLP task due to the lack of large-scale datasets that address sentence-level translation. Correspondingly, existing research in this field has been limited to word and alphabet level detection. In this work, we introduce Bangla-SGP, a novel parallel dataset consisting of 1,000 human-annotated sentence-gloss pairs which was augmented with around 3,000 synthetically generated pairs using syntactic and morphological rules through a rule-based Retrieval-Augmented Generation (RAG) pipeline. The gloss sequences of the spoken Bangla sentences are made up of individual glosses which are Bangla sign supported words and serve as an intermediate representation for a continuous sign. Our dataset consists of 1000 high quality Bangla sentences that are manually annotated into a gloss sequence by a professional signer. The augmentation process incorporates rule-based linguistic strategies and prompt engineering techniques that we have adopted by critically analyzing our human annotated sentence-gloss pairs and by working closely with our professional signer. Furthermore, we fine-tune several transformer-based models such as mBart50, Google mT5, GPT4.1-nano and evaluate their sentence-to-gloss translation performance using BLEU scores, based on these evaluation metrics we compare the model's gloss-translation consistency across our dataset and the RWTH-PHOENIX-2014T benchmark.

Fields of Study & Subjects

Hand Gesture Recognition Systems Hearing Impairment and Communication Natural Language Processing Techniques

Publication details

Journal / source
Proceedings of the Language Resources and Evaluation Conference
Publisher
European Language Resources Association (ELRA)
Pages
10457–10466
Publication date
30 April 2026