CymruFluency - A Fusion Technique and a 4D Welsh Dataset for Welsh Fluency Analysis

Read full text
Authors: Arvinder Pal Singh Bali, Gary K. L. Tam, Avishek Siris, Gareth Andrews, Yukun Lai, Bernie Tiddeman, Gwenno Ffrancon
Cited by: 0
References: 33

Abstract

Welsh is a linguistically rich yet under-resourced minority language. Despite its cultural significance, automated fluency assessment remains largely unexplored due to limited datasets and tools. Existing models focus on high-resource languages, leaving Welsh without sufficient multi-modal resources. To address this, we introduce CymruFluency, the first 4D dataset for Welsh fluency assessment, capturing both audio and 3D lip movements with expert-annotated fluency scores. Building on this, we propose a multi-modal fluency classification framework that combines audio features (mel spectrograms) and manually annotated 3D lip landmarks. Our fusion approach significantly improves fluency prediction over unimodal models, emphasizing the critical role of 3D lip dynamics in Welsh learning. This research advances minority language processing by integrating articulatory features into fluency evaluation, offering a powerful tool for Welsh language learning, assessment, and preservation. Project page: https://github.com/arvinsingh/CymruFluency .

Fields of Study & Subjects

Speech and Audio Processing Phonetics and Phonology Research Voice and Speech Disorders

Publication details

Journal / source
Lecture notes in computer science
Pages
96–108
Publication date
1 January 2026
Language
EN