Post-ASR Correction for Low-Resource Rajasthani Language

Read full text
Authors: Abhishek Bhandari, Gaurav Harit
Cited by: 1
References: 12

Abstract

State-of-the-art multilingual Automatic Speech Recognition (ASR) models produce systematic errors when applied to low-resource languages like Rajasthani, for which they lack dedicated training data. This article addresses this challenge by introducing a post-ASR correction framework that leverages the complementary error patterns in the outputs (termed as views) from two distinct models: Whisper-large-v3 and MMS-1B-All. We propose a multi-view, 1 character-level sequence-to-sequence (Seq2Seq) model that uses a gated fusion mechanism to dynamically weigh information from the two ASR outputs. On a new benchmark created from the IndicTTS Rajasthani corpus, our gated model achieves a Character Error Rate (CER) of 7.86% and a Word Error Rate (WER) of 29.98%. This outperforms the best single-view baselines (8.01% CER and 30.33% WER), simple multi-view concatenation (8.21% CER and 30.05% WER), as well as Llama-3.2-3B and mBART-50-large, both fine-tuned on Whisper and MMS inputs. It also surpasses powerful Large Language Models (LLMs) like GPT-4o and Gemini 2.5 Pro in a zero-shot setting. This work establishes the first baseline for post-ASR correction in Rajasthani, demonstrating that a compact, specialized model is more effective than general-purpose LLMs for this targeted, low-resource task.

Fields of Study & Subjects

Speech Recognition and Synthesis Natural Language Processing Techniques Phonetics and Phonology Research

Publication details

Journal / source
ACM Transactions on Asian and Low-Resource Language Information Processing
Publisher
Association for Computing Machinery (ACM)
Volume
25
Issue
3
Pages
1–13
Publication date
24 January 2026
Language
EN