ImKWS: Test-Time Adaptation for Keyword Spotting with Class Imbalance

Read full text
Authors: Hanyu Ding, Yang Xiao, Jiaheng Dong, Ting Dang
Cited by: 0
References: 4

Abstract

Keyword spotting (KWS) identifies words for voice assistants, but environmental noise frequently reduces accuracy.Standard adaptation fixes this issue and strictly requires original or labeled audio.Test-time adaptation (TTA) solves this data constraint using only unlabeled test audio.However, current methods fail to handle the severe imbalance between rare keywords and frequent background sounds.Consequently, standard entropy minimization becomes overconfident and heavily biased toward the frequent background class.To overcome this problem, we propose a TTA method named ImKWS.Our approach splits the entropy process into a reward branch and a penalty branch with separate update strengths.Furthermore, we enforce consistency across multiple audio transformations to ensure stable model updates.Experiments on the Google Speech Commands dataset indicate ImKWS achieves reliable adaptation in realistic imbalanced scenarios.The code is available on GitHub 1 .

Fields of Study & Subjects

Speech Recognition and Synthesis Domain Adaptation and Few-Shot Learning Speech and Audio Processing

Publication details

Journal / source
Interspeech (USB)
Pages
1272–1276
Publication date
27 September 2026
Language
EN