HuPER: A Human-Inspired Framework for Phonetic Perception
Abstract
We propose HuPER, a human-inspired framework that models phonetic perception as adaptive inference over acoustic-phonetics evidence and linguistic knowledge. With only 100 hours of training data, HuPER achieves state-of-the-art phonetic error rates on five English benchmarks and strong zero-shot transfer to 95 unseen languages. HuPER is also the first framework to enable adaptive, multi-path phonetic perception under diverse acoustic conditions. All training data, models, and code are open-sourced. Code and demo avaliable at https://github.com/Berkeley-Speech-Group/HuPER.
Fields of Study & Subjects
Speech Recognition and Synthesis
Speech and Audio Processing
Phonetics and Phonology Research
Publication details
- Journal / source
- arXiv (Cornell University)
- Publication date
- 2 February 2026
- Document type
- Preprint