HuPER: A Human-Inspired Framework for Phonetic Perception

Read full text
Authors: Chenxu Guo, Jiachen Lian, Yisi Liu, Baihe Huang, Shriyaa Narayanan, Bixing Wu, Zoe Ezzes, Jet M. J. Vonk, Zachary Miller, Cheol Jun Cho, Maria Gorno-Tempini, Gopala Anumanchipalli
Cited by: 0

Abstract

We propose HuPER, a human-inspired framework that models phonetic perception as adaptive inference over acoustic-phonetics evidence and linguistic knowledge. With only 100 hours of training data, HuPER achieves state-of-the-art phonetic error rates on five English benchmarks and strong zero-shot transfer to 95 unseen languages. HuPER is also the first framework to enable adaptive, multi-path phonetic perception under diverse acoustic conditions. All training data, models, and code are open-sourced. Code and demo avaliable at https://github.com/Berkeley-Speech-Group/HuPER.

Fields of Study & Subjects

Speech Recognition and Synthesis Speech and Audio Processing Phonetics and Phonology Research

Publication details

Journal / source
arXiv (Cornell University)
Publication date
2 February 2026
Document type
Preprint