CLARIS: Clear and Intelligible Speech from Whispered and Dysarthric Voices

Read full text
Authors: Neil Shah, Yash Sonkar, Shirish Subhash Karande, Vineet Gandhi
Cited by: 1
References: 79

Abstract

Whispered and dysarthric speech hinder effective communication and undermine the reliability of voice-enabled systems. We present CLARIS, a compact speech-to-speech restoration system that turns such atypical input into clear, expressive speech. CLARIS requires no disorder-specific architectural tuning, generalizes across languages, and adapts quickly to new accents and speakers, enabling practical personalization. On whispered English, Hindi, and clinically challenging dysarthric speech, CLARIS delivers state-of-the-art intelligibility and naturalness, with listener studies confirming gains in quality, intelligibility, naturalness, and prosody. The system runs in real time, converting one second of input in about 30ms and enables inclusive, private, and personalized voice interaction. Audio samples are available at https://claris-w2s.github.io/CLARIS/

Fields of Study & Subjects

Voice and Speech Disorders Speech Recognition and Synthesis Phonetics and Phonology Research

Publication details

Journal / source
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Pages
1–18
Publication date
13 April 2026