Controllable End-to-End Neural Source–Filter Vocoder With Low-Dimensional Speech Parameters and Data Augmentation

Read full text Summarise with VIRAT
Authors: Sumiharu Kobayashi, Tetsuo Kosaka, Takashi Nose
Cited by: 0
References: 44

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Recent neural vocoders synthesize speech waveforms from high-dimensional spectrograms, making it difficult to control individual speech parameters such asF0and formants. Previous research has proposed a speech synthesis system that controls speech parameters by converting low-dimensional parameters into spectrograms that serve as input to a neural vocoder. However, the quality of the synthesized speech degrades because the generated spectral time series differs from the natural speech used to train the neural vocoder. In this study, we propose a controllable end-to-end neural vocoder that directly synthesizes speech waveforms from low-dimensional speech parameters. Furthermore, we aim to improve the synthesis quality during speech-parameter control by introducing a source–filter model and employing data augmentation. Experimental evaluations show that the source-filter-based method synthesizes speech with quality equal to or better than that of conventional approaches when controlling speech parameters. Additionally, data augmentation improved the robustness ofF0and formant controls. A demonstration of the proposed methods is available online (https://misumisumi.github.io/myprojects/end-to-end-neural-formant-synthesis).

Fields of Study & Subjects

Speech Recognition and Synthesis Speech and Audio Processing Voice and Speech Disorders

Publication details

Journal / source
IEEE Access
Volume
14
Pages
50191–50203
Publication date
1 January 2026
Language
EN