Research on the integration of English translation robot and speech enhancement technology based on deep learning

View at publisher Summarise with VIRAT
Authors: Yun Feng
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

With the acceleration of globalization, the demand for real-time cross-language interaction is increasing. However, traditional translation tools have problems such as translation errors or delays caused by noise interference in voice interaction scenarios. In this paper, a fusion system of English translation robot and speech enhancement technology based on deep learning is proposed. Dual-branch parallel architecture (DBPA) is adopted to perform speech enhancement and translation tasks respectively, and dynamic interaction is realized through feature alignment module to avoid error accumulation. At the same time, the dynamic weight allocation strategy is introduced to optimize the resource allocation in real time according to the noise level and speech complexity, so as to improve the efficiency and robustness of the system. Combined with the multi-modal countermeasure training mechanism, the generalization ability of the model to unknown noise is enhanced. The experimental results show that the system is superior to the traditional cascade model and the most advanced Noise-Adaptive ST(NAST) in noise robustness and real-time, and can maintain high translation quality in different noise environments, which provides new ideas and solutions for the development of cross-language interaction technology.

Fields of Study & Subjects

Speech and Audio Processing Speech Recognition and Synthesis Speech and dialogue systems

Publication details

Journal / source
IET conference proceedings.
Volume
2025
Issue
47
Pages
162–166
Publication date
1 March 2026
Language
EN