Emotion-Aware Offline Speech Translation using Deep Learning for Real-Time Multilingual Communication

Read full text Summarise with VIRAT
Authors: Rahul Jadhav, Om Kadam, Rushikesh Wagh, Sneha P. Pathare, Prof. Dipali Pingle
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Real-time speech translation systems have gained significant importance in enabling seamless multilingual communication. However, most existing solutions rely heavily on cloud-based processing, resulting in latency, privacy concerns, and limited usability in low-connectivity environments. This paper presents an emotion-aware offline speech translation framework optimized using deep learning techniques for efficient real-time communication. The proposed system integrates automatic speech recognition, neural machine translation, emotion classification, and speech synthesis within a fully offline architecture. Deep learning models are optimized to reduce computational overhead while maintaining high accuracy across multiple languages. Emotion-aware processing enhances contextual understanding by adapting speech output according to detected emotional states. Experimental evaluation demonstrates improved translation accuracy, reduced response latency, and reliable performance under resource-constrained conditions. The proposed approach provides a scalable and privacy-preserving solution suitable for assistive technologies, smart devices, and multilingual human–computer interaction systems.

Fields of Study & Subjects

Speech Recognition and Synthesis Speech and Audio Processing Speech and dialogue systems

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
21 March 2026
Language
EN