Design and implementation of interactive intelligent system for Russian learning based on augmented reality and speech recognition
Abstract
The purpose of this study is to design and implement an interactive intelligent system for Russian learning, which integrates augmented reality (AR) and speech recognition technology, in order to solve the problems existing in traditional Russian learning methods, such as lack of immersion, poor interactivity and difficulty in pronunciation correction. The system adopts hierarchical architecture design, covering user layer, application layer, service layer and hardware layer, and supports interaction through AR glasses or mobile phones. In the core function, AR scene interaction is realized by SLAM spatial registration and image recognition technology, and speech training, pronunciation scoring and grammar training are realized by end-to-end speech recognition based on WFST decoding and dynamic time warping (DTW) algorithm. The system builds AR engine based on Unity3D, integrates Russian speech recognition model and pronunciation scoring algorithm under the framework of Kaldi, realizes modular training of vocabulary, grammar and pronunciation, and introduces gamification learning mechanism to enhance learning motivation. The test results show that compared with the benchmark system based on Google speech recognition API, the word error rate of this system is reduced by 43.3%, the consonant cluster recognition accuracy is improved by 21.4%, the soft tone symbol capture rate is improved by 16.8%, and the end-to-end delay is reduced by 37.7%. The accuracy of pronunciation scoring algorithm is 92.7%. After two weeks of training, the learners who use this system are significantly better than the traditional method group in vocabulary memory, pronunciation accuracy, grammar error rate and daily active learning time. The analysis of user experience shows that the system is highly evaluated in terms of interest, immersion, convenience of operation, feedback clarity and stability. The system provides an efficient, interesting and immersive new learning method for Russian learning, which has a good application prospect and popularization value.
Fields of Study & Subjects
Augmented Reality Applications
Advanced Technologies in Various Fields
Advanced Technology in Applications
Publication details
- Journal / source
- IET conference proceedings.
- Volume
- 2025
- Issue
- 34
- Pages
- 900–906
- Publication date
- 1 January 2026
- Language
- EN