Applications of Multimodal Technology in User Interfaces: A Systematic Review
Abstract
Development of user interface (UI) is undergoing traditional grafic user interface to multi-modal and AI-driven paradigms , which significantly enhanced interaction richness and system adaptability. Traditional interface rely on interaction logic that predefined and offering limited flexibility in addressing diverse user behaviors, cognitive patterns, and contextual conditions. Advances in multimodal technologies and artificial intelligence recently provide new opportunities to overcome these limitations through supporting context-aware, adaptive, and personalized interaction. This work aims to exploring how multimodal interaction and AI-based methods affect the design, evaluation, and enhancement of UI/UX systems. Through using a systematic review approach, recent studies identifies key trends in multimodal presentation, AI-driven evaluation, and adaptive interface mechanisms. The findings illustrate a shift from a static, visually dominant interfaces toward intelligent systems in which AI functions as an evaluator, optimizer, and co-creator within iterative human–AI design workflows. This review is anaylzing recent research which published from 2018-2025 with keyword UI/UX and multi-modal. Besides,this paper provides a conceptual framework in order to guide the development of explainable, adaptive, and human-centered multimodal UI/UX systems.This study contributes more possibility for applicating and exploring in the interdisplinary of HCI and design.
Fields of Study & Subjects
Usability and User Interface Design
Interactive and Immersive Displays
Innovative Human-Technology Interaction
Publication details
- Journal / source
- Applied and Computational Engineering
- Volume
- 227
- Issue
- 1
- Pages
- 15–30
- Publication date
- 9 March 2026
- Language
- EN