Applications of Multimodal Technology in User Interfaces: A Systematic Review

Read full text
Authors: Zhaohong Zhang
Cited by: 0
References: 17

Abstract

Development of user interface (UI) is undergoing traditional grafic user interface to multi-modal and AI-driven paradigms , which significantly enhanced interaction richness and system adaptability. Traditional interface rely on interaction logic that predefined and offering limited flexibility in addressing diverse user behaviors, cognitive patterns, and contextual conditions. Advances in multimodal technologies and artificial intelligence recently provide new opportunities to overcome these limitations through supporting context-aware, adaptive, and personalized interaction. This work aims to exploring how multimodal interaction and AI-based methods affect the design, evaluation, and enhancement of UI/UX systems. Through using a systematic review approach, recent studies identifies key trends in multimodal presentation, AI-driven evaluation, and adaptive interface mechanisms. The findings illustrate a shift from a static, visually dominant interfaces toward intelligent systems in which AI functions as an evaluator, optimizer, and co-creator within iterative human–AI design workflows. This review is anaylzing recent research which published from 2018-2025 with keyword UI/UX and multi-modal. Besides,this paper provides a conceptual framework in order to guide the development of explainable, adaptive, and human-centered multimodal UI/UX systems.This study contributes more possibility for applicating and exploring in the interdisplinary of HCI and design.

Fields of Study & Subjects

Usability and User Interface Design Interactive and Immersive Displays Innovative Human-Technology Interaction

Publication details

Journal / source
Applied and Computational Engineering
Volume
227
Issue
1
Pages
15–30
Publication date
9 March 2026
Language
EN