Patient-independent Evaluation of CNN-LSTM for Facial Expression Recognition in Intubated ICU Patients
Abstract
This study evaluates CNN-LSTM architectures for facial expression recognition (FER) in intubated ICU patients under strict patient-independent Leave-One-Patient-Out Cross-Validation (LOPOCV), aiming to establish a conservative baseline for clinical video analysis.The dataset comprises 33 videos from 10 ICU patients annotated by medical experts, with ten clinical expression labels consolidated into three FER target classes based on clinical relevance.Spatial facial features were extracted using ImageNet-pretrained CNN backbones, while temporal dependencies were modeled using an LSTM module.Controlled baseline comparisons were conducted between static CNN models, temporal aggregation (CNN-GTP), and sequential temporal modeling (CNN-LSTM) under identical preprocessing and training configurations.Four CNN backbones were evaluated with fully frozen feature extractors to isolate the effect of temporal modeling.The results indicate that temporal modeling improves macro-averaged performance, while overall performance remains constrained by limited data size, class imbalance, and inter-patient variability.These findings underscore the importance of patient-independent evaluation and establish a conservative, clinically grounded baseline for future ICU-oriented FER research.
Fields of Study & Subjects
Emotion and Mood Recognition
Anesthesia and Sedative Agents
Intensive Care Unit Cognitive Disorders
Publication details
- Journal / source
- International journal of intelligent engineering and systems
- Publisher
- The Intelligent Networks and Systems Society
- Volume
- 19
- Issue
- 5
- Pages
- 1109–1123
- Publication date
- 31 May 2026