A Hybrid Spatiotemporal Fusion Model for Real-time Fall Detection

View at publisher
Authors: EunYoung Kim, Jaeho Lee
Cited by: 0
References: 19

Abstract

We propose a hybrid spatiotemporal fusion model for real‑time fall detection using monocular camera videos. Per-frame spatial features are extracted by a lightweight CNN with squeeze-and-excitation modules, an AutoEncoder reduces noise to generate core representations, and a two-layer GRU together with a Transformer encoder jointly learns temporal flow and global relations. Multi-task learning that combines classification error (cross-entropy) and reconstruction error (MSE) enables discrimination of subtle pre-fall motions. Evaluated on sequences (30 frames by default) compiled from multiple public datasets with a subject-wise split, the proposed model achieves 97.10% accuracy (67/69), 100% recall for falls (FN=0), and ROC–AUC of 1.00. With 0.91 GFLOPs, 3.22 M parameters, and an average inference delay of 8.16 ms per sample, its usability in edge environments is verified.

Fields of Study & Subjects

Context-Aware Activity Recognition Systems Human Pose and Action Recognition Balance Gait and Falls Prevention

Publication details

Journal / source
Journal of Institute of Control Robotics and Systems
Volume
32
Issue
2
Pages
307–316
Publication date
1 February 2026
Language
EN