Graph-Informed and FiLM-Enhanced Multimodal Fusion for Myocardial Infarction Prediction

View at publisher
Authors: Xiantong Xiang, Longxiao Gao, Yuansheng Liu, Ningji Gong, Yongshun Gong
Cited by: 1
References: 45

Abstract

Accurate and timely diagnosis of cardiovascular diseases, particularly myocardial infarction (MI), remains a critical clinical challenge. Existing electrocardiogram (ECG) analysis methods often rely solely on asingle data modality, such as raw signals or waveform images, which limits their ability to capture thebroader physiological context. To address this limitation, we propose GFM-MIP, a Graph-informed and FiLM-enhanced Multimodal Fusion framework for myocardial infarction prediction. GFM-MIP integrates 12-lead ECG time-series signals, ECG images, and laboratory test results through a unified architecture. Specifically, it employs a Graphormer encoder to model inter-lead dependencies in ECG signals and a Vision Transformer to extract morphological patterns from ECG images, both modulated by patient-specific laboratory features using Feature-wise Linear Modulation (FiLM). A Transformer-based fusion module captures cross-modal interactions, while a contrastive learning objective encourages alignment between signal and image modalities. Experimental results on a real-world clinical dataset and three public benchmarks demonstrate that GFM-MIP consistently outperforms state-of-the-art baselines across multiple evaluation metrics. Ablation studies further validate the contribution of each modality and architectural component. The proposed framework offers a clinically meaningful and scalable solution for robust, multimodal cardiovascular diagnosis.

Fields of Study & Subjects

ECG Monitoring and Analysis Machine Learning in Healthcare Artificial Intelligence in Healthcare

Publication details

Journal / source
IEEE Journal of Biomedical and Health Informatics
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
30
Issue
9
Pages
7431–7444
Publication date
3 March 2026
Language
EN