Attention-Based Remote Photoplethysmography Estimation from Facial Video with Balanced Time-Frequency Supervision

Read full text Summarise with VIRAT
Authors: Sungpil Woo
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

This study proposes a robust and cost-effective contactless remote photoplethysmography (rPPG) estimation method capable of extracting heart rate signals directly from facial videos. To address motion artifacts and environmental noise, model, designated as Balanced-TF, employs an attention-based deep learning architecture. This architecture captures long-range temporal relationships across frames while selectively attending to salient spatial features by leveraging inter-pixel relationships. We introduce a dynamic supervision strategy utilizing a hybrid loss function that incorporates both frequency and time domain losses. Time-domain supervision captures signal trends, whereas frequency-domain supervision ensures periodic physiological features are maintained within the target frequency band. The adaptive adjustment of these constraints accelerates convergence speed and minimizes overfitting risks. Extensive experimental results on the UBFC-rPPG and PURE datasets demonstrate that achieving an optimal balance between time-frequency supervision significantly enhances the robustness and generalizability of rPPG estimation. Consequently, the proposed model consistently outperforms existing methods, highlighting the efficacy of Balanced-TF in remote physiological monitoring. This study contributes to broadening the practical applicability of contactless health monitoring systems in real-world scenarios.

Fields of Study & Subjects

Non-Invasive Vital Sign Monitoring Emotion and Mood Recognition Heart Rate Variability and Autonomic Control

Publication details

Journal / source
Journal of Korea Multimedia Society
Volume
29
Issue
2
Pages
211–219
Publication date
28 February 2026
Language
EN