From a Glance to a Boundary: Uncertainty-Aware Distillation for Glance-Supervised Video Moment Localization

View at publisher
Authors: Yupeng Hu, Hao Liu, Kun Wang, Ruping Cao, Yinwei Wei, Liqiang Nie
Cited by: 1
References: 64

Abstract

Glance-supervised video moment localization, which requires only single-frame annotations within target moments, offers a promising balance between annotation efficiency and localization precision. However, existing methods suffer from a fundamental limitation: the inherent uncertainty regarding precise moment boundaries when given only glance supervision. Current approaches either assume deterministic relationships between glance annotations and boundaries or employ predefined soft-label distributions, both failing to capture the complexity of real-world boundary uncertainty. We introduce UDist, an uncertainty-aware distillation network that explicitly models boundary prediction uncertainty as learnable probability distributions. Our framework consists of two key components: 1) an Uncertainty-aware Offset Distribution (UOD) mechanism, transforming implicit boundary uncertainty into explicit probability distributions over discretized offset bins; and 2) a dual-branch distillation framework that transfers uncertainty knowledge from a teacher to a student branch through a competitive distillation process. This “certainty to uncertainty to refined certainty” paradigm converts glance annotation certainty into uncertainty representations, then distills them into precise boundary predictions. Experiments on Charades-STA, ActivityNet Captions and TACoS show UDist improves localization accuracy while maintaining computational efficiency.

Fields of Study & Subjects

Human Pose and Action Recognition Generative Adversarial Networks and Image Synthesis Domain Adaptation and Few-Shot Learning

Publication details

Journal / source
IEEE Transactions on Multimedia
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
28
Pages
1–11
Publication date
1 January 2026