Hyperbolic Active Learning for Label-Efficient Action Segmentation

Read full text Summarise with VIRAT
Authors: Jingqiao Xiu, Wei Ji, Menglin Yang, Yufeng Chen, Hanbin Zhao, Fangfang Wang, Roger Zimmermann
Cited by: 0
References: 72

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Recent advances in action segmentation have greatly enhanced our understanding of complex and dynamic scenes in video content. Despite these improvements, the field continues to face persistent challenges, particularly in terms of model efficiency and the substantial cost associated with manual annotation. In this work, we introduce a novel framework that integrates active learning within hyperbolic space to effectively address these issues. By leveraging the hierarchical representational capacity of hyperbolic space, which is naturally suited for modeling structured data, and combining it with the selective efficiency of active learning, our method introduces hyperbolic uncertainty metrics to guide the targeted selection of the most informative video frames and sequences for annotation. This enables the model to prioritize annotation efforts where they are most impactful. Furthermore, the model iteratively refines pseudo labels using all available annotations, significantly reducing the need for exhaustive labeling while preserving high segmentation accuracy. To further mitigate reliance on precise annotations, we enhance the MS-TCN model by incorporating soft pseudo labels and a weighting mechanism that dynamically adjusts learning based on label confidence, allowing for more robust training in the presence of noisy or weakly labeled data. Extensive experiments conducted on two widely used action segmentation benchmark datasets validate the effectiveness of our approach, demonstrating that it can substantially reduce annotation effort while maintaining overall segmentation performance.

Fields of Study & Subjects

Human Pose and Action Recognition Domain Adaptation and Few-Shot Learning Machine Learning and Algorithms

Publication details

Journal / source
ACM Transactions on Multimedia Computing Communications and Applications
Volume
22
Issue
7
Pages
1–18
Publication date
30 March 2026
Language
EN