Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision

Read full text
Authors: Yuping He, Yifei Huang, Guo Chen, Lidong Lü, Baoqi Pei, Jilan Xu, Tong Lu, Yoichi Sato
Cited by: 2
References: 181

Abstract

Perceiving the world from both egocentric (first-person) and exocentric (third-person) perspectives is fundamental to human cognition, enabling rich and complementary understanding of dynamic environments. In recent years, allowing the machines to leverage the synergistic potential of these dual perspectives has emerged as a compelling research direction in video understanding. In this survey, we provide a comprehensive review of video understanding from both exocentric and egocentric viewpoints. We first ground our review in key application domains, from healthcare to embodied intelligence, to establish the practical value of ego-exo collaboration. From the needs of these applications, we derive a set of core research tasks. We then systematically organize recent advancements into three primary research directions: (1) leveraging egocentric data to enhance exocentric understanding, (2) utilizing exocentric data to improve egocentric analysis, and (3) joint learning frameworks that unify both perspectives. We also provide a detailed overview of relevant datasets and conclude by discussing current limitations and promising future directions. By synthesizing insights from both perspectives, our goal is to inspire advancements in video understanding and artificial intelligence, bringing machines closer to perceiving the world in a human-like manner.

Fields of Study & Subjects

Human Pose and Action Recognition Multimodal Machine Learning Applications Social Robot Interaction and HRI

Publication details

Journal / source
International Journal of Computer Vision
Publisher
Springer Science and Business Media LLC
Volume
134
Issue
2
Publication date
13 January 2026
Language
EN