Hierarchical Interactive Multi-Plane Image Construction for Light Field Background and Reflection Separation

Reflections pose a significant challenge to the quality of light field images. Existing reflection removal methods typically regard it as pixel classification of 2D images, overlooking the fundamental principle that reflections arise from the 3D spatial superposition of background and reflection spaces. In this work, we propose a hierarchical interactive Multi-Plane Image (MPI) construction approach, which separates the mixed 3D space containing reflections and constructs two independent MPIs. We leverage the layered structure of MPIs to introduce three hierarchical interaction mechanisms: The inter interaction is designed to separate and recover background and reflection components, the intra interaction aims to reduce errors in information distribution within each plane, and the inner interaction focuses on optimizing the MPI structure itself. Ultimately, we successfully separate the mixed images and reconstruct two independent spatial representations. Compared to existing reflection removal methods, our approach not only achieves superior separation performance but also supports novel view synthesis of the separated results. In challenging scenarios with severe overlap between background and reflection, our method demonstrates a remarkable ability to improve separation quality.