Neural light field representation and reconstruction based on a ray displacement field

Read full text
Authors: Chang Liu, Ligen Shi, Lina Wu, Kaiwen Yu, Jun Qiu
Cited by: 4
References: 21

Abstract

High-quality light field (LF) acquisition involves a trade-off between spatial and angular resolution. Hybrid camera systems offer a practical solution but present challenges for dense reconstruction due to sparse angular sampling and complex occlusions. To address these issues, this paper proposes a geometry-aware implicit neural representation (INR) framework for LF reconstruction. Distinct from traditional discrete representations or generic ray-space embeddings, we introduce a compact, continuous representation that combines a radiance field with a geometry module, where scalar disparity provides an ideal geometric interpretation and a ray-displacement field serves as the practical realization for occlusion-aware reconstruction. This framework leverages the global epipolar geometry of the 2D LF grid while utilizing the displacement field to correct local geometric inconsistencies caused by occlusions and non-Lambertian effects. By coupling these fields with a radiance network, our method enables end-to-end differentiable optimization from sparse, multi-resolution inputs without relying on large-scale external training datasets. Experiments on hybrid camera data fusion and spatial-angular super-resolution tasks demonstrate that our approach preserves high-frequency details and geometric consistency.

Fields of Study & Subjects

Visual perception and processing mechanisms Advanced Vision and Imaging Optical Imaging and Spectroscopy Techniques

Publication details

Journal / source
Optics Express
Publisher
Optica Publishing Group
Volume
34
Issue
8
Pages
15468–15468
Publication date
7 April 2026
Language
EN