Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction
Abstract
Accurate endoscope pose estimation and3Dtissue reconstruction are essential for enhancing navigation and spatial awareness in monocular minimally invasive surgery. However, these tasks remain challenging due to depth ambiguity, physiological tissue deformation, inconsistent endoscope motion, limited texture fidelity, and the restricted field of view. To address these limitations, a unified monocular reconstruction framework is proposed that integrates scale-aware depth prediction with temporally constrained perceptual refinement. The proposed MAPIS-Depth module combines Depth Pro for robust scale initialisation with Depth Anything for efficient per-frame prediction, followed by L-BFGS-B optimisation to obtain pseudo-metric depth. Temporal consistency is further improved using RAFT-based pixel correspondences and LPIPS-guided adaptive blending, reducing artefacts caused by motion and deformation. For reliable registration of the synthesised pseudo-RGBD frames, the WEMA-RTDL module is introduced, which jointly optimises rotation and translation. Finally, truncated signed distance fusion and marching cubes are used to extract coherent3Dtissue surfaces. Experiments on the HEVD and SCARED datasets, supported by ablation studies and comparisons with state-of-the-art methods, demonstrate the robustness and superior accuracy of the proposed approach.
Fields of Study & Subjects
Soft Robotics and Applications
Robotics and Sensor-Based Localization
Surgical Simulation and Training
Publication details
- Journal / source
- IEEE Access
- Publisher
- Institute of Electrical and Electronics Engineers (IEEE)
- Volume
- 14
- Pages
- 15464–15482
- Publication date
- 1 January 2026
- Language
- EN