Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction

Read full text
Authors: Muzammil Khan, Enzo Kerkhof, Matteo Fusaglia, Koert Kuhlmann, Theo J. M. Ruers, Françoise J. Siepel
Cited by: 1
References: 95

Abstract

Accurate endoscope pose estimation and3Dtissue reconstruction are essential for enhancing navigation and spatial awareness in monocular minimally invasive surgery. However, these tasks remain challenging due to depth ambiguity, physiological tissue deformation, inconsistent endoscope motion, limited texture fidelity, and the restricted field of view. To address these limitations, a unified monocular reconstruction framework is proposed that integrates scale-aware depth prediction with temporally constrained perceptual refinement. The proposed MAPIS-Depth module combines Depth Pro for robust scale initialisation with Depth Anything for efficient per-frame prediction, followed by L-BFGS-B optimisation to obtain pseudo-metric depth. Temporal consistency is further improved using RAFT-based pixel correspondences and LPIPS-guided adaptive blending, reducing artefacts caused by motion and deformation. For reliable registration of the synthesised pseudo-RGBD frames, the WEMA-RTDL module is introduced, which jointly optimises rotation and translation. Finally, truncated signed distance fusion and marching cubes are used to extract coherent3Dtissue surfaces. Experiments on the HEVD and SCARED datasets, supported by ablation studies and comparisons with state-of-the-art methods, demonstrate the robustness and superior accuracy of the proposed approach.

Fields of Study & Subjects

Soft Robotics and Applications Robotics and Sensor-Based Localization Surgical Simulation and Training

Publication details

Journal / source
IEEE Access
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
14
Pages
15464–15482
Publication date
1 January 2026
Language
EN