MonoSTR: Structure-aware monocular 3D object detection via keypoint-based geometric representation

Read full text
Authors: Yeon Woo Cho, Jung Woo Cheon, Seok Bong Yoo
Cited by: 1
References: 13

Abstract

• Proposes a structure-aware monocular 3D detector based on semantic keypoints. • Recovers occluded object structure using a direction-guided autoencoder. • Uses dual-band depth features to mitigate depth ambiguity under occlusion. • Achieves reliable 3D perception for safety-critical transportation systems. Monocular 3D object detection provides a cost-effective alternative to multi-sensor setups, but estimating accurate depth from a single image remains inherently challenging. The difficulty becomes more pronounced when objects are partially visible. To address these challenges, we introduce skeleton keypoints. Semantic skeleton keypoints serve as interpretable structural cues that encode expert knowledge about object geometry. Our keypoint structural representation detects visible skeleton keypoints and reconstructs missing ones with an autoencoder reconstructor conditioned on coarse pose, providing a compact and shape-aware cue tolerant to occlusion and truncation. In parallel, depth features are estimated by a dual-band-guided depth predictor, which explicitly decomposes low- and high-frequency components to balance global context and fine details, thereby mitigating spectral bias and improving depth estimation for tiny and distant objects. These representations are then fused, and a scene-topology 3D detection head decodes class and box parameters while conditioning on neighborhood topology to enforce geometric consistency. Experiments show that our method provides more reliable 3D perception for decision-support systems in intelligent transportation by improving robustness under occlusion, demonstrating its effectiveness for autonomous driving perception systems.

Fields of Study & Subjects

Advanced Image and Video Retrieval Techniques Robotics and Sensor-Based Localization Medical Image Segmentation Techniques

Publication details

Journal / source
Expert Systems with Applications
Publisher
Elsevier BV
Volume
321
Pages
132274–132274
Publication date
3 April 2026
Language
EN