Exploring thermal contact potentials for hand–object interaction refinement
Abstract
Reconstructing hand–object interactions from visual data is difficult under severe occlusions, especially when soft objects are involved. In this work, we explore the use of thermal imagery as an additional cue for refining RGBbased hand–object reconstruction. We map multi-view thermal observations onto object surfaces and represent delayed thermal traces of contact as a contact potential field. This field is incorporated as a soft temporal cue to refine hand–object relative poses. Preliminary results indicate that thermal guidance can help resolve visually ambiguous configurations caused by occlusions.
Fields of Study & Subjects
Robot Manipulation and Learning
Advanced Vision and Imaging
Hand Gesture Recognition Systems
Publication details
- Journal / source
- Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR)
- Pages
- 46–46
- Publication date
- 5 March 2026
- Language
- EN