Semantic-Spatial Guided Reasoning for Human-Object Interaction Detection
Abstract
Human-Object Interaction (HOI) detection requires not only recognizingwhatthe interaction is but also understandingwhereit occurs. Although recent methods have achieved remarkable progress, they often lack effective joint modeling of spatial and semantic information, which is essential for accurate reasoning in complex scenes. In this paper, we propose a Semantic-Spatial Guided Reasoning (SSGR) framework that performs interaction reasoning by jointly modeling global semantic cues and fine-grained spatial priors. Specifically, SSGR constructs pair-specific spatial layouts to encode detailed spatial relationships and introduces a global semantic decoder to learn category-aware semantic representations. A semantic-spatial guided reasoning module further adaptively fuses these complementary cues, enabling unified reasoning and more discriminative interaction understanding. Extensive experiments on HICO-DET and V-COCO demonstrate that SSGR consistently outperforms prior methods under both standard and zero-shot settings, validating the effectiveness of our semantic-spatial reasoning paradigm.
Fields of Study & Subjects
Multimodal Machine Learning Applications
Constraint Satisfaction and Optimization
Spatial Cognition and Navigation
Publication details
- Journal / source
- IEEE Signal Processing Letters
- Publisher
- Institute of Electrical and Electronics Engineers (IEEE)
- Volume
- 33
- Pages
- 551–555
- Publication date
- 1 January 2026