Semantic-Spatial Guided Reasoning for Human-Object Interaction Detection

View at publisher
Authors: Ping Cao, C. Zhang, Xiaolong Zheng, Yao Zhao
Cited by: 1
References: 34

Abstract

Human-Object Interaction (HOI) detection requires not only recognizingwhatthe interaction is but also understandingwhereit occurs. Although recent methods have achieved remarkable progress, they often lack effective joint modeling of spatial and semantic information, which is essential for accurate reasoning in complex scenes. In this paper, we propose a Semantic-Spatial Guided Reasoning (SSGR) framework that performs interaction reasoning by jointly modeling global semantic cues and fine-grained spatial priors. Specifically, SSGR constructs pair-specific spatial layouts to encode detailed spatial relationships and introduces a global semantic decoder to learn category-aware semantic representations. A semantic-spatial guided reasoning module further adaptively fuses these complementary cues, enabling unified reasoning and more discriminative interaction understanding. Extensive experiments on HICO-DET and V-COCO demonstrate that SSGR consistently outperforms prior methods under both standard and zero-shot settings, validating the effectiveness of our semantic-spatial reasoning paradigm.

Fields of Study & Subjects

Multimodal Machine Learning Applications Constraint Satisfaction and Optimization Spatial Cognition and Navigation

Publication details

Journal / source
IEEE Signal Processing Letters
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
33
Pages
551–555
Publication date
1 January 2026