GeCHO: Generation of Contextualized Human–Object Interactions

Read full text Summarise with VIRAT
Authors: Giovanni Minelli, Andrea Benericetti, Leonardo Taccari, Francesco Sambo, Samuele Salti
Cited by: 0
References: 71

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Creating realistic human-world interactions with diffusion models remains a key challenge, often requiring tedious trial-and-error processes and iterative manual refinements to achieve the desired result. Current approaches either fail to seamlessly integrate new content while maintaining global consistency of the scene, or require time-consuming editing and prompt engineering, making the process impractical for large-scale applications. To address this challenge, we propose an inpainting approach that specifically tackles the complexities of generating contextual human-object interactions, which we refer to as GeCHO. Our method improves local object fidelity and global scene consistency by leveraging cross-attention maps for automated, annotation-free object placement and using ControlNet to ensure precise spatial localization.We demonstrate the practical impact of our approach through two key applications: natural image inpainting, where we achieve contextual object placement with flexible spatial control, and human-object interaction detection, where we address the problem of long-tail distributions through synthetic data generation. Our results show that the proposed method enhances realism and adherence of generated images to text prompts, simplifies the generation of complex scenes without extensive input engineering, and improves performance in computer vision tasks limited by data scarcity. The source code implementation is available here: https://github.com/johnMinelli/gecho.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Advanced Neural Network Applications Multimodal Machine Learning Applications

Publication details

Journal / source
IEEE Access
Volume
14
Pages
48872–48886
Publication date
1 January 2026
Language
EN