Training-Free Spatio-temporal Decoupled Reasoning Video Segmentation with Adaptive Object Memory

Read full text
Authors: Association for Artificial Intelligence 2026, Jiaqing Fan, Fanzhang Li, Zhixuan Liu, Zhengtong Zhu
Cited by: 0

Abstract

Reasoning Video Object Segmentation (ReasonVOS) is a challenging task that requires stable object segmentation across video sequences using implicit and complex textual inputs. Previous methods fine-tune Multimodal Large Language Models (MLLMs) to produce segmentation outputs, which demand substantial resources. Additionally, some existing methods are coupled in the processing of spatio-temporal information, which affects the temporal stability of the model to some extent. To address these issues, we propose Training-Free Spatio-temporal Decoupled Reasoning Video Segmentation with Adaptive Object Memory (SDAM). We aim to design a training-free reasoning video segmentation framework that outperforms existing methods requiring fine-tuning, using only pre-trained models. Meanwhile, we propose an Adaptive Object Memory module that selects and memorizes key objects based on motion cues in different video sequences. Finally, we propose Spatio-temporal Decoupling for stable temporal propagation. In the spatial domain, we achieve precise localization and segmentation of target objects, while in the temporal domain, we leverage key object temporal information to drive stable cross-frame propagation. Our method achieves excellent results on five benchmark datasets, including Ref-YouTubeVOS, Ref-DAVIS17, MeViS, ReasonVOS, and ReVOS. We will release the code.

Fields of Study & Subjects

Multimodal Machine Learning Applications Advanced Neural Network Applications Visual Attention and Saliency Detection

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN