RMMNet: Deep Memory Aided Extended Object Tracking via High-Order Markovian Modeling and State Decoupling

View at publisher
Authors: ZhiXing Wang, Le Zheng, Shasha Yan, Ruud J. G. van Sloun, Nir Shlezinger, Yonina C. Eldar
Cited by: 1
References: 32

Abstract

Grounded in Bayesian filtering (BF), random matrix-based extended object tracking (EOT) offers an efficient framework for the joint estimation of a target’s kinematic state and extension. However, the performance of these methods is fundamentally constrained by the first-order Markov assumption, which often fails to capture the high-order Markovian dynamics prevalent in real-world scenarios. To overcome this limitation, we introduce RMMNet, a novel EOT method that integrates a deep memoryaided recursive neural network filter within a BF framework, enabling robust tracking of targets that exhibit high-order Markovian dynamics. Initially, we propose an approximate model under a high-order Markovian assumption and derive the implementation of its BF framework. Thereafter, Gaussian approximation and moment matching are employed to derive the analytical formulations for the proposed BF framework. Finally, based on the closed-form formulations, we design the architecture of RMMNet as an end-to-end trainable recursive neural networkbased filter. Experimental results on both simulated and real-world data demonstrate that our method outperforms traditional EOT approaches and other state-of-the-art deep learning methods.

Fields of Study & Subjects

Video Surveillance and Tracking Methods Target Tracking and Data Fusion in Sensor Networks Advanced Neural Network Applications

Publication details

Journal / source
IEEE Transactions on Signal Processing
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
74
Pages
1538–1552
Publication date
1 January 2026