Online Learning of Kalman Filtering: From Output to State Estimation

Read full text Summarise with VIRAT
Authors: Lintao Ye, Ankang Zhang, Ming Chi, Bin Du, Jianghai Hu
Cited by: 0
References: 62

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

In this paper, we study the problem of learning Kalman filtering with unknown system model in partially observed linear dynamical systems. We propose a unified algorithmic framework based on online optimization that can be used to solve both the output estimation and state estimation scenarios. By exploring the properties of the estimation error cost functions, such as conditionally strong convexity, we show that our algorithm achieves a $\log T$-regret in the horizon length $T$ for the output estimation scenario. More importantly, we tackle the more challenging scenario of learning Kalman filtering for state estimation, which is an open problem in the literature. We first characterize a fundamental limitation of the problem, demonstrating the impossibility of any algorithm to achieve sublinear regret in $T$. By further introducing a random query scheme into our algorithm, we show that a $\sqrt{T}$-regret is achievable when rendering the algorithm limited query access to more informative measurements of the system state in practice. Our algorithm and regret readily capture the trade-off between the number of queries and the achieved regret, and shed light on online learning problems with limited observations. We validate the performance of our algorithms using numerical examples.

Fields of Study & Subjects

Advanced Bandit Algorithms Research Control Systems and Identification Target Tracking and Data Fusion in Sensor Networks

Publication details

Journal / source
arXiv (Cornell University)
Publication date
28 March 2026
Language
EN
Document type
Preprint