Scalable Gaussian Processes for Integrated and Overlapping Measurements via Augmented State-space Models

Read full text
Authors: Ryan A. Rubenzahl, Soichiro Hattori, Simo Särkkä, Will M. Farr, Jacob K. Luhn, Megan Bedell, Daniel Foreman-Mackey
Cited by: 1
References: 51

Abstract

Abstract Astronomical measurements are often integrated over finite exposures, which can obscure latent variability on comparable timescales. Correctly accounting for exposure integration with Gaussian processes (GPs) in such scenarios is essential but computationally challenging: once exposure times vary or overlap across measurements, the covariance matrix forfeits any quasi-separability, forcing O ( N 2 ) memory and O ( N 3 ) runtime costs. Linear Gaussian state-space models (SSMs) are equivalent to GPs and have well-known O ( N ) solutions via the Kalman filter and Rauch–Tung–Striebel smoother. In this work, we extend the GP–SSM equivalence to handle integrated measurements while maintaining scalability by augmenting the SSM with an integral state that resets at exposure start times and is observed at exposure end times. This construction yields exactly the same posterior as a fully integrated GP but in O ( N ) time on a CPU and is parallelizable down to O ( N / T + log T ) on a GPU with T parallel workers. We present State-space Models for O(Linear/log) GPs ( smolgp ), an open-source Python/JAX package offering drop-in compatibility with tinygp while supporting both standard and exposure-aware GP modeling. Since SSMs provide a framework for representing general GP kernels via their series expansion, smolgp also brings scalable performance to many commonly used covariance kernels in astronomy that lack quasi-separability, such as the quasiperiodic kernel. The substantial performance boosts at large N will enable massive multi-instrument cross-comparisons where exposure overlap is ubiquitous and unlocks the potential for analyses with more complex models and/or higher dimensional datasets.

Fields of Study & Subjects

Gaussian Processes and Bayesian Inference Gamma-ray bursts and supernovae Statistical Mechanics and Entropy

Publication details

Journal / source
The Astronomical Journal
Publisher
American Astronomical Society
Volume
171
Issue
4
Pages
259–259
Publication date
31 March 2026
Language
EN