Dimension-Free Multimodal Sampling via Preconditioned Annealed Langevin Dynamics

Read full text
Authors: Lorenzo Baldassari, Josselin C. Garnier, Knut Solna, Maarten V. de Hoop
Cited by: 0

Abstract

Designing sampling algorithms for multimodal targets that remain stable under refinement of the finite-dimensional approximation of an underlying function-space problem is a central challenge. Annealed Langevin dynamics (ALD) is a natural alternative to classical Langevin in this context, since it is often observed to improve exploration across modes. Yet a gap remains between its empirical success and existing theory: under which conditions can ALD be guaranteed to remain stable across dimensions? In this paper, we bridge this gap by providing a uniform-in-dimension analysis of continuous-time ALD for Gaussian-mixture targets. Along an explicit annealing path obtained by gradually removing Gaussian smoothing from the target, we identify spectral conditions linking the smoothing covariance to the component covariances under which ALD achieves a prescribed accuracy in Kullback-Leibler divergence within a dimension-uniform time horizon. We then establish stability in a perturbative regime with imperfect initialization and approximate scores. Under a misspecified-mixture score model, we show that preconditioning ALD with an operator whose spectrum decays sufficiently fast prevents error terms from accumulating across coordinates and thereby preserves dimension-uniform control.

Fields of Study & Subjects

Markov Chains and Monte Carlo Methods Gaussian Processes and Bayesian Inference Stochastic Gradient Optimization Techniques

Publication details

Journal / source
arXiv (Cornell University)
Publication date
1 February 2026
Document type
Preprint