Gradient-free ensemble transform methods for generalized Bayesian inference in generative models

Read full text
Authors: Diksha Bhandari, Sebastian Reich
Cited by: 0

Abstract

Bayesian inference in complex generative models is often obstructed by the absence of tractable likelihoods and the infeasibility of computing gradients of high-dimensional simulators. Existing likelihood-free methods for generalized Bayesian inference typically rely on gradient-based optimization or reparameterization, which can be computationally expensive and often inapplicable to black-box simulators. To overcome these limitations, we introduce a gradient-free ensemble transform Langevin dynamics method for generalized Bayesian inference using the maximum mean discrepancy. By relying on ensemble-based covariance structures rather than simulator derivatives, the proposed method enables robust posterior approximation without requiring access to gradients of the forward model, making it applicable to a broader class of likelihood-free models. The method is affine invariant, computationally efficient, and robust to model misspecification. Through numerical experiments on well-specified chaotic dynamical systems, and misspecified generative models with contaminated data, we demonstrate that the proposed method achieves comparable or improved accuracy relative to existing gradient-based methods, while substantially reducing computational cost.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Markov Chains and Monte Carlo Methods Gaussian Processes and Bayesian Inference

Publication details

Journal / source
arXiv (Cornell University)
Publication date
2 January 2026
Document type
Preprint