DeGAS: Gradient-Based Optimization of Probabilistic Programs without Sampling

Read full text
Authors: Francesca Randone, Romina Doz, Mirco Tribastone, Luca Bortolussi
Cited by: 1
References: 20

Abstract

We present DeGAS, a differentiable Gaussian approximate semantics for loopless probabilistic programs that enables sample-free, gradient-based optimization in models with both continuous and discrete components. DeGAS evaluates programs under a Gaussian-mixture semantics and replaces measure-zero predicates and discrete branches with a vanishing smoothing, yielding closed-form expressions for posterior and path probabilities. We prove differentiability of these quantities with respect to program parameters, enabling end-to-end optimization via standard automatic differentiation, without Monte Carlo estimators. On thirteen benchmark programs, DeGAS achieves accuracy and runtime competitive with variational inference and MCMC. Importantly, it reliably tackles optimization problems where sampling-based baselines fail to converge due to conditioning involving continuous variables.

Fields of Study & Subjects

Advanced Multi-Objective Optimization Algorithms Risk and Portfolio Optimization Stochastic Gradient Optimization Techniques

Publication details

Journal / source
Lecture notes in computer science
Publisher
Springer Nature Switzerland
Pages
566–585
Publication date
1 January 2026
Language
EN