A Constructive Method to Maximize Entropy under Marginal Constraints

Read full text
Authors: Pierre Jean-Claude Robert Bertrand
Cited by: 0

Abstract

We study the problem of maximizing R{é}nyi entropy of order $2$ (equivalently, minimizing the index of coincidence) over the set of joint distributions with prescribed marginals. A closed-form optimizer is known under a feasibility condition on the marginals; we show that this condition is highly restrictive. We then provide an explicit construction of an optimal coupling for arbitrary marginals. Our approach characterizes the optimizer's structure and yields an iterative algorithm that terminates in finite time, returning an exact solution after at most $p-1$ updates, where $p$ is the number of rows.

Fields of Study & Subjects

Statistical Mechanics and Entropy Probability and Statistical Research Risk and Portfolio Optimization

Publication details

Journal / source
arXiv (Cornell University)
Publication date
14 January 2026
Language
EN
Document type
Preprint