Jensen-$$\phi $$-entropy, g-mean mixture distributions and optimal information: application to binary models

Read full text
Authors: Omid Kharazmi, E. Castilla
Cited by: 1
References: 25

Abstract

Abstract This paper has two main objectives. First, we introduce a Jensen-type extension of the $$\phi $$ ϕ -entropy, which naturally generalizes the classical Jensen–Shannon divergence and explores its connections with Bregman divergence. Several theoretical results are established that highlight the interplay between these entropy and divergence measures, particularly in the context of mixture distributions. Second, we propose the g-mean mixture distribution, a general class of statistical models that encompasses many classical mixtures, such as arithmetic, geometric, and $$(\alpha ,\lambda )$$ ( α , λ ) -mixtures, as special cases. We show that this class arises as the optimal solution to a family of optimization problems formulated in terms of Bregman divergence. Finally, we apply the Jensen- $$\phi $$ ϕ -entropy to two binary models as an alternative to classical estimation methods, demonstrating promising empirical performance and potential for further theoretical investigation.

Fields of Study & Subjects

Statistical Mechanics and Entropy Multi-Criteria Decision Making Mathematical Inequalities and Applications

Publication details

Journal / source
Computational and Applied Mathematics
Publisher
Springer Science and Business Media LLC
Volume
45
Issue
8
Publication date
31 March 2026
Language
EN