Distributed Online Stochastic Convex-Concave Optimization: Dynamic Regret Analyses Under Single and Multiple Consensus Steps

View at publisher
Authors: Wentao Zhang, Baoyong Zhang, Deming Yuan, Shengyuan Xu, Vincent K. N. Lau
Cited by: 1
References: 55

Abstract

This paper considers the distributed online convex-concave optimization with constraint sets over a multiagent network, in which each agent autonomously generates a series of decision pairs through a designable mechanism to cooperatively minimize the global loss function. To this end, under no-Euclidean distance metrics, we propose a distributed online stochastic mirror descent convex-concave optimization algorithm with timevarying predictive mappings. Taking dynamic saddle point regret as a performance metric, it is proved that the proposed algorithm achieves the regret upper-bound in$O({\rm max}\{T^{θ1} , T^{θ2}(1 + V_T )\})$for the general convex-concave loss function, where θ1, θ2∈ (0, 1) are the tuning parameters,Tis the total iteration time, andVTis the path-variation. Surely, this algorithm guarantees the sublinear convergence, provided thatVTis sublinear. Moreover, aiming to achieve better convergence, we further investigate a variant of this algorithm by employing the multiple consensus technique. The obtained results show that the appropriate setting can effectively tighten the regret bound to a certain extent. Finally, the efficacy of the proposed algorithms is validated and compared through the simulation example of a target tracking problem.

Fields of Study & Subjects

Optimization and Search Problems Advanced Bandit Algorithms Research Stochastic Gradient Optimization Techniques

Publication details

Journal / source
IEEE Transactions on Signal Processing
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
74
Pages
2258–2272
Publication date
1 January 2026
Language
EN