Giorgos Roussakis | Searcharxiv

arXiv2026

Improved Last-iterate Convergence Properties for the FLBR-MWU Dynamics

We revisit a variant of Multiplicative Weights Update (MWU), defined recently by Fasoulakis et al. [AISTATS; 2022], and denoted as Forward Looking Best Response MWU (FLBR-MWU). These dynamics are based on the approach of extra-gradient methods, with the tweak of using different learning rates in the intermediate step and the actual update step. So far, it has been proved that this algorithm attains asymptotic last-iterate convergence but no explicit rate has been known. We answer the open question from Fasoulakis et al. by establishing a concrete convergence rate for the duality gap. In particular, we show a geometric convergence rate, of the form $O(c^t)$, where $c<1$ is independent of time but dependent on game parameters, such as the maximum eigenvalue of the Jacobian matrix. We also complement our theoretical analysis with an experimental comparison to OGDA (Optimistic Gradient Descent-Ascent), which ranks among the best last-iterate methods for solving zero-sum games. We demonstrate that the performance of the FLBR-MWU method matches or, in some cases, outperforms OGDA.

cs.GT↗

arXiv2025

A Descent-based method on the Duality Gap for solving zero-sum games

We focus on the design of algorithms for finding equilibria in 2-player zero-sum games. Although it is well known that such problems can be solved by a single linear program, there has been a surge of interest in recent years for simpler algorithms, motivated in part by applications in machine learning. Our work proposes such a method, inspired by the observation that the duality gap (a standard metric for evaluating convergence in min-max optimization problems) is a convex function for bilinear zero-sum games. To this end, we analyze a descent-based approach, variants of which have also been used as a subroutine in a series of algorithms for approximating Nash equilibria in general non-zero-sum games. In particular, we study a steepest descent approach, by finding the direction that minimises the directional derivative of the duality gap function. Our main theoretical result is that the derived algorithms achieve a geometric decrease in the duality gap and improved complexity bounds until we reach an approximate equilibrium. Finally, we complement this with an experimental evaluation, which provides promising findings. Our algorithm is comparable with (and in some cases outperforms) some of the standard approaches for solving 0-sum games, such as OGDA (Optimistic Gradient Descent/Ascent), even with thousands of available strategies per player.

cs.GT↗