Searcharxiv⌕ Search

arXiv subjects

Sylvain Sorin

Publications and source records attributed to Sylvain Sorin.

9 recordsLinked to original sources
arXiv2021

Learning in nonatomic games, Part I: Finite action spaces and population games

We examine the long-run behavior of a wide range of dynamics for learning in nonatomic games, in both discrete and continuous time. The class of dynamics under consideration includes fictitious play and its regularized variants, the best-reply dynamics (again, possibly regularized), as well as the dynamics of dual averaging / "follow the regularized leader" (which themselves include as special cases the replicator dynamics and Friedman's projection dynamics). Our analysis concerns both the actual trajectory of play and its time-average, and we cover potential and monotone games, as well as games with an evolutionarily stable state (global or otherwise). We focus exclusively on games with finite action spaces; nonatomic games with continuous action spaces are treated in detail in Part II of this paper.

cs.GT↗
arXiv2018

Zero-sum Stochastic Games: Limit Optimal Trajectories

We consider zero sum stochastic games. For every discount factor $λ$, a time normalization allows to represent the game as being played on the interval [0, 1]. We introduce the trajectories of cumulated expected payoff and of cumulated occupation measure up to time t $\in$ [0, 1], under $ε$-optimal strategies. A limit optimal trajectory is defined as an accumulation point as the discount factor tends to 0. We study existence, uniqueness and characterization of these limit optimal trajectories for absorbing games.

math.OC↗
arXiv2016

Uniform Value for Recursive Games with Compact Actions

Mertens, Neyman and Rosenberg [MOR, 2009] used the Mertens and Neyman theorem [IJGT, 1981] to prove the existence of uniform value for absorbing games with finite state space and compact action sets. We provide an analogous proof for another class of stochastic games, recursive games with finite state space and compact action sets. Moreover, both players have stationary epsilon-optimal strategies.

math.OC↗
arXiv2016

Limit value of dynamic zero-sum games with vanishing stage duration

We consider two person zero-sum games where the players control, at discrete times {tn} induced by a partition $Π$ of R + , a continuous time Markov state process. We prove that the limit of the values v$Π$ exist as the mesh of $Π$ goes to 0. The analysis covers the cases of : 1) stochastic games (where both players know the state) 2) symmetric no information. The proof is by reduction to a deterministic differential game.

math.OC↗
arXiv2016

Operator approach to values of stochastic games with varying stage duration

We study the links between the values of stochastic games with varying stage duration $h$, the corresponding Shapley operators $\bf{T}$ and ${\bf{T}}\_h$and the solution of $\dot f\_t = ({\bf{T}} - Id )f\_t$. Considering general non expansive maps we establish two kinds of results, under both the discounted or the finite length framework, that apply to the class of "exact" stochastic games. First, for a fixed length or discount factor, the value converges as the stage duration go to 0. Second, the asymptotic behavior of the value as the length goes to infinity, or as the discount factor goes to 0, does not depend on the stage duration. In addition, these properties imply the existence of the value of the finite length or discounted continuous time game (associated to a continuous time jointly controlled Markov process), as the limit of the value of any time discretization with vanishing mesh.

math.OC↗
arXiv2016

On values of repeated games with signals

We study the existence of different notions of value in two-person zero-sum repeated games where the state evolves and players receive signals. We provide some examples showing that the limsup value (and the uniform value) may not exist in general. Then we show the existence of the value for any Borel payoff function if the players observe a public signal including the actions played. We also prove two other positive results without assumptions on the signaling structure: the existence of the $\sup$ value in any game and the existence of the uniform value in recursive games with nonnegative payoffs.

math.OC↗
arXiv2015

Finite composite games: Equilibria and dynamics

We study games with finitely many participants, each having finitely many choices. We consider the following categories of participants: (I) populations: sets of nonatomic agents, (II) atomic splittable players, (III) atomic non splittable players. We recall and compare the basic properties, expressed through variational inequalities, concerning equilibria, potential games and dissipative games, as well as evolutionary dynamics. Then we consider composite games where the three categories of participants are present, a typical example being congestion games, and extend the previous properties of equilibria and dynamics. Finally we describe an instance of composite potential game.

math.OC↗
arXiv2009

Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time

This survey is devoted to the asymptotic behavior of solutions of evolution equations generated by maximal monotone operators in Hilbert spaces. The emphasis is in the comparison of the continuous time trajectories to sequences generated by implicit or explicit discrete time schemes. The analysis covers weak convergence for the average process, for the process itself and strong convergence and aims at highlighting the main ideas and unifying the proofs. We further make the connection with the analysis in terms of almost orbits that allows for a broader scope.

math.OC↗