SearcharxivSearch

arXiv subjects

Gokce Dayanikli

Publications and source records attributed to Gokce Dayanikli.

16 recordsLinked to original sources

Regulation of Rumor Propagation via (Multi-Leader) Stackelberg Graphon Games

We study the control of rumor propagation in large networked populations by using Stackelberg graphon games. We first introduce a principal who wants to incentivize the spread of her preferred news and discourage the spread of non-preferred news. We define the Stackelberg graphon game equilibrium (SGGE), characterize the graphon game Nash equilibrium (GGNE) with a forward-backward differential equation system, and establish existence results. We further formulate a multi-leader model with two competing principals, each incentivizing her own preferred news. Finally, we propose a bi-level algorithm for computing (multi-leader) Stackelberg graphon game equilibria and conclude with numerical experiments where we show that existence of competing principals will result in strong opinion divisions in the population.

math.OC

Modeling Epidemic Spread with Strategic Vaccination and Socialization: a Mean Field Game Analysis

We study a game-theoretic model of epidemic control in a large population with finitely many groups and non-cooperative individuals. In the model, individuals jointly choose their socialization levels and vaccination rates, and vaccination is subject to a linear individual cost structure. We derive a forward-backward ordinary differential equations (FBODE) system that characterizes the mean field Nash equilibrium, show that the equilibrium vaccination rate exhibits an at-most one-jump bang-bang structure, and establish the existence of a Carathéodory solution to the FBODE. This establishes a realistic interpretation of the vaccination decisions, meaning individuals decide to vaccinate until a time point which is determined by model parameters and then stop after. We further consider a population-awareness extension in which individuals incorporate population infection information into their objective functions, and we prove a similar at-most one-jump bang-bang property under suitable conditions. Finally, we propose a numerical algorithm for solving the FBODE and conduct simulations to validate the theoretical findings. The experiments highlight two main insights: the trade-off between socialization and vaccination, and the greater importance of quarantining infected individuals instead of restricting susceptible individuals.

math.OC

Incorporating Authority Perception, Economic Status, and Behavioral Response in Infectious Disease Control

We introduce a multi-population mean field game framework to examine how economic status and authority perception shape vaccination and social distancing decisions under different epidemic control policies. We carried out a survey to inform our model and stratify the population into six groups based on income and perception of authority, capturing behavioral heterogeneity. Individuals adjust their socialization and vaccination levels to optimize objectives such as minimizing treatment costs, complying with social-distancing guidelines if they are authority-followers, or reducing losses from decreased social interactions if they are authority-indifferents, alongside economic costs. Public health authorities influence behavior through social-distancing guidelines and vaccination costs. We characterize the Nash equilibrium via a forward-backward differential equation system, provide its mathematical analysis, and develop a numerical algorithm to solve it. Our findings reveal a trade-off between social-distancing and vaccination decisions. Under stricter guidelines that target both susceptible and infected individuals, followers reduce both socialization and vaccination levels, while indifferents increase socialization due to followers' preventative measures. Adaptive guidelines targeting infected individuals effectively reduce infections and narrow the gap between low- and high-income groups, even when susceptible individuals socialize more and vaccinate less. Lower vaccination costs incentivize vaccination among low-income groups, but their impact on disease spread is smaller than when they are coupled with social-distancing guidelines. Trust-building emerges as a critical factor in epidemic mitigation, underscoring the importance of data-informed, game-theoretical models that aim to understand complex human responses to mitigation policies.

math.OC

A Game-Theoretic Framework for Network Formation in Large Populations

In this paper, we study a model of network formation in large populations. Each agent can choose the strength of interaction (i.e. connection) with other agents to find a Nash equilibrium. Different from the recently-developed theory of graphon games, here each agent's control depends not only on her own index but also on the index of other agents. After defining the general model of the game, we focus on a special case with piecewise constant graphs and we provide optimality conditions through a system of forward-backward stochastic differential equations. Furthermore, we show the uniqueness and existence results. Finally, we provide numerical experiments to discuss the effects of different model settings.

math.OC

Cooperation, Competition, and Common Pool Resources in Mean Field Games

Mean field games (MFGs) have been introduced to study Nash equilibria in very large population of self-interested agents. However, when applied to common pool resource (CPR) games, MFG equilibria lead to the so-called tragedy of the commons (TOTC). Empirical studies have shown that in many situations, TOTC does not materialize which hints at the fact that standard MFG models cannot explain the behavior of agents in CPR games. In this work, we study two models which incorporate a mix of cooperative and non-cooperative behaviors, either at the individual level or the population level. After defining these models, we study optimality conditions in the form of forward-backward stochastic differential equations and we prove that the mean field models provide approximate equilibria controls for corresponding finite-agent games. We then show an application to a model of fish stock management, for which the solution can be computed by solving systems of ordinary differential equations, which we prove to have a unique solution. Numerical results illustrate the impact of the level of cooperation at the individual and the population levels on the CPR.

math.OC

Modeling of Rumor Propagation in Large Populations with Network via Graphon Games

In this paper, we propose a graphon game model to understand how rumor (such as fake news) propagates in large populations that are interacting on a network and how different policies affect the spread. We extend the SKIR model that is used to model rumor propagation and implement individual controls and weighted interactions with other agents to have controlled dynamics. The agents aim to minimize their own expected costs non-cooperatively. We give the finite player game model and the limiting graphon game model to approximate the Nash equilibrium in the population. We give the graphon game Nash equilibrium as a solution to a continuum of ordinary differential equations (ODEs) and give existence results. Finally, we give a numerical approach and analyze examples where we use piecewise constant graphon.

math.OC

How can the tragedy of the commons be prevented?: Introducing Linear Quadratic Mixed Mean Field Games

In a regular mean field game (MFG), the agents are assumed to be insignificant, they do not realize their effect on the population level and this may result in a phenomenon coined as the Tragedy of the Commons by the economists. However, in real life this phenomenon is often avoided thanks to the underlying altruistic behavior of (all or some of the) agents. Motivated by this observation, we introduce and analyze two different mean field models to include altruism in the decision making of agents. In the first model, mixed individual MFGs, there are infinitely many agents who are partially altruistic (i.e., they behave partially cooperatively) and partially non-cooperative. In the second model, mixed population MFGs, one part of the population behaves cooperatively and the remaining agents behave non-cooperatively. Both models are introduced in a general linear quadratic framework for which we characterize the equilibrium via forward backward stochastic differential equations. Furthermore, we give explicit solutions in terms of ordinary differential equations, and prove the existence and uniqueness results.

math.OC

Machine Learning Methods for Large Population Games with Applications in Operations Research

In this tutorial, we provide an introduction to machine learning methods for finding Nash equilibria in games with large number of agents. These types of problems are important for the operations research community because of their applicability to real life situations such as control of epidemics, optimal decisions in financial markets, electricity grid management, or traffic control for self-driving cars. We start the tutorial by introducing stochastic optimal control problems for a single agent, in discrete time and in continuous time. Then, we present the framework of dynamic games with finite number of agents. To tackle games with a very large number of agents, we discuss the paradigm of mean field games, which provides an efficient way to compute approximate Nash equilibria. Based on this approach, we discuss machine learning algorithms for such problems. First in the context of discrete time games, we introduce fixed point based methods and related methods based on reinforcement learning. Second, we discuss machine learning methods that are specific to continuous time problems, by building on optimality conditions phrased in terms of stochastic or partial differential equations. Several examples and numerical illustrations of problems arising in operations research are provided along the way.

math.OC

A Machine Learning Method for Stackelberg Mean Field Games

We propose a single-level numerical approach to solve Stackelberg mean field game (MFG) problems. In Stackelberg MFG, an infinite population of agents play a non-cooperative game and choose their controls to optimize their individual objectives while interacting with the principal and other agents through the population distribution. The principal can influence the mean field Nash equilibrium at the population level through policies, and she optimizes her own objective, which depends on the population distribution. This leads to a bi-level problem between the principal and mean field of agents that cannot be solved using traditional methods for MFGs. We propose a reformulation of this problem as a single-level mean field optimal control problem through a penalization approach. We prove convergence of the reformulated problem to the original problem. We propose a machine learning method based on (feed-forward and recurrent) neural networks and illustrate it on several examples from the literature.

math.OC

From Nash Equilibrium to Social Optimum and vice versa: a Mean Field Perspective

Mean field games (MFG) and mean field control (MFC) problems have been introduced to study large populations of strategic players. They correspond respectively to non-cooperative or cooperative scenarios, where the aim is to find the Nash equilibrium and social optimum. These frameworks provide approximate solutions to situations with a finite number of players and have found a wide range of applications, from economics to biology and machine learning. In this paper, we study how the players can pass from a non-cooperative to a cooperative regime, and vice versa. The first direction is reminiscent of mechanism design, in which the game's definition is modified so that non-cooperative players reach an outcome similar to a cooperative scenario. The second direction studies how players that are initially cooperative gradually deviate from a social optimum to reach a Nash equilibrium when they decide to optimize their individual cost similar to the free rider phenomenon. To formalize these connections, we introduce two new classes of games which lie between MFG and MFC: $λ$-interpolated mean field games, in which the cost of an individual player is a $λ$-interpolation of the MFG and the MFC costs, and $p$-partial mean field games, in which a proportion $p$ of the population deviates from the social optimum by playing the game non-cooperatively. We conclude the paper by providing an algorithm for myopic players to learn a $p$-partial mean field equilibrium, and we illustrate it on a stylized model.

cs.GT

Deep Learning for Population-Dependent Controls in Mean Field Control Problems with Common Noise

In this paper, we propose several approaches to learn the optimal population-dependent controls in order to solve mean field control problems (MFC). Such policies enable us to solve MFC problems with forms of common noises at a level of generality that was not covered by existing methods. We analyze rigorously the theoretical convergence of the proposed approximation algorithms. Of particular interest for its simplicity of implementation is the $N$-particle approximation. The effectiveness and the flexibility of our algorithms is supported by numerical experiments comparing several combinations of distribution approximation techniques and neural network architectures. We use three different benchmark problems from the literature: a systemic risk model, a price impact model, and a crowd motion model. We first show that our proposed algorithms converge to the correct solution in an explicitly solvable MFC problem. Then, we show that population-dependent controls outperform state-dependent controls. Along the way, we show that specific neural network architectures can improve the learning further.

math.OC

Multi-population Mean Field Games with Multiple Major Players: Application to Carbon Emission Regulations

In this paper, we propose and study a mean field game model with multiple populations of minor players and multiple major players, motivated by applications to the regulation of carbon emissions. Each population of minor players represent a large group of electricity producers and each major player represents a regulator. We first characterize the minor players equilibrium controls using forward-backward differential equations, and show existence and uniqueness of the minor players equilibrium. We then express the major players' equilibrium controls through analytical formulas given the other players' controls. Finally, we then provide a method to solve the Nash equilibrium between all the players, and we illustrate numerically the sensitivity of the model to its parameters.

math.OC

Mean Field Model for an Advertising Competition in a Duopoly

In this study, we analyze an advertising competition in a duopoly. We consider two different notions of equilibrium. We model the companies in the duopoly as major players, and the consumers as minor players. In our first game model we identify Nash Equilibria (NE) between all the players. Next we frame the model to lead to the search for Multi-Leader-Follower Nash Equilibria (MLF-NE). This approach is reminiscent of Stackelberg games in the sense that the major players design their advertisement policies assuming that the minor players are rational and settle in a Nash Equilibrium among themselves. This rationality assumption reduces the competition between the major players to a 2-player game. After solving these two models for the notions of equilibrium, we analyze the similarities and differences of the two different sets of equilibria.

math.OC

Mean Field Models to Regulate Carbon Emissions in Electricity Production

The most serious threat to ecosystems is the global climate change fueled by the uncontrolled increase in carbon emissions. In this project, we use mean field control and mean field game models to analyze and inform the decisions of electricity producers on how much renewable sources of production ought to be used in the presence of a carbon tax. The trade-off between higher revenues from production and the negative externality of carbon emissions is quantified for each producer who needs to balance in real time reliance on reliable but polluting (fossil fuel) thermal power stations versus investing in and depending upon clean production from uncertain wind and solar technologies. We compare the impacts of these decisions in two different scenarios: 1) the producers are competitive and hopefully reach a Nash Equilibrium; 2) they cooperate and reach a Social Optimum. We first prove that both problems have a unique solution using forward-backward systems of stochastic differential equations. We then illustrate with numerical experiments the producers' behavior in each scenario. We further introduce and analyze the impact of a regulator in control of the carbon tax policy, and we study the resulting Stackelberg equilibrium with the field of producers.

math.OC

Finite State Graphon Games with Applications to Epidemics

We consider a game for a continuum of non-identical players evolving on a finite state space. Their heterogeneous interactions are represented by a graphon, which can be viewed as the limit of a dense random graph. The player's transition rates between the states depend on their own control and the interaction strengths with the other players. We develop a rigorous mathematical framework for this game and analyze Nash equilibria. We provide a sufficient condition for a Nash equilibrium and prove existence of solutions to a continuum of fully coupled forward-backward ordinary differential equations characterizing equilibria. Moreover, we propose a numerical approach based on machine learning tools and show experimental results on different applications to compartmental models in epidemiology.

math.OC

Optimal incentives to mitigate epidemics: a Stackelberg mean field game approach

Motivated by models of epidemic control in large populations, we consider a Stackelberg mean field game model between a principal and a mean field of agents evolving on a finite state space. The agents play a non-cooperative game in which they can control their transition rates between states to minimize an individual cost. The principal can influence the resulting Nash equilibrium through incentives so as to optimize its own objective. We analyze this game using a probabilistic approach. We then propose an application to an epidemic model of SIR type in which the agents control their interaction rate and the principal is a regulator acting with non pharmaceutical interventions. To compute the solutions, we propose an innovative numerical approach based on Monte Carlo simulations and machine learning tools for stochastic optimization. We conclude with numerical experiments by illustrating the impact of the agents' and the regulator's optimal decisions in two models: a basic SIR model with semi-explicit solutions and a more complex model with a larger state space.

math.OC