SearcharxivSearch

arXiv subjects

Francois Delarue

Publications and source records attributed to Francois Delarue.

At least 19 recordsLinked to original sources

Rearranged Stochastic Heat Equations with an Entropy Gradient Structure

We extend a previously introduced one-dimensional diffusion model on the space of probability measures, defined via the rearranged stochastic heat equation by, penalizing the dynamics with an additional entropy-driven gradient-descent term. By means of a splitting argument, we prove that despite the opposite effects of rearrangement and entropy minimization, the resulting penalized stochastic heat equation is well defined. We study several properties of the associated dynamics and show, in particular, that solutions admit a density satisfying a corrected version of the Dean--Kawasaki equation. The smoothing properties established for the stochastic heat equation are shown to persist.

math.PR

Major-minor mean field games: common noise helps

The objective of this work is to study the existence, uniqueness, and stability of equilibria in mean field games involving a major player and a continuum of minor players over finite intervals of arbitrary length. Following earlier articles addressing similar questions in the context of classical mean field games, the cost functions for the minor players are assumed to satisfy the Lasry-Lions monotonicity condition. In this contribution, we demonstrate that if, in addition to the monotonicity condition, the intensity of the (Brownian) noise driving the major player is sufficiently high, then -- under further mild regularity assumptions on the coefficients -- existence, uniqueness, and stability of equilibria are guaranteed. A key challenge is to show that the threshold (beyond which the noise intensity must be taken) can be chosen independently of the length of the time interval over which the game is defined. Building on the stability properties thus established, we further show that the associated system of master equations admits a unique classical solution. To the best of our knowledge, this is the first result of its kind for major-minor mean field games defined over intervals of arbitrary length.

math.OC

From Nash Equilibrium to Social Optimum and vice versa: a Mean Field Perspective

Mean field games (MFG) and mean field control (MFC) problems have been introduced to study large populations of strategic players. They correspond respectively to non-cooperative or cooperative scenarios, where the aim is to find the Nash equilibrium and social optimum. These frameworks provide approximate solutions to situations with a finite number of players and have found a wide range of applications, from economics to biology and machine learning. In this paper, we study how the players can pass from a non-cooperative to a cooperative regime, and vice versa. The first direction is reminiscent of mechanism design, in which the game's definition is modified so that non-cooperative players reach an outcome similar to a cooperative scenario. The second direction studies how players that are initially cooperative gradually deviate from a social optimum to reach a Nash equilibrium when they decide to optimize their individual cost similar to the free rider phenomenon. To formalize these connections, we introduce two new classes of games which lie between MFG and MFC: $\lambda$-interpolated mean field games, in which the cost of an individual player is a $\lambda$-interpolation of the MFG and the MFC costs, and $p$-partial mean field games, in which a proportion $p$ of the population deviates from the social optimum by playing the game non-cooperatively. We conclude the paper by providing an algorithm for myopic players to learn a $p$-partial mean field equilibrium, and we illustrate it on a stylized model.

cs.GT

An example driven introduction to probabilistic rough paths

In these notes, we provide an introduction to a new regularity structure used for solving rough mean-field equations. The index set of this regularity structure is described a collection of novel objects which we refer to as Lions trees. These objects arise in Taylor expansions involving the Lions derivative and capture many of the desirable properties of mean-field dynamics. This work represents a comprehensive generalisation of the ideas first introduced in [BCD20] that promise powerful insights into how interactions with a collective determine the dynamics of an individual within this collective.

math.PR

Finite state Mean Field Games with Wright-Fisher common noise

We force uniqueness in finite state mean field games by adding a Wright-Fisher common noise. We achieve this by analyzing the master equation of this game, which is a degenerate parabolic second-order partial differential equation set on the simplex whose characteristics solve the stochastic forward-backward system associated with the mean field game; see Cardaliaguet et al. (2019). We show that this equation, which is a non-linear version of the Kimura type equation studied in Epstein and Mazzeo (2013), has a unique smooth solution whenever the normal component of the drift at the boundary is strong enough. Among others, this requires a priori estimates of Hölder type for the corresponding Kimura operator when the drift therein is merely continuous.

math.PR

Global solutions to the supercooled Stefan problem with blow-ups: regularity and uniqueness

We consider the supercooled Stefan problem, which captures the freezing of a supercooled liquid, in one space dimension. A probabilistic reformulation of the problem allows to define global solutions, even in the presence of blow-ups of the freezing rate. We provide a complete description of such solutions, by relating the temperature distribution in the liquid to the regularity of the ice growth process. The latter is shown to transition between (i) continuous differentiability, (ii) Holder continuity, and (iii) discontinuity. In particular, in the second regime we rediscover the square root behavior of the growth process pointed out by Stefan in his seminal paper [Ste89] from 1889 for the ordinary Stefan problem. In our second main theorem, we establish the uniqueness of the global solutions, a first result of this kind in the context of growth processes with singular self-excitation when blow-ups are present.

math.PR

From the master equation to mean field game limit theory: A central limit theorem

Mean field games (MFGs) describe the limit, as $n$ tends to infinity, of stochastic differential games with $n$ players interacting with one another through their common empirical distribution. Under suitable smoothness assumptions that guarantee uniqueness of the MFG equilibrium, a form of law of large of numbers (LLN), also known as propagation of chaos, has been established to show that the MFG equilibrium arises as the limit of the sequence of empirical measures of the $n$-player game Nash equilibria, including the case when player dynamics are driven by both idiosyncratic and common sources of noise. The proof of convergence relies on the so-called master equation for the value function of the MFG, a partial differential equation on the space of probability measures. In this work, under additional assumptions, we establish a functional central limit theorem (CLT) that characterizes the limiting fluctuations around the LLN limit as the unique solution of a linear stochastic PDE. The key idea is to use the solution to the master equation to construct an associated McKean-Vlasov interacting $n$-particle system that is sufficiently close to the Nash equilibrium dynamics of the $n$-player game for large $n$. We then derive the CLT for the latter from the CLT for the former. Along the way, we obtain a new multidimensional CLT for McKean-Vlasov systems. We also illustrate the broader applicability of our methodology by applying it to establish a CLT for a specific linear-quadratic example that does not satisfy our main assumptions, and we explicitly solve the resulting stochastic PDE in this case.

math.PR

From the master equation to mean field game limit theory: Large deviations and concentration of measure

We study a sequence of symmetric $n$-player stochastic differential games driven by both idiosyncratic and common sources of noise, in which players interact with each other through their empirical distribution. The unique Nash equilibrium empirical measure of the $n$-player game is known to converge, as $n$ goes to infinity, to the unique equilibrium of an associated mean field game. Under suitable regularity conditions, in the absence of common noise, we complement this law of large numbers result with non-asymptotic concentration bounds for the Wasserstein distance between the $n$-player Nash equilibrium empirical measure and the mean field equilibrium. We also show that the sequence of Nash equilibrium empirical measures satisfies a weak large deviation principle, which can be strengthened to a full large deviation principle only in the absence of common noise. For both sets of results, we first use the master equation, an infinite-dimensional partial differential equation that characterizes the value function of the mean field game, to construct an associated McKean-Vlasov interacting $n$-particle system that is exponentially close to the Nash equilibrium dynamics of the $n$-player game for large $n$, by refining estimates obtained in our companion paper. Then we establish a weak large deviation principle for McKean-Vlasov systems in the presence of common noise. In the absence of common noise, we upgrade this to a full large deviation principle and obtain new concentration estimates for McKean-Vlasov systems. Finally, in two specific examples that do not satisfy the assumptions of our main theorems, we show how to adapt our methodology to establish large deviations and concentration results.

math.PR

Restoring Uniqueness to Mean-Field Games by Randomizing the Equilibria

We here address the question of restoration of uniqueness in mean-field games deriving from deterministic differential games with a large number of players. The general strategy for restoring uniqueness is inspired from earlier similar results on ordinary and stochastic differential equations. It consists in randomizing the equilibria through an external noise. As a main feature, we choose the external noise as an infinite dimensional Ornstein-Uhlenbeck process. We first investigate existence and uniqueness of a solution to the noisy system made of the mean-field game forced by the Ornstein-Uhlenbeck process. We also show how such a noisy system can be interpreted as the limit version of a stochastic differential game with a large number of players.

math.PR

Mean field games of timing and models for bank runs

The goal of the paper is to introduce a set of problems which we call mean field games of timing. We motivate the formulation by a dynamic model of bank run in a continuous-time setting. We briefly review the economic and game theoretic contributions at the root of our effort, and we develop a mathematical theory for continuous-time stochastic games where the strategic decisions of the players are merely choices of times at which they leave the game, and the interaction between the strategic players is of a mean field nature.

math.PR

Mean field games with common noise

A theory of existence and uniqueness is developed for general stochastic differential mean field games with common noise. The concepts of strong and weak solutions are introduced in analogy with the theory of stochastic differential equations, and existence of weak solutions for mean field games is shown to hold under very general assumptions. Examples and counter-examples are provided to enlighten the underpinnings of the existence theory. Finally, an analog of the famous result of Yamada and Watanabe is derived, and it is used to prove existence and uniqueness of a strong solution under additional assumptions.

math.PR

The Master Equation for Large Population Equilibriums

We use a simple N-player stochastic game with idiosyncratic and common noises to introduce the concept of Master Equation originally proposed by Lions in his lectures at the Collège de France. Controlling the limit N tends to the infinity of the explicit solution of the N-player game, we highlight the stochastic nature of the limit distributions of the states of the players due to the fact that the random environment does not average out in the limit, and we recast the Mean Field Game (MFG) paradigm in a set of coupled Stochastic Partial Differential Equations (SPDEs). The first one is a forward stochastic Kolmogorov equation giving the evolution of the conditional distributions of the states of the players given the common noise. The second is a form of stochastic Hamilton Jacobi Bellman (HJB) equation providing the solution of the optimization problem when the flow of conditional distributions is given. Being highly coupled, the system reads as an infinite dimensional Forward Backward Stochastic Differential Equation (FBSDE). Uniqueness of a solution and its Markov property lead to the representation of the solution of the backward equation (i.e. the value function of the stochastic HJB equation) as a deterministic function of the solution of the forward Kolmogorov equation, function which is usually called the decoupling field of the FBSDE. The (infinite dimensional) PDE satisfied by this decoupling field is identified with the \textit{master equation}. We also show that this equation can be derived for other large populations equilibriums like those given by the optimal control of McKean-Vlasov stochastic differential equations. The paper is written more in the style of a review than a technical paper, and we spend more time and energy motivating and explaining the probabilistic interpretation of the Master Equation, than identifying the most general set of assumptions under which our claims are true.

math.PR

Forward-Backward Stochastic Differential Equations and Controlled McKean Vlasov Dynamics

The purpose of this paper is to provide a detailed probabilistic analysis of the optimal control of nonlinear stochastic dynamical systems of the McKean Vlasov type. Motivated by the recent interest in mean field games, we highlight the connection and the differences between the two sets of problems. We prove a new version of the stochastic maximum principle and give sufficient conditions for existence of an optimal control. We also provide examples for which our sufficient conditions for existence of an optimal solution are satisfied. Finally we show that our solution to the control problem provides approximate equilibria for large stochastic games with mean field interactions.

math.PR

Mean Field Forward-Backward Stochastic Differential Equations

The purpose of this note is to provide an existence result for the solution of fully coupled Forward Backward Stochastic Differential Equations (FBSDEs) of the mean field type. These equations occur in the study of mean field games and the optimal control of dynamics of the McKean Vlasov type.

math.PR

Control of McKean-Vlasov Dynamics versus Mean Field Games

We discuss and compare two methods of investigations for the asymptotic regime of stochastic differential games with a finite number of players as the number of players tends to the infinity. These two methods differ in the order in which optimization and passage to the limit are performed. When optimizing first, the asymptotic problem is usually referred to as a mean-field game. Otherwise, it reads as an optimization problem over controlled dynamics of McKean-Vlasov type. Both problems lead to the analysis of forward-backward stochastic differential equations, the coefficients of which depend on the marginal distributions of the solutions. We explain the difference between the nature and solutions to the two approaches by investigating the corresponding forward-backward systems. General results are stated and specific examples are treated, especially when cost functionals are of linear-quadratic type.

math.PR

Singular Forward-Backward Stochastic Differential Equations and Emissions Derivatives

We introduce two simple models of forward-backward stochastic differential equations with a singular terminal condition and we explain how and why they appear naturally as models for the valuation of CO2 emission allowances. Single phase cap-and-trade schemes lead readily to terminal conditions given by indicator functions of the forward component, and using fine partial differential equations estimates, we show that the existence theory of these equations, as well as the properties of the candidates for solution, depend strongly upon the characteristics of the forward dynamics. Finally, we give a first order Taylor expansion and show how to numerically calibrate some of these models for the purpose of CO2 option pricing.

q-fin.PR

Singular FBSDEs and Scalar Conservation Laws Driven by Diffusion Processes

Motivated by earlier work on the use of fully-coupled Forward-Backward Stochastic Differential Equations (henceforth FBSDEs) in the analysis of mathematical models for the CO2 emissions markets, the present study is concerned with the analysis of these equations when the generator of the forward equation has a conservative degenerate structure and the terminal condition of the backward equation is a non-smooth function of the terminal value of the forward component. We show that a general form of existence and uniqueness result still holds. When the function giving the terminal condition is binary, we also show that the flow property of the forward component of the solution can fail at the terminal time. In particular, we prove that a Dirac point mass appears in its distribution, exactly at the location of the jump of the binary function giving the terminal condition. We provide a detailed analysis of the breakdown of the Markovian representation of the solution at the terminal time.

math.PR

Probabilistic Analysis of Mean-Field Games

The purpose of this paper is to provide a complete probabilistic analysis of a large class of stochastic differential games for which the interaction between the players is of mean-field type. We implement the Mean-Field Games strategy developed analytically by Lasry and Lions in a purely probabilistic framework, relying on tailor-made forms of the stochastic maximum principle. While we assume that the state dynamics are affine in the states and the controls, our assumptions on the nature of the costs are rather weak, and surprisingly, the dependence of all the coefficients upon the statistical distribution of the states remains of a rather general nature. Our probabilistic approach calls for the solution of systems of forward-backward stochastic differential equations of a McKean-Vlasov type for which no existence result is known, and for which we prove existence and regularity of the corresponding value function. Finally, we prove that solutions of the mean-field game as formulated by Lasry and Lions do indeed provide approximate Nash equilibriums for games with a large number of players, and we quantify the nature of the approximation.

math.PR