SearcharxivSearch

arXiv subjects

Markus Fischer

Publications and source records attributed to Markus Fischer.

At least 19 recordsLinked to original sources

Mean field games with option to buy information

We introduce a class of continuous time finite horizon mean field games where the objective function of the representative player depends on a hidden state, in addition to position, control, and the population distribution. While acting on the position dynamics, the agent has the option to pay for seeing the hidden state. We connect the original formulation of our model with a mean field model of optimal control with discretionary stopping, characterize solutions, and give a simple explicitly solvable example. For a class of $N$-player games with compatible information structure, we show that approximate Nash equilibria can be constructed starting from a solution to the limit model.

math.OC

Dimension Reduction for Symbolic Regression

Solutions of symbolic regression problems are expressions that are composed of input variables and operators from a finite set of function symbols. One measure for evaluating symbolic regression algorithms is their ability to recover formulae, up to symbolic equivalence, from finite samples. Not unexpectedly, the recovery problem becomes harder when the formula gets more complex, that is, when the number of variables and operators gets larger. Variables in naturally occurring symbolic formulas often appear only in fixed combinations. This can be exploited in symbolic regression by substituting one new variable for the combination, effectively reducing the number of variables. However, finding valid substitutions is challenging. Here, we address this challenge by searching over the expression space of small substitutions and testing for validity. The validity test is reduced to a test of functional dependence. The resulting iterative dimension reduction procedure can be used with any symbolic regression approach. We show that it reliably identifies valid substitutions and significantly boosts the performance of different types of state-of-the-art symbolic regression algorithms.

cs.LG

Weak equilibria of a mean-field market model under asymmetric information

We investigate how asymmetric information affects equilibrium price formation in an economy with many interacting agents. Motivated by a finite-player model with two populations of asymmetrically informed agents, we study its mean-field limit when one population observes an additional stochastic factor which is inaccessible to the other. The resulting equilibrium condition involves the conditional expectation of the adjoint process and, therefore, differs from standard mean-field formulations based on the state process. We prove existence of mean-field equilibria in probabilistic weak sense by combining discretization and weak convergence arguments with a lifting procedure tailored to preserve compatibility in the limit. Under additional assumptions, we obtain a conditional asymptotic justification of the mean-field price as an approximation of the finite-player market clearing relation. Finally, we illustrate how, in the case of a single informed agent, her strategy can be characterized in terms of the equilibrium.

math.PR

NMR shift prediction from small data quantities

Prediction of chemical shift in NMR using machine learning methods is typically done with the maximum amount of data available to achieve the best results. In some cases, such large amounts of data are not available, e.g. for heteronuclei. We demonstrate a novel machine learning model which is able to achieve good results with comparatively low amounts of data. We show this by predicting 19F and 13C NMR chemical shifts of small molecules in specific solvents.

physics.chem-ph

Coarse correlated equilibria for continuous time mean field games in open loop strategies

In the framework of continuous time symmetric stochastic differential games in open loop strategies, we introduce a generalization of mean field game solution, called coarse correlated solution. This can be seen as the analogue of a coarse correlated equilibrium in the $N$-player game, where a moderator randomly generates a strategy profile and asks the players to pre-commit to such strategies before disclosing them privately to each one of them; such a profile is a coarse correlated equilibrium if no player has an incentive to unilaterally deviate. We justify our definition by showing that a coarse correlated solution for the mean field game induces a sequence of approximate coarse correlated equilibria with vanishing error for the underlying $N$-player games. Existence of coarse correlated solutions for the mean field game is proved by means of a minimax theorem. An example with explicit solutions is discussed as well.

math.PR

Correlated equilibria for mean field games with progressive strategies

In a discrete space and time framework, we study the mean field game limit for a class of symmetric $N$-player games based on the notion of correlated equilibrium. We give a definition of correlated solution that allows to construct approximate $N$-player correlated equilibria that are robust with respect to progressive deviations. We illustrate our definition by way of an example with explicit solutions.

math.OC

A unifying framework for submodular mean field games

We provide an abstract framework for submodular mean field games and identify verifiable sufficient conditions that allow to prove existence and approximation of strong mean field equilibria in models where data may not be continuous with respect to the measure parameter and common noise is allowed. The setting is general enough to encompass qualitatively different problems, such as mean field games for discrete time finite space Markov chains, singularly controlled and reflected diffusions, and mean field games of optimal timing. Our analysis hinges on Tarski's fixed point theorem, along with technical results on lattices of flows of probability and sub-probability measures.

math.OC

An algorithm to construct subsolutions of convex optimal control problems

We propose an algorithm that produces a non-decreasing sequence of subsolutions for a class of optimal control problems distinguished by the property that the associated Bellman operators preserve convexity. In addition to a theoretical discussion and proofs of convergence, numerical experiments are presented to illustrate the feasibility of the method.

math.OC

Correlated equilibria and mean field games: a simple model

In the context of simple finite-state discrete time systems, we introduce a generalization of mean field game solution, called correlated solution, which can be seen as the mean field game analogue of a correlated equilibrium. Our notion of solution is justified in two ways: We prove that correlated solutions arise as limits of exchangeable correlated equilibria in restricted (Markov open-loop) strategies for the underlying $N$-player games, and we show how to construct approximate $N$-player correlated equilibria starting from a correlated solution to the mean field game.

math.OC

Submodular Mean Field Games: Existence and Approximation of Solutions

We study mean field games with scalar It{\^o}-type dynamics and costs that are submodular with respect to a suitable order relation on the state and measure space. The submodularity assumption has a number of interesting consequences. Firstly, it allows us to prove existence of solutions via an application of Tarski's fixed point theorem, covering cases with discontinuous dependence on the measure variable. Secondly, it ensures that the set of solutions enjoys a lattice structure: in particular, there exist a minimal and a maximal solution. Thirdly, it guarantees that those two solutions can be obtained through a simple learning procedure based on the iterations of the best-response-map. The mean field game is first defined over ordinary stochastic controls, then extended to relaxed controls. Our approach allows also to treat a class of submodular mean field games with common noise in which the representative player at equilibrium interacts with the (conditional) mean of its state's distribution.

math.OC

On the asymptotic nature of first order mean field games

For a class of finite horizon first order mean field games and associated N-player games, we give a simple proof of convergence of symmetric N-player Nash equilibria in distributed open-loop strategies to solutions of the mean field game in Lagrangian form. Lagrangian solutions are then connected with those determined by the usual mean field game system of two coupled first order PDEs, and convergence of Nash equilibria in distributed Markov strategies is established.

math.OC

On the convergence problem in Mean Field Games: a two state model without uniqueness

We consider N-player and mean field games in continuous time over a finite horizon, where the position of each agent belongs to {-1,1}. If there is uniqueness of mean field game solutions, e.g. under monotonicity assumptions, then the master equation possesses a smooth solution which can be used to prove convergence of the value functions and of the feedback Nash equilibria of the N-player game, as well as a propagation of chaos property for the associated optimal trajectories. We study here an example with anti-monotonous costs, and show that the mean field game has exactly three solutions. We prove that the value functions converge to the entropy solution of the master equation, which in this case can be written as a scalar conservation law in one space dimension, and that the optimal trajectories admit a limit: they select one mean field game soution, so there is propagation of chaos. Moreover, viewing the mean field game system as the necessary conditions for optimality of a deterministic control problem, we show that the N-player game selects the optimizer of this problem.

math.OC

On non-uniqueness and uniqueness of solutions in finite-horizon mean field games

This paper presents a class of evolutive Mean Field Games with multiple solutions for all time horizons T and convex but non-smooth Hamiltonian H, as well as for smooth H and T large enough. The phenomenon is analyzed in both the PDE and the probabilistic setting. The examples are compared with the current theory about uniqueness of solutions. In particular, a new result on uniqueness for the MFG PDEs with small data, e.g., small T, is proved. Some results are also extended to MFGs with two populations.

math.AP

Probabilistic approach to finite state mean field games

We study mean field games and corresponding $N$-player games in continuous time over a finite time horizon where the position of each agent belongs to a finite state space. As opposed to previous works on finite state mean field games, we use a probabilistic representation of the system dynamics in terms of stochastic differential equations driven by Poisson random measures. Under mild assumptions, we prove existence of solutions to the mean field game in relaxed open-loop as well as relaxed feedback controls. Relying on the probabilistic representation and a coupling argument, we show that mean field game solutions provide symmetric $\epsilon_N$-Nash equilibria for the $N$-player game, both in open-loop and in feedback strategies (not relaxed), with $\epsilon_N\leq \frac{\text{constant}}{\sqrt{N}}$. Under stronger assumptions, we also find solutions of the mean field game in ordinary feedback controls and prove uniqueness either in case of a small time horizon or under monotonicity.

math.PR

McKean-Vlasov limit for interacting systems with simultaneous jumps

Motivated by several applications, including neuronal models, we consider the McKean-Vlasov limit for mean-field systems of interacting diffusions with simultaneous jumps. We prove propagation of chaos via a coupling technique that involves an intermediate process and that gives a rate of convergence for the $W_1$ Wasserstein distance between the empirical measures of the two systems on the space of trajectories $\mathbf{D}([0,T],\mathbb{R}^d)$.

math.PR

$N$-player games and mean field games with absorption

We introduce a simple class of mean field games with absorbing boundary over a finite time horizon. In the corresponding $N$-player games, the evolution of players' states is described by a system of weakly interacting It\^o equations with absorption on first exit from a bounded open set. Once a player exits, her/his contribution is removed from the empirical measure of the system. Players thus interact through a renormalized empirical measure. In the definition of solution to the mean field game, the renormalization appears in form of a conditional law. We justify our definition of solution in the usual way, that is, by showing that a solution of the mean field game induces approximate Nash equilibria for the $N$-player games with approximation error tending to zero as $N$ tends to infinity. This convergence is established provided the diffusion coefficient is non-degenerate. The degenerate case is more delicate and gives rise to counter-examples.

math.PR

Limits of relative entropies associated with weakly interacting particle systems

The limits of scaled relative entropies between probability distributions associated with N-particle weakly interacting Markov processes are considered. The convergence of such scaled relative entropies is established in various settings. The analysis is motivated by the role relative entropy plays as a Lyapunov function for the (linear) Kolmogorov forward equation associated with an ergodic Markov process, and Lyapunov function properties of these scaling limits with respect to nonlinear finite-state Markov processes are studied in the companion paper [6].

math.PR

Local stability of Kolmogorov forward equations for finite state nonlinear Markov processes

The focus of this work is on local stability of a class of nonlinear ordinary differential equations (ODE) that describe limits of empirical measures associated with finite-state weakly interacting N-particle systems. Local Lyapunov functions are identified for several classes of such ODE, including those associated with systems with slow adaptation and Gibbs systems. Using results from [5] and large deviations heuristics, a partial differential equation (PDE) associated with the nonlinear ODE is introduced and it is shown that positive definite subsolutions of this PDE serve as local Lyapunov functions for the ODE. This PDE characterization is used to construct explicit Lyapunov functions for a broad class of models called locally Gibbs systems. This class of models is significantly larger than the family of Gibbs systems and several examples of such systems are presented, including models with nearest neighbor jumps and models with simultaneous jumps that arise in applications.

math.PR