Searcharxiv⌕ Search

arXiv subjects

Francisco J. Silva

Publications and source records attributed to Francisco J. Silva.

At least 19 recordsLinked to original sources

Initialization-driven neural generation and training for high-dimensional optimal control and first-order mean field games

This paper first introduces a method to approximate the value function of high-dimensional optimal control by neural networks. Based on the established relationship between Pontryagin's maximum principle (PMP) and the value function of the optimal control problem, which is characterized as being the unique solution to an associated Hamilton-Jacobi-Bellman (HJB) equation, we propose an approach that begins by using neural networks to provide a first rough estimate of the value function, which serves as initialization for solving the two point boundary value problem in the PMP and, as a result, generates reliable data. To train the neural network we define a loss function that takes into account this dataset and also penalizes deviations from the HJB equation. In the second part, we address the computation of equilibria in first-order Mean Field Game (MFG) problems by integrating our method with the fictitious play algorithm. These equilibria are characterized by a coupled system of a first-order HJB equation and a continuity equation. To approximate the solution to the continuity equation, we introduce a second neural network that learns the flow map transporting the initial distribution of agents. This network is trained on data generated by solving the underlying ODEs for a batch of initial conditions sampled from the initial distribution of agents. By combining this flow approximation, the previously described method for approximating the value function, and the fictitious play algorithm, we obtain an effective method to tackle high-dimensional deterministic MFGs.

math.OC↗

A Proximal Primal-Dual Approach to Generalized JKO Schemes for Doubly Nonlinear Parabolic Equations

Variational methods based on optimization strategies are proposed to numerically solve a large family of nonlinear partial differential equations. They are all particular instances of gradient flows with general costs, including the $p$-Laplace equation and flux-limited equations such as the relativistic heat equation. This is achieved by computing explicit formulas for proximal operators with general costs amenable to efficient numerical approximation. We showcase our numerical approach via validation of the results by recovering the qualitative behavior of particular known cases of this large family of steepest descent evolutions.

math.NA↗

Parallel-in-Time Preconditioning for Time-Dependent Variational Mean Field Games

We study the numerical approximation of a time-dependent variational mean field game system with local couplings and either periodic or Neumann boundary conditions. Following a variational approach, we employ a finite difference discretization and solve the resulting finite-dimensional optimization problem using the Chambolle--Pock primal--dual algorithm. As this involves computing proximal operators and solving ill-conditioned linear systems at each iteration, we embed within our solver a general class of parallel-in-time preconditioners based on suitably-chosen diagonalization techniques, applied using discrete Fourier transforms. These enable efficient, scalable iterative solvers for each linear system, with robustness across a wide range of viscosities. We further develop fast solvers for the resulting ill-conditioned systems arising at each time step, using exact recursive schemes for structured grids while allowing for other geometries. Numerical experiments confirm the improved performance and parallel scalability of our approach.

math.NA↗

A Semi-Lagrangian scheme for Hamilton-Jacobi-Bellman equations with Dirichlet boundary conditions

We study the numerical approximation of time-dependent, possibly degenerate, second-order Hamilton-Jacobi-Bellman equations in bounded domains with nonhomogeneous Dirichlet boundary conditions. It is well known that convergence towards the exact solution of the equation, considered here in the viscosity sense, holds if the scheme is monotone, consistent, and stable. While standard finite difference schemes are, in general, not monotone, the so-called semi-Lagrangian schemes are monotone by construction. On the other hand, these schemes make use of a wide stencil and, when the equation is set in a bounded domain, this typically causes an overstepping of the boundary and hence the loss of consistency. We propose here a semi-Lagrangian scheme defined on an unstructured mesh, with a suitable treatment at grid points near the boundary to preserve consistency, and show its convergence for problems where the viscosity solution can even be discontinuous. We illustrate the numerical convergence in several tests, including degenerate and first-order equations.

math.NA↗

Proximity Operators of Perspective Functions with Nonlinear Scaling

A perspective function is a construction which combines a base function defined on a given space with a nonlinear scaling function defined on another space and which yields a lower semicontinuous convex function on the product space. Since perspective functions are typically nonsmooth, their use in first-order algorithms necessitates the computation of their proximity operator. This paper establishes closed-form expressions for the proximity operator of a perspective function defined on a Hilbert space in terms of a proximity operator involving its base function and one involving its scaling function.

math.OC↗

A high-order scheme for mean field games

In this paper we propose a high-order numerical scheme for time-dependent mean field games systems. The scheme, which is built by combining Lagrange-Galerkin and semi-Lagrangian techniques, is consistent and stable for large time steps compared with the space steps. We provide a convergence analysis for the exactly integrated Lagrange-Galerkin scheme applied to the Fokker-Planck equation, and we propose an implementable version with inexact integration. Finally, we validate the convergence rate of the proposed scheme through the numerical approximation of two mean field games systems.

math.NA↗

Perspective Functions with Nonlinear Scaling

The classical perspective of a function is a construction which transforms a convex function into one that is jointly convex with respect to an auxiliary scaling variable. Motivated by applications in several areas of applied analysis, we investigate an extension of this construct in which the scaling variable is replaced by a nonlinear term. Our construction is placed in the general context of locally convex spaces and it generates a lower semicontinuous convex function under broad assumptions on the underlying functions. Various convex-analytical properties are established and closed-form expressions are derived. Several applications are presented.

math.FA↗

Approximation of deterministic mean field games under polynomial growth conditions on the data

We consider a deterministic mean field games problem in which a typical agent solves an optimal control problem where the dynamics is affine with respect to the control and the cost functional has a growth which is polynomial with respect to the state variable. In this framework, we construct a mean field game problem in discrete time and finite state space that approximates equilibria of the original game. Two numerical examples, solved with the fictitious play method, are presented.

math.OC↗

Approximation of deterministic mean field games with control-affine dynamics

We consider deterministic mean field games where the dynamics of a typical agent is non-linear with respect to the state variable and affine with respect to the control variable. Particular instances of the problem considered here are mean field games with control on the acceleration. We focus our attention on the approximation of such mean field games by analogous problems in discrete time and finite state space. For these approximations, we show the existence and, under an additional monotonicity assumption, uniqueness of solutions. In our main result, we establish the convergence of equilibria of the discrete mean field games problems towards equilibria of the continuous one. Finally, we provide some numerical results for two MFG problems. In the first one, the dynamics of a typical player is nonlinear with respect to the state and, in the second one, a typical player controls its acceleration.

math.OC↗

A Primal-Dual Partial Inverse Splitting for Constrained Monotone Inclusions: Applications to stochastic Programming and Mean Field Games

In this work we study a constrained monotone inclusion involving the normal cone to a closed vector subspace and a priori information on primal solutions. We model this information by imposing that solutions belongs to the fixed point set of an averaged nonexpansive mapping. We characterize the solutions using an auxiliary inclusion that involves the partial inverse operator. Then, we propose the primal-dual partial inverse splitting and we prove its weak convergence to a solution of the inclusion, generalizing several methods in the literature. The efficiency of the proposed method is illustrated in two non-smooth convex optimization problems whose constraints have vector subspace structure. Finally, the proposed algorithm is applied to find a solution to a stochastic arc capacity expansion problem in transport networks.

math.OC↗

A semi-Lagrangian scheme for Hamilton-Jacobi-Bellman equations with oblique boundary conditions

We investigate in this work a fully-discrete semi-Lagrangian approximation of second order possibly degenerate Hamilton-Jacobi-Bellman (HJB) equations on a bounded domain with oblique boundary conditions. These equations appear naturally in the study of optimal control of diffusion processes with oblique reflection at the boundary of the domain. The proposed scheme is shown to satisfy a consistency type property, it is monotone and stable. Our main result is the convergence of the numerical solution towards the unique viscosity solution of the HJB equation. The convergence result holds under the same asymptotic relation between the time and space discretization steps as in the classical setting for semi-Lagrangian schemes. We present some numerical results that confirm the numerical convergence of the scheme.

math.NA↗

The planning problem in Mean Field Games as regularized mass transport

In this paper, using variational approaches, we investigate the first order planning problem arising in the theory of mean field games. We show the existence and uniqueness of weak solutions of the problem in the case of a large class of Hamiltonians with arbitrary superlinear order of growth at infinity and local coupling functions. We require the initial and final measures to be merely summable. At the same time (relying on the techniques developed recently by Graber and Mészáros), under stronger monotonicity and convexity conditions on the data, we obtain Sobolev estimates on the solutions of the planning problem both for space and time derivatives.

math.AP↗

On the asymptotic nature of first order mean field games

For a class of finite horizon first order mean field games and associated N-player games, we give a simple proof of convergence of symmetric N-player Nash equilibria in distributed open-loop strategies to solutions of the mean field game in Lagrangian form. Lagrangian solutions are then connected with those determined by the usual mean field game system of two coupled first order PDEs, and convergence of Nash equilibria in distributed Markov strategies is established.

math.OC↗

Metric regularity under Gâteaux differentiability with applications to optimization and stochastic optimal control problems

The main objective of this work is to study the existence of Lagrange multipliers for infinite dimensional problems under Gâteux differentiability assumptions on the data. Our investigation follows two main steps: the proof of the existence of Lagrange multipliers under a calmness assumption on the constraints and the study of sufficient conditions, which only use the Gâteaux derivative of the function defining the constraint, that ensure this assumption.

math.OC↗

A fully-discrete scheme for systems of nonlinear Fokker-Planck-Kolmogorov equations

We consider a system of Fokker-Planck-Kolmogorov (FPK) equations, where the dependence of the coefficients is nonlinear and nonlocal in time with respect to the unknowns. We extend the numerical scheme proposed and studied recently by the authors for a single FPK equation of this type. We analyse the convergence of the scheme and we study its applicability in two examples. The first one concerns a population model involving two interacting species and the second one concerns two populations Mean Field Games.

math.NA↗

On the discretization of some nonlinear Fokker-Planck-Kolmogorov equations and applications

In this work, we consider the discretization of some nonlinear Fokker-Planck-Kolmogorov equations. The scheme we propose preserves the non-negativity of the solution, conserves the mass and, as the discretization parameters tend to zero, has limit measure-valued trajectories which are shown to solve the equation. The main assumptions to obtain a convergence result are that the coefficients are continuous and satisfy a suitable linear growth property with respect to the space variable. In particular, we obtain a new proof of existence of solutions for such equations. We apply our results to several examples, including Mean Field Games systems and variations of the Hughes model for pedestrian dynamics.

math.NA↗

On the variational formulation of some stationary second order mean field games systems

We consider the variational approach to prove the existence of solutions of second order stationary Mean Field Games on a bounded domain $Ω\subseteq \mathbb{R}^{d}$, with Neumann boundary conditions, and with and without density constraints. We consider Hamiltonians which growth as $|\cdot|^{q'}$, where $q'=q/(q-1)$ and $q>d$. Despite this restriction, our approach allows us to prove the existence of solutions in the case of rather general coupling terms. When density constraints are taken into account, our results improve those in \cite{MesSil}. Furthermore, our approach can be used to obtain solutions of systems with multiple populations.

math.AP↗

The Hughes model for pedestrian dynamics and congestion modelling

In this paper we present a numerical study of some variations of the Hughes model for pedestrian flow under different types of congestion effects. The general model consists of a coupled non-linear PDE system involving an eikonal equation and a first order conservation law, and it intends to approximate the flow of a large pedestrian group aiming to reach a target as fast as possible, while taking into account the congestion of the crowd. We propose an efficient semi-Lagrangian scheme (SL) to approximate the solution of the PDE system and we investigate the macroscopic effects of different penalization functions modelling the congestion phenomena.

math.NA↗