SearcharxivSearch

arXiv subjects

Jingguo Zhang

Publications and source records attributed to Jingguo Zhang.

3 recordsLinked to original sources

A Globally Convergent Flow for Time-Dependent Mean Field Games and a Solver-Agnostic Framework for Inverse Problems

Mean field games (MFGs) describe the limiting behavior of large populations of strategically interacting agents. This paper addresses two numerical challenges for MFGs: globally convergent forward solvers and solver-agnostic methods for inverse problems. For the forward problem, we extend the Hessian--Riemannian flow (HRF), previously developed for stationary MFGs, to time-dependent MFGs. We first discretize the system in space and time and then construct the flow directly on the resulting finite-dimensional problem. The proposed flow exploits Lasry--Lions monotonicity, preserves the initial density and terminal value function, and maintains positivity and mass of the density. Under standard assumptions, we prove global convergence of the HRF and show how to recover a solution of the full discretized time-dependent MFG system from its limit. For the inverse problem, we formulate parameter estimation as a bilevel problem in which the outer problem updates unknown coefficients and the inner problem solves the discretized MFG system. Gradients of the outer objective are obtained by differentiating the discretized MFG system at the inner solution, rather than differentiating through the iterations of a particular forward solver. This yields a solver-agnostic framework with adjoint-based gradient descent and Gauss--Newton acceleration. Numerical experiments on stationary and time-dependent MFGs demonstrate the effectiveness of the proposed methods.

math.OC

Gaussian process policy iteration with additive Schwarz acceleration for forward and inverse HJB and mean field game problems

In this paper, we propose a Gaussian Process (GP)-based policy iteration framework for addressing both forward and inverse problems in Hamilton--Jacobi--Bellman (HJB) equations and mean field games (MFGs). Policy iteration is formulated as an alternating procedure between evaluating the value function under a fixed control policy and improving the policy. In our approach, we model the unknown fields using GPs within a policy-iteration framework that converts the nonlinear system into a sequence of linear PDE subproblems. Then, leveraging the linear structure, the updates for the value function and, in the MFG setting, the population density admit explicit representer formulas under linear PDE collocation constraints. The policy is subsequently updated pointwise via a Legendre transform step, which involves a low-dimensional maximization over the control variable. This maximization is explicit for standard quadratic costs. For smooth, strictly convex costs, this pointwise maximization is solved through its first-order optimality condition, whereas in constrained or non-smooth cases, it becomes a low-dimensional constrained maximization problem. To improve convergence, we incorporate the additive Schwarz acceleration as a preconditioning step following each policy update. Numerical experiments demonstrate the effectiveness of the Schwarz acceleration in improving computational efficiency.

cs.LG

Learning Surrogate Potential Mean Field Games via Gaussian Processes: A Data-Driven Approach to Ill-Posed Inverse Problems

Mean field games (MFGs) describe the collective behavior of large populations of interacting agents. In this work, we tackle ill-posed inverse problems in potential MFGs, aiming to recover the agents' population, momentum, and environmental setup from limited, noisy measurements and partial observations. These problems are ill-posed because multiple MFG configurations can explain the same data, or different parameters can yield nearly identical observations. Nonetheless, they remain crucial in practice for real-world scenarios where data are inherently sparse or noisy, or where the MFG structure is not fully determined. Our focus is on finding surrogate MFGs that accurately reproduce the observed data despite these challenges. We propose two Gaussian process (GP)-based frameworks: an inf-sup formulation and a bilevel approach. The choice between them depends on whether the unknown parameters introduce concavity in the objective. In the inf-sup framework, we use the linearity of GPs and their parameterization structure to maintain convex-concave properties, allowing us to apply standard convex optimization algorithms. In the bilevel framework, we employ a gradient-descent-based algorithm and introduce two methods for computing the outer gradient. The first method leverages an existing solver for the inner potential MFG and applies automatic differentiation, while the second adopts an adjoint-based strategy that computes the outer gradient independently of the inner solver. Our numerical experiments show that when sufficient prior information is available, the unknown parameters can be accurately recovered. Otherwise, if prior information is limited, the inverse problem is ill-posed, but our frameworks can still produce surrogate MFG models that closely match observed data.

cs.LG