SearcharxivSearch

arXiv subjects

Alain Bensoussan

Publications and source records attributed to Alain Bensoussan.

At least 19 recordsLinked to original sources

Finite-Sample Metric Non-Collapse for Geometrically Supervised Latent World Models in Control

We establish a finite-sample learning-to-control theory for geometrically supervised latent models of nonlinear deterministic systems. Geometric supervision is used only during training: simulator state, proprioception, or state estimates with independently validated metric and directional error bounds supply observable-state distances and tangent directions, while deployment remains observation- and action-conditioned. We introduce an encoder-only local--global metric hinge that enforces directional resolution and separated-state discrimination. Under regular observable-factor, coverage, finite-capacity approximation, and uniform $C^{1,1}$ hypotheses, a computable one-sided regularization regime has a strong selection property: with high probability, every approximate empirical minimizer is simultaneously pointwise co-Lipschitz and uniformly approximately semiconjugate to the controlled dynamics. Approximation, sampling, and optimization errors remain explicit and separate. Norm-constrained tensor-product B-spline classes constructively realize the approximation hypotheses, and the interpolation exponent converting mean residual control into a uniform bound is sharp. A modular deterministic corollary transfers the learned certificates to trajectory, finite-horizon cost, learned-cost-head, and optimizer guarantees, while a validated finite-net result enables sharper model-specific certification. Controlled experiments isolate collapse and folding, quantify the analytic certificate's reserve, and demonstrate the control benefit of restored metric resolution. The principal contribution is a complete finite-sample implication from approximate empirical optimization to metric faithfulness, uniform controlled dynamics, and reliable planning for the same learned model.

math.OC

Control and optimization for Neural Partial Differential Equations in Supervised Learning

Although there is a substantial body of literature on control and optimization problems for parabolic and hyperbolic systems, the specific problem of controlling and optimizing the coefficients of the associated operators within such systems has not yet been thoroughly explored. In this work, we aim to initiate a line of research in control theory focused on optimizing and controlling the coefficients of these operators-a problem that naturally arises in the context of neural networks and supervised learning. In supervised learning, the primary objective is to transport initial data toward target data through the layers of a neural network. We propose a novel perspective: neural networks can be interpreted as partial differential equations (PDEs). From this viewpoint, the control problem traditionally studied in the context of ordinary differential equations (ODEs) is reformulated as a control problem for PDEs, specifically targeting the optimization and control of coefficients in parabolic and hyperbolic operators. To the best of our knowledge, this specific problem has not yet been systematically addressed in the control theory of PDEs. To this end, we propose a dual system formulation for the control and optimization problem associated with parabolic PDEs, laying the groundwork for the development of efficient numerical schemes in future research. We also provide a theoretical proof showing that the control and optimization problem for parabolic PDEs admits minimizers. Finally, we investigate the control problem associated with hyperbolic PDEs and prove the existence of solutions for a corresponding approximated control problem.

math.OC

Operator Splitting, Policy Iteration, and Machine Learning for Stochastic Optimal Control

We propose a splitting approach to solve the second-order Hamilton--Jacobi equation, reducing it to a heat step and a purely first-order step. The latter is implemented using a gradient value policy iteration algorithm, enabling efficient characteristic-based machine learning methods. We establish convergence rates for the splitting method. In particular, with $h$ the splitting step, the $L^\infty$ error is bounded between $\mathcal{O}(h)$ and $\mathcal{O}(h^{1/5})$ for Lipschitz data, improving to $\mathcal{O}(h^{1/3})$ for semiconcave data. In the periodic setting, we also obtain an $L^1$ error of order $\mathcal{O}(h^{1/2})$. For the first-order step, we provide a weighted $L^2$ error analysis that shows exponential convergence. Each iteration solves linear characteristic equations and learns the value function by minimizing a weighted value gradient loss. The approach yields stable and accurate numerical results.

math.OC

A Class of Degenerate Mean Field Games, Associated FBSDEs and Master Equations

In this paper, we study a class of degenerate mean field games (MFGs) with state-distribution dependent and unbounded functional diffusion coefficients. With a probabilistic method, we study the well-posedness of the forward-backward stochastic differential equations (FBSDEs) associated with the MFG and arising from the maximum principle, and estimate the corresponding Jacobian and Hessian flows. We further establish the classical regularity of the value functional $V$; in particular, we show that when the cost function is $C^3$ in the spatial and control variables and $C^2$ in the distribution argument, then the value functional is $C^1$ in time and $C^2$ in the spatial and distribution variables. As a consequence, the value functional $V$ is the unique classical solution of the degenerate MFG master equation.

math.OC

A Variational Approach to Mean Field Type Control

Variational methods have been used to study stochastic control for long, see Bensoussan (1982) and Bensoussan-Lions (1978) for the early works. More precisely, variational approaches apply to the study of Bellman equation as a parabolic quasi-linear equation, when the nonlinearity affects only the gradient of the solution, and the second order derivative term is linear and not degenerate. This corresponds to a stochastic control problem, where the state equation is a diffusion process. The primary objective of this article is to extend this approach to mean field control theory, as an alternative to the current approach, which considers a coupled system of Hamilton-Jacobi (HJ) and Fokker-Planck (FP) equations, since the introduction of the theory by Lasry-Lions (2007). The main novelty lies in that the equation studied here is the HJB equation, neither the HJ-FP system nor the master equation; and our results also provide another perspective for probabilistic approaches; see Chassagneux-Crisan-Delarue (2022), Bensoussan-Wong-Yam-Yuan (2024), Bensoussan-Tai-Yam (2025) and Bensoussan-Huang-Tang-Yam (2025) for instance. Within the scope of the PDE methods, the advantage of this article is to solve a larger class of mean field control problems, with moderate regularity; and this kind of variational methods fairly require few conditions on the regularity of the coefficients.

math.OC

Mean Field Type Control Problems Driven by Jump-diffusions

In this article, we apply a probabilistic approach to study general mean field type control (MFTC) problems with jump-diffusions, and give the first global-in-time solution. We allow the drift coefficient $b$ and the diffusion coefficient $σ$ to nonlinearly depend on the state, distribution and control variables, and both can be unbounded and possibly degenerate; besides, the jump coefficient $γ$ is allowed to be non-constant. To tackle the non-linear and control-dependent diffusion $σ$, we further formulate a joint cone property and estimates for both processes $P$ and $Q$ of the corresponding adjoint process (where $(P,Q,R)$ is the solution triple of the associated adjoint process as a backward stochastic differential equation with jump), in contrast to our previous single cone property of the only process $P$. We study first the system of forward-backward stochastic differential equations (FBSDEs) with jumps arising from the maximum principle, and then the related Jacobian flows, which altogether yield the classical regularity of the value function and thus allow us to show that the value function is the unique classical solution of the HJB integro-partial differential equation. Most importantly, our proposed probabilistic approach can apparently handle the MFTC problem driven by a fairly general process far beyond Brownian motion, in a relatively easier manner than the existing analytic approach.

math.PR

On Convergence Rates of General $N$-Player Stackelberg Games to their Mean Field Limits

In this article, we establish precise convergence rates of a general class of $N$-Player Stackelberg games to their mean field limits, which allows the response time delay of information, empirical distribution based interactions, and the control-dependent diffusion coefficients. All these features makes our problem nonstandard, barely been touched in the literature, and they complicate the analysis and therefore reduce the convergence rate. We first justify the same convergence rate for both the followers and the leader. Specifically, for the most general case, the convergence rate is shown to be $\mathcal{O}\left(N^{-\frac{2(q-2)}{n_1(3q-4)}}\right)$ when $n_1>4$ where $n_1$ is the dimension of the follower's state, and $q$ is the order of the integration of the initial; and this rate has yet been shown in the literature, to the best of our knowledge. Moreover, by classifying cases according to the state dimension $n_1$, the nature of the delay, and the assumptions of the coefficients, we provide several subcases where faster convergence rates can be obtained; for instance the $\mathcal{O}\left(N^{-\frac{2}{3n_1}}\right)$-convergence when the diffusion coefficients are independent of control variable. Our result extends the standard $o(1)$-convergence result for the mean field Stackelberg games in the literature, together with the $\mathcal{O}(N^{-\frac{1}{n_1+4}})$-convergence for the mean field games with major and minor players. We also discuss the special case where our coefficients are linear in distribution argument while nonlinear in state and control arguments, and we establish an $\mathcal{O}(1/\sqrt{N})$ convergence rate, which extends the linear quadratic cases in the literature.

math.OC

Second Order Fully Nonlinear Mean Field Games with Degenerate Diffusions

In this article, we study the global-in-time well-posedness of second order mean field games (MFGs) with both nonlinear drift functions simultaneously depending on the state, distribution and control variables, and the diffusion term depending on both state and distribution. Besides, the diffusion term is allowed to be degenerate, unbounded and even nonlinear in the distribution, but it does not depend on the control. First, we establish the global well-posedness of the corresponding forward-backward stochastic differential equations (FBSDEs), which arise from the maximum principle under a so-called $β$-monotonicity commonly used in the optimal control theory. The $β$-monotonicity admits more interesting cases, as representative examples including but not limited to the displacement monotonicity, the small mean field effect condition or the Lasry-Lions monotonicity; and ensures the well-posedness result in diverse non-convex examples. In our settings, we pose assumptions directly on the drift and diffusion coefficients and the cost functionals, rather than indirectly on the Hamiltonian, to make the conditions more visible. Our probabilistic method tackles the nonlinear dynamics with a linear but infinite dimensional version, and together with our recently proposed cone property for the adjoint processes, following in an almost straightforward way the conventional approach to the classical stochastic control problem, we derive a sufficiently good regularity of the value functional, and finally show that it is the unique classical solution to the MFG master equation. Our results require fairly few conditions on the functional coefficients for solution of the MFG, and a bit more conditions -- which are least stringent in the contemporary literature -- for classical solution of the MFG master equation.

math.OC

Control on Hilbert Space and Mean Field Control: the Common Noise Case

The objective of this paper is to provide an equivalent of the theory developed in P.~Cardaliaguet, F.~Delarue, J.M.~Lasry, P.L.~Lions \cite{CDLL}, following the approach of control on Hilbert spaces introduced by the authors in \cite{BGY-2}. We include the common noise in this paper, so the alternative is now complete. Since we consider a control problem, our theory applies only to Mean field control and not to mean field games. The assumptions are adapted to guarantee a unique optimal control, so they insure that the cost functional is strictly convex and coercive.

math.OC

On stochastic control problems with higher-order moments

In this paper, we focus on a class of time-inconsistent stochastic control problems, where the objective function includes the mean and several higher-order central moments of the terminal value of state. To tackle the time-inconsistency, we seek both the closed-loop and the open-loop Nash equilibrium controls as time-consistent solutions. We establish a partial differential equation (PDE) system for deriving a closed-loop Nash equilibrium control, which does not include the equilibrium value function and is different from the extended Hamilton-Jacobi-Bellman (HJB) equations as in Björk et al. (Finance Stoch. 21: 331-360, 2017). We show that our PDE system is equivalent to the extended HJB equations that seems difficult to be solved for our higher-order moment problems. In deriving an open-loop Nash equilibrium control, due to the non-separable higher-order moments in the objective function, we make some moment estimates in addition to the standard perturbation argument for developing a maximum principle. Then, the problem is reduced to solving a flow of forward-backward stochastic differential equations. In particular, we investigate linear controlled dynamics and some objective functions affine in the mean. The closed-loop and the open-loop Nash equilibrium controls are identical, which are independent of the state value, random path and the preference on the odd-order central moments. By sending the highest order of central moments to infinity, we obtain the time-consistent solutions to some control problems whose objective functions include some penalty functions for deviation.

q-fin.MF

A Control Theoretical Approach to Mean Field Games and Associated Master Equations

We prove the global-in-time well-posedness for a broad class of mean field game problems, which is beyond the special linear-quadratic setting, as long as the mean field sensitivity is not too large. Through the stochastic maximum principle, we adopt the FBSDE approach to investigate the unique existence of the corresponding equilibrium strategies. The corresponding FBSDEs are first solved locally in time, then by controlling the sensitivity of the backward solutions with respect to the initial condition via some suitable apriori estimates for the corresponding Jacobian flows, the global-in-time solution is warranted. Further analysis on these Jacobian flows will be discussed to establish the regularities, such as linear functional differentiability, of the respective value functions that leads to the ultimate classical well-posedness of the master equation on $\mathbb{R}^d$. To the best of our knowledge, it is the first article to deal with the mean field game problem, as well as its associated master equation, with general cost functionals having quadratic growth under the small mean field effect. In this current approach, we directly impose the structural conditions on the cost functionals, rather than conditions on the Hamiltonian. The advantages of this are threefold: (i) compared with imposing conditions on Hamiltonian, the structural conditions imposed in this work are easily verified, and less demanding on the regularity requirements of the cost functionals while solving the master equation; (ii) the displacement monotonicity is basically just a direct consequence of small mean field effect in the structural conditions; and (iii) when the mean field effect is not that small, we can still provide an accurate lifespan for the local existence. The method in this work can be readily extended to the case with nonlinear drift and non-separable cost functionals.

math.OC

On Mean Field Monotonicity Conditions from Control Theoretical Perspective

In this article, from the viewpoint of control theory, we discuss the relationships among the commonly used monotonicity conditions that ensure the well-posedness of the solutions arising from problems of mean field games (MFGs) and mean field type control (MFTC). We first introduce the well-posedness of general forward-backward stochastic differential equations (FBSDEs) defined on some suitably chosen Hilbert spaces under the $β$-monotonicity. We then propose a monotonicity condition for the MFG, namely partitioning the running cost functional into two parts, so that both parts still depend on the control and the state distribution, yet one satisfies a strong convexity and a small mean field effect condition, while the other has a newly introduced displacement quasi-monotonicity. To the best of our knowledge, the latter quasi type condition has not yet been discussed in the contemporary literature, and it can be considered as a bit more general monotonicity condition than those commonly used. Besides, for the MFG, we show that convexity and small mean field effect condition for the first part of running cost functional and the quasi-monotonicity condition for the second part together imply the $β$-monotonicity and thus the well-posedness for the associated FBSDEs. For the MFTC problem, we show that the $β$-monotonicity for the corresponding FBSDEs is simply the convexity assumption on the cost functional. Finally, we consider a more general setting where the drift functional is allowed to be non-linear for both MFG and MFTC problems.

math.OC

Degenerate Mean Field Type Control with Linear and Unbounded Diffusion, and their Associated Equations

We study the well-posedness of a system of forward-backward stochastic differential equations (FBSDEs) corresponding to a degenerate mean field type control problem, when the diffusion coefficient depends on the state together with its measure and also the control. Degenerate mean field type control problems are rarely studied in the literature. Our method is based on a lifting approach which embeds the control problem and the associated FBSDEs in Wasserstein spaces into certain Hilbert spaces. We use a continuation method to establish the solvability of the FBSDEs and that of the Gâteaux derivatives of this FBSDEs. We then explore the regularity of the value function in time and in measure argument, and we also show that it is the unique classical solution of the associated Bellman equation. We also study the higher regularity of the linear functional derivative of the value function, by then, we obtain the classical solution of the mean field type master equation.

math.PR

Global Well-Posedness of First-Order Mean Field Games and Master Equations with Nonlinear Dynamics

This article presents the variant of the approach introduced in the recent work of Bensoussan, Wong, Yam and Yuan [13] to the generic first-order mean field game problem. A major contribution here is the provision of new crucial a priori estimates, whose establishment is fundamentally different from the mentioned work since the associated forward-backward ordinary differential equation (FBODE) system is notably different. In addition, we require monotonicity conditions intimately on the coefficient functions but not on the Hamiltonians to handle their non-separable nature and nonlinear dynamics; as tackling Hamiltonians directly, it potentially dissolves much useful information. Compared with the assumptions used in [13], we introduce an additional requirement that the first-order derivative of the drift function in the measure variable cannot be too large relative to the convexity of the running cost function; this requirement only arises when the Hamiltonian is non-separable, and this phenomenon can also be seen in the existing literature. On the other hand, we require less here for the second-order differentiability of the coefficient functions in comparison to that in [13]. Our approach involves first demonstrating the local existence of a solution over small time interval, followed by the provision of new crucial a priori estimates for the sensitivity of the backward equation with respect to the initial condition of forward dynamics; and finally, smoothly gluing the local solutions together to form a global solution. In addition, we establish the local and global existence and uniqueness of classical solutions for the mean field game and its master equation.

math.OC

Linear Quadratic Extended Mean Field Games and Control Problems

We provide a thorough study of a general class of linear-quadratic extended mean field games and control problems in any dimensions where the mean field terms are allowed to be unbounded and there are also presence of cross terms in the objective functionals. Our investigation focuses on the unique existence of equilibrium strategies for the extended mean field problems by employing the stochastic maximum principle approach and the appropriate fixed point argument. We provide two distinct proofs, accompanied by two sufficient conditions, that establish the unique existence of the equilibrium strategy over a global time horizon. Both conditions emphasize the importance of sufficiently small coefficients of sensitivity for the cross term, of state and control, and mean field term. To determine the required magnitude of these coefficients, we utilize the singular values of appropriate matrices and Weyl's inequalities. The present proposed theory is consistent with the classical one, namely, our theoretical framework encompasses classical linear-quadratic stochastic control problems as particular cases. Additionally, we establish sufficient conditions for the unique existence of solutions to a particular class of non-symmetric Riccati equations, and we illustrate a counterexample to the existence of equilibrium strategies. Furthermore, we also apply the stochastic maximum principle approach to examine linear-quadratic extended mean field type stochastic control problems. Finally, we conduct a comparative analysis between our method and the alternative master equation approach, specifically addressing the efficacy of the present proposed approach in solving common practical problems, for which the explicit forms of the equilibrium strategies can be obtained directly, even over any global time horizon.

math.OC

A Theory of First Order Mean Field Type Control Problems and their Equations

In this article, by using several new crucial {\it a priori} estimates which are still absent in the literature, we provide a comprehensive resolution of the first order generic mean field type control problems and also establish the global-in-time classical solutions of their Bellman and master equations. Rather than developing the analytical approach via tackling the Bellman and master equation directly, we apply the maximum principle approach by considering the induced forward-backward ordinary differential equation (FBODE) system; indeed, we first show the local-in-time unique existence of the solution of the FBODE system for a variety of terminal data by Banach fixed point argument, and then provide crucial a priori estimates of bounding the sensitivity of the terminal data for the backward equation by utilizing a monotonicity condition that can be deduced from the positive definiteness of the Schur complement of the Hessian matrix of the Lagrangian in the lifted version and manipulating first order condition appropriately; this uniform bound over the whole planning horizon $[0,T]$ allows us to partition $[0,T]$ into a number of sub-intervals with a common small length and then glue the consecutive local-in-time solutions together to form the unique global-in-time solution of the FBODE system. The regularity of the global-in-time solution follows from that of the local ones due to the regularity assumptions on the coefficient functions. Moreover, the regularity of the value function will also be shown with the aid of the regularity of the solution couple of the FBODE system and the regularity assumptions on the coefficient functions, with which we can further deduce that this value function and its linear functional derivative satisfy the Bellman and master equations, respectively.

math.OC

Maximum Principle for Mean Field Type Control Problems with General Volatility Functions

In this paper, we study the maximum principle of mean field type control problems when the volatility function depends on the state and its measure and also the control, by using our recently developed method. Our method is to embed the mean field type control problem into a Hilbert space to bypass the evolution in the Wasserstein space. We here give a necessary condition and a sufficient condition for these control problems in Hilbert spaces, and we also derive a system of forward-backward stochastic differential equations.

math.OC

Reproducing kernel approach to linear quadratic mean field control problems

Mean-field control problems have received continuous interest over the last decade. Despite being more intricate than in classical optimal control, the linear-quadratic setting can still be tackled through Riccati equations. Remarkably, we demonstrate that another significant attribute extends to the mean-field case: the existence of an intrinsic reproducing kernel Hilbert space associated with the problem. Our findings reveal that this Hilbert space not only encompasses deterministic controlled push-forward mappings but can also represent of stochastic dynamics. Specifically, incorporating Brownian noise affects the deterministic kernel through a conditional expectation, to make the trajectories adapted. Introducing reproducing kernels allows us to rewrite the mean-field control problem as optimizing over a Hilbert space of trajectories rather than controls. This framework even accommodates nonlinear terminal costs, without resorting to adjoint processes or Pontryagin's maximum principle, further highlighting the versatility of the proposed methodology.

math.OC