SearcharxivSearch

arXiv subjects

Marco Scaratti

Publications and source records attributed to Marco Scaratti.

2 recordsLinked to original sources

Neural feedback approximation for stochastic control with degenerate diffusions: error estimates and numerical analysis

We study finite-horizon stochastic optimal control problems and approximate the resulting time-discrete formulation by a direct policy-learning problem over neural-network feedback maps. We prove a quantitative convergence estimate, in an averaged sense, for the error between the time-discrete value and the value induced by an approximately optimized neural policy. The bound separates the approximation of near-optimal feedback policies, the localization of stochastic trajectories on compact sets, and the optimization tolerance in training. The analysis does not require transition-density assumptions and covers possibly degenerate diffusions and deterministic controlled dynamics in a unified framework. Numerical experiments are provided for a degenerate stochastic radial target problem, a Hamilton--Jacobi--Bellman benchmark, and a gas storage problem, illustrating the approach and separating the main error sources: time discretization, restriction to piecewise-constant policies, neural-network approximation, and Monte Carlo evaluation.

math.OC

Extended mean field control: a global numerical solution via finite-dimensional approximation

We investigate the global numerical approximation of a class of extended mean field control problems (MFC), where the dynamics and costs depend on the joint distribution of the state and the control. We propose a framework to approximate the value function globally over the Wasserstein space, moving beyond the restriction of fixed initial conditions. Our approach exploits the propagation of chaos by approximating the infinite-dimensional MFC problem by an $N$-player cooperative game, together with the usage of finite-dimensional solvers. This method avoids the need to parametrise functions on an infinite-dimensional space, offering a balance between probabilistic rigor and computational efficiency.

math.OC