SearcharxivSearch

arXiv subjects

Mehdi Talbi

Publications and source records attributed to Mehdi Talbi.

11 recordsLinked to original sources

Finite-player Optimal Stopping Games: Randomization, $\alpha$-potentiality, and Learning

Finite-player nonzero-sum optimal stopping games typically lead to coupled equilibrium systems whose complexity grows rapidly with the number of players. We introduce an independently randomized formulation in which each stopping rule is represented by an adapted, nondecreasing cumulative stopping process. The canonical embedding preserves pure-profile payoffs, and a pure profile is a Nash equilibrium of the original game if and only if its embedding is a Nash equilibrium of the randomized game. We adopt the $\alpha$-potential approach to construct an $\alpha_N$-potential function, with the error $\alpha_N=O(N^{-1})$ under weak-interaction. We also identify an exact-potential subclass with a closed-form threshold equilibrium. For local stopped-status interactions, randomized payoffs admit a local stopped-mass representation, and potential maximization can be formulated as a multidimensional singular-control problem with local gradient constraints and a nonlocal condition for finite jumps. Under suitable regularity assumptions, we study the associated Hamilton-Jacobi-Bellman quasi-variational inequality and its regularity properties. For unknown model coefficients, we propose a bounded-intensity Potential-CT-DDPG learning algorithm. Numerical experiments closely match the analytical benchmark and yield estimated best-response improvements consistent with $N^{-1}$ scaling.

math.OC

Deep Learning for the Multiple Optimal Stopping Problem

This paper presents a novel deep learning framework for solving multiple optimal stopping problems in high dimensions. While deep learning has recently shown promise for single stopping problems, the multiple exercise case involves complex recursive dependencies that remain challenging. We address this by combining the Dynamic Programming Principle with neural network approximation of the value function. Unlike policy-search methods, our algorithm explicitly learns the value surface. We first consider the discrete-time problem and analyze neural network training error. We then turn to continuous problems and analyze the additional error due to the discretization of the underlying stochastic processes. Numerical experiments on high-dimensional American basket options and nonlinear utility maximization demonstrate that our method provides an efficient and scalable method for the multiple optimal stopping problem.

math.OC

Optimal control of Volterra integral diffusions and application to contract theory

This paper focuses on the optimal control of a class of stochastic Volterra integral equations. Here the coefficients are regular and not assumed to be of convolution type. We show that, under mild regularity assumptions, these equations can be lifted in a Sobolev space, whose Hilbertian structure allows us to attack the problem through a dynamic programming approach. We are then able to use the theory of viscosity solutions on Hilbert spaces to characterise the value function of the control problem as the unique solution of a parabolic equation on Sobolev space. We provide applications and examples to illustrate the usefulness of our theory, in particular for a certain class of time inconsistent principal agent problems. As a byproduct of our analysis, we introduce a new Markovian approximation for Volterra type dynamics.

math.PR

It\^o-Wentzell formulas for semimartingale conditional laws with applications to mean-field control

The present paper is an extension of Fadle-Touzi (2024). Following the same methodology, merely based on Taylor expansions, we establish the It\^o and It\^o-Wentzell formulae for flows of conditional distributions of general semimartingales, thus allowing for discontinuous semimartingales with possibly discontinuous flows of conditional marginals. We apply these results to derive the dynamic programming equations corresponding to mean field control problems with Poisson type common noise and mean field stopping problems with common noise.

math.PR

Markov approximation for controlled Hawkes Jump-Diffusions with general kernels

We present a Markov approximation for jump-diffusions whose jump part consists in a Hawkes process with intensity driven by a general (possibly non-monotone) kernel. Under minimal integrability conditions, the kernel can be approximated by a linear combination of exponential functions. This implies that Hawkes jump-diffusions can be approximated with Markov jump-diffusions. We illustrate the usefulness of this approximation by applying it to a class of stochastic control problems.

math.PR

It\=o and It\=o-Wentzell chain rule for flows of conditional laws of continuous semimartingales: an easy approach

We provide a general It\=o\,-Wentzell formula for a random field of maps on the Wasserstein space of probability measures, defined by continuous semimartingales, and evaluated along the flow of conditional distributions of another continuous semimartingale. Our method follows standard arguments of It\=o calculus, and thus bypasses the approximation by empirical measures commonly used in the existing literature. As an application, we derive the dynamic programming equation for a mean field stochastic control problem with common noise.

math.PR

Mean-field games of optimal stopping: master equation and weak equilibria

We are interested in the study of stochastic games for which each player faces an optimal stopping problem. In our setting, the players may interact through the criterion to optimise as well as through their dynamics. After briefly discussing the N-player game, we formulate the corresponding mean-field problem. In particular, we introduce a weak formulation of the game for which we are able to prove existence of Nash equilibria for a large class of criteria. We also prove that equilibria for the mean-field problem provide approximated Nash equilibria for the N-player game, and we formally derive the master equation associated with our mean-field game.

math.PR

A finite-dimensional approximation for partial differential equations on Wasserstein space

This paper presents a finite-dimensional approximation for a class of partial differential equations on the space of probability measures. These equations are satisfied in the sense of viscosity solutions. The main result states the convergence of the viscosity solutions of the finite-dimensional PDE to the viscosity solutions of the PDE on Wasserstein space, provided that uniqueness holds for the latter, and heavily relies on an adaptation of the Barles & Souganidis monotone scheme to our context, as well as on a key precompactness result for semimartingale measures. We illustrate this result with the example of the Hamilton-Jacobi-Bellman and Bellman-Isaacs equations arising in stochastic control and differential games, and propose an extension to the case of path-dependent PDEs.

math.PR

From finite population optimal stopping to mean field optimal stopping

This paper analyzes the convergence of the finite population optimal stopping problem towards the corresponding mean field limit. Building on the viscosity solution characterization of the mean field optimal stopping problem of our previous papers [Talbi, Touzi & Zhang 2021 & 2022], we prove the convergence of the value functions by adapting the Barles-Souganidis [1991] monotone scheme method to our context. We next characterize the optimal stopping policies of the mean field problem by the accumulation points of the finite population optimal stopping strategies. In particular, if the limiting problem has a unique optimal stopping policy, then the finite population optimal stopping strategies do converge towards this solution. As a by-product of our analysis, we provide an extension of the standard propagation of chaos to the context of stopped McKean-Vlasov diffusions.

math.PR

Viscosity solutions for obstacle problems on Wasserstein space

This paper is a continuation of our accompanying paper [Talbi, Touzi and Zhang (2021)], where we characterized the mean field optimal stopping problem by an obstacle equation on the Wasserstein space of probability measures, provided that the value function is smooth. Our purpose here is to establish this characterization under weaker regularity requirements. We shall define a notion of viscosity solutions for such equation, and prove existence, stability, and comparison principle.

math.PR

Dynamic programming equation for the mean field optimal stopping problem

We study the optimal stopping problem of McKean-Vlasov diffusions when the criterion is a function of the law of the stopped process. A remarkable new feature in this setting is that the stopping time also impacts the dynamics of the stopped process through the dependence of the coefficients on the law. The mean field stopping problem is introduced in weak formulation in terms of the joint marginal law of the stopped underlying process and the survival process. This specification satisfies a dynamic programming principle. The corresponding dynamic programming equation is an obstacle problem on the Wasserstein space, and is obtained by means of a general It\^o formula for flows of marginal laws of c\`adl\`ag semimartingales. Our verification result characterizes the nature of optimal stopping policies, highlighting the crucial need to randomized stopping. The effectiveness of our dynamic programming equation is illustrated by various examples including the mean-variance optimal stopping problem.

math.PR