Searcharxiv⌕ Search

arXiv · 2610.18376

Quantitative Convergence of Markov Equilibria for Time-Inconsistent Controlled Diffusions

Abstract

Time-inconsistent stochastic control admits a natural game-theoretic interpretation in which successive decision dates are represented by different selves. In the Markovian framework of Björk-Khapko-Murgoci, the corresponding continuous-time equilibrium HJB system can be motivated by discrete subgame-perfect games, but the general discrete-to-continuous passage is not automatic. We establish a quantitative convergence theorem for a smooth uniformly elliptic class in which the control may enter both drift and diffusion. Using the exact sample-and-hold transition law on each time step, we construct, near a verified continuous equilibrium branch, a unique regular discrete Markov subgame-perfect equilibrium and prove first-order convergence of the continuation objects in an anisotropic $C^{2+β}$ topology and of the equilibrium policies in $C^0$. The key stability mechanism is structural: the discrete first-order condition forces the differential feedback correction in the frozen linearization to be nilpotent, which yields mesh-uniform block estimates through a two-norm dyadic Schauder argument despite the second-order coupling caused by controlled volatility. We also formulate a conditional transfer principle for structured polynomial-growth classes, with error-space stability stated as a separate hypothesis.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sascha Desmettre. 2026-10-13. Quantitative Convergence of Markov Equilibria for Time-Inconsistent Controlled Diffusions. https://arxiv.org/abs/2610.18376

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Optimality conditions with cone-generalized convex vector functions

The object of investigation in this paper are generalized convex vector nonlinear programming problems with cone constraints. We prove that a quasiconvex vector function is pseudoconvex with respect to the same cone if and only if every vector critical point of the function is a weak global minimizer, a result, which is a natural extension of a known characterization of pseudoconvex scalar functions. We introduce a new notion of a Fréchet differentiable pseudoconvex problem. We derive that a problem with quasiconvex vector data is pseudoconvex if and only if every Fritz John vector critical point is a weakly efficient global solution. Thus, we generalize a lot of previous optimality conditions, concerning the scalar case and the multiobjective Paretian one. We also introduce the notion of a Fritz John cone-pseudoinvex vector problem. We prove that a problem with cone constraints is Fritz John pseudoinvex if and only if every vector critical point of Fritz John type is a weak global minimizer with respect to the considered cone..

math.OC↗

Projecting onto a Capped Rotated Second-Order Cone

We derive a closed-form expression for the projection onto a capped rotated second-order cone, a convex set that arises in perspective relaxations of nonlinear programs with binary indicator variables. The closed-form solution involves four distinct cases, one of which coincides with the classical projection onto a secondorder cone. The remaining three cases involve a nontrivial analysis in determining the necessary and sufficient conditions under which the solution lies on the intersection of the cone and a facet of a box. Beyond theoretical interest, this result enables the development of efficient projection-based first-order methods for optimization problems involving perspective reformulations. As an illustration, we consider the continuous perspective relaxation of sparse logistic regression, whose feasible region contains a Cartesian product of capped rotated second-order cones. Computational experiments on synthetic datasets demonstrate that accelerated projected-gradient, together with computing our closed-form projection at each iteration, improves on the running time of a general first-order conic solver while obtaining solutions of similar accuracy. These results highlight the practical value of the proposed projection formula for solving continuous relaxations of perspective formulations of mixed-integer second-order cone problems.

math.OC↗

Time-Invariant Linear Quadratic Regulators: A New Look

This paper demonstrates that linear ordinary differential equations with constant coefficients serve as the main building block for time-invariant linear quadratic regulators (LQRs). By applying the Euler-Lagrange equations to a flat output, i.e., to a basis of the free finitely-generated module over the commutative principal ideal ring of time-invariant linear differential operators with respect to the time derivation, this result emerges directly. In module-theoretic terms. The freeness of this structure corresponds to the classical Kalman controllability condition (M. Fliess, Some basic structural properties of generalized linear systems, Syst. Contr. Lett., 15 (1990) 391-396). Within this framework, the two-point boundary value problem, including the control variables, becomes analytically tractable, enabling the derivation of optimal time horizons, optimal parameter design, and rest-to-rest trajectories. Furthermore, a novel turnpike-like phenomenon is established via nonstandard analysis. The feedback loop is closed thanks to the HEOL approach (C. Join, E. Delaleau, M. Fliess, Flatness-based control revisited: The HEOL setting, C.R. Math., 362 (2024) 1693-1706), an extension of model-free control (MFC) that leverages intelligent controllers. Our viewpoint, which significantly simplifies the presentation by avoiding the conventional Kalman state-space representation, relies on foundational algebraic concepts that, while elementary, are rarely used in today's control theory. To aid intuition, some rudimentary examples are presented, most of which include computer simulations.

math.OC↗