arXiv subjects

Jiongmin Yong

Publications and source records attributed to Jiongmin Yong.

At least 55 records · Page 3Linked to original sources

arXiv2019

Indefinite Stochastic Linear-Quadratic Optimal Control Problems with Random Coefficients: Closed-Loop Representation of Open-Loop Optimal Controls

This paper is concerned with a stochastic linear-quadratic optimal control problem in a finite time horizon, where the coefficients of the control system are allowed to be random, and the weighting matrices in the cost functional are allowed to be random and indefinite. It is shown, with a Hilbert space approach, that for the existence of an open-loop optimal control, the convexity of the cost functional (with respect to the control) is necessary; and the uniform convexity, which is slightly stronger, turns out to be sufficient, which also leads to the unique solvability of the associated stochastic Riccati equation. Further, it is shown that the open-loop optimal control admits a closed-loop representation. In addition, some sufficient conditions are obtained for the uniform convexity of the cost functional, which are strictly general than the classical conditions that the weighting matrix-valued processes are positive (semi-)definite.

math.OC↗

arXiv2019

Optimization of the Principal Eigenvalue for Elliptic Operators

Maximization and minimization problems of the principle eigenvalue for divergence form second order elliptic operators with the Dirichlet boundary condition are considered. The principal eigen map of such elliptic operators is introduced and some basic properties of this map, including continuity, concavity, and differentiability with respect to the parameter in the diffusibility matrix, are established. For maximization problem, the admissible control set is convexified to get the existence of an optimal convexified relaxed solution. Whereas, for minimization problem, the relaxation of the problem under $H$-convergence is introduced to get an optimal $H$-relaxed solution for certain interesting special cases. Some necessary optimality conditions are presented for both problems and a couple of illustrative examples are presented as well.

math.OC↗

arXiv2019

Linear Quadratic Stochastic Optimal Control Problems with Operator Coefficients: Open-Loop Solutions

An optimal control problem is considered for linear stochastic differential equations with quadratic cost functional. The coefficients of the state equation and the weights in the cost functional are bounded operators on the spaces of square integrable random variables. The main motivation of our study is linear quadratic optimal control problems for mean-field stochastic differential equations. Open-loop solvability of the problem is investigated, which is characterized as the solvability of a system of linear coupled forward-backward stochastic differential equations (FBSDE, for short) with operator coefficients. Under proper conditions, the well-posedness of such an FBSDE is established, which leads to the existence of an open-loop optimal control. Finally, as an application of our main results, a general mean-field linear quadratic control problem in the open-loop case is solved.

math.OC↗

arXiv2018

Weak Closed-Loop Solvability of Stochastic Linear-Quadratic Optimal Control Problems

Recently it has been found that for a stochastic linear-quadratic optimal control problem (LQ problem, for short) in a finite horizon, open-loop solvability is strictly weaker than closed-loop solvability which is equivalent to the regular solvability of the corresponding Riccati equation. Therefore, when an LQ problem is merely open-loop solvable not closed-loop solvable, which is possible, the usual Riccati equation approach will fail to produce a state feedback representation of open-loop optimal controls. The objective of this paper is to introduce and investigate the notion of weak closed-loop optimal strategy for LQ problems so that its existence is equivalent to the open-loop solvability of the LQ problem. Moreover, there is at least one open-loop optimal control admitting a state feedback representation. Finally, we present an example to illustrate the procedure for finding weak closed-loop optimal strategies.

math.OC↗

arXiv2018

Backward Stochastic Volterra Integral Equations--- Representation of Adapted Solutions

For backward stochastic Volterra integral equations (BSVIEs, for short), under some mild conditions, the so-called adapted solutions or adapted M-solutions uniquely exist. However, satisfactory regularity of the solutions is difficult to obtain in general. Inspired by the decoupling idea of forward-backward stochastic differential equations, in this paper, for a class of BSVIEs, a representation of adapted M-solutions is established by means of the so-called representation partial differential equations and (forward) stochastic differential equations. Well-posedness of the representation partial differential equations are also proved in certain sense.

math.PR↗

arXiv2017

Equilibrium Strategies for Time-Inconsistent Stochastic Switching Systems

An optimal control problem is considered for a stochastic differential equation containing a state-dependent regime switching, with a recursive cost functional. Due to the non-exponential discounting in the cost functional, the problem is time-inconsistent in general. Therefore, instead of finding a global optimal control (which is not possible), we look for a time-consistent (approximately) locally optimal equilibrium strategy. Such a strategy can be represented through the solution to a system of partial differential equations, called an equilibrium Hamilton-Jacob-Bellman (HJB, for short) equation which is constructed via a sequence of multi-person differential games. A verification theorem is proved and, under proper conditions, the well-posedness of the equilibrium HJB equation is established as well.

math.OC↗

arXiv2017

Controlled Singular Volterra Integral Equations and Pontryagin Maximum Principle

This paper is concerned with a class of controlled singular Volterra integral equations, which could be used to describe problems involving memories. The well-known fractional order ordinary differential equations of the Riemann--Liouville or Caputo types are strictly special cases of the equations studied in this paper. Well-posedness and some regularity results in proper spaces are established for such kind of questions. For the associated optimal control problem, by using a Liapounoff's type theorem and the spike variation technique, we establish a Pontryagin's type maximum principle for optimal controls. Different from the existing literature, our method enables us to deal with the problem without assuming regularity conditions on the controls, the convexity condition on the control domain, and some additional unnecessary conditions on the nonlinear terms of the integral equation and the cost functional.

math.OC↗

arXiv2017

Second-Order Necessary Conditions for Optimal Control of Semilinear Elliptic Equations with Leading Term Containing Controls

An optimal control problem for a semilinear elliptic equation of divergence form is considered. Both the leading term and the semilinear term of the state equation contain the control. The well-known Pontryagin type maximum principle for the optimal controls is the first-order necessary condition. When such a first-order necessary condition is singular in some sense, certain type of the second-order necessary condition will come in naturally. The aim of this paper is to explore such kind of conditions for our optimal control problem.

math.OC↗

arXiv2016

Stochastic Linear Quadratic Optimal Control Problems in Infinite Horizon

This paper is concerned with stochastic linear quadratic (LQ, for short) optimal control problems in an infinite horizon with constant coefficients. It is proved that the non-emptiness of the admissible control set for all initial state is equivalent to the $L^2$-stabilizability of the control system, which in turn is equivalent to the existence of a positive solution to an algebraic Riccati equation (ARE, for short). Different from the finite horizon case, it is shown that both the open-loop and closed-loop solvabilities of the LQ problem are equivalent to the existence of a static stabilizing solution to the associated generalized ARE. Moreover, any open-loop optimal control admits a closed-loop representation. Finally, the one-dimensional case is worked out completely to illustrate the developed theory.

math.OC↗

arXiv2016

Linear Quadratic Stochastic Two-Person Nonzero-Sum Differential Games: Open-Loop and Closed-Loop Nash Equilibria

In this paper, we consider a linear quadratic stochastic two-person nonzero-sum differential game. Open-loop and closed-loop Nash equilibria are introduced. The existence of the former is characterized by the solvability of a system of forward-backward stochastic differential equations, and that of the latter is characterized by the solvability of a system of coupled symmetric Riccati differential equations. Sometimes, open-loop Nash equilibria admit a closed-loop representation, via the solution to a system of non-symmetric Riccati equations, which is different from the outcome of the closed-loop Nash equilibria in general. However, it is found that for the case of zero-sum differential games, the Riccati equation system for the closed-loop representation of open-loop saddle points coincides with that for the closed-loop saddle points, which leads to the conclusion that the closed-loop representation of open-loop saddle points is the outcome of the corresponding closed-loop saddle point as long as both exist. In particular, for linear quadratic optimal control problem, the closed-loop representation of open-loop optimal controls coincides with the outcome of the corresponding closed-loop optimal strategy, provided both exist.

math.OC↗

arXiv2016

Time-Inconsistent Recursive Stochastic Optimal Control Problems

In this paper, we study a time-inconsistent stochastic optimal control problem with a recursive cost functional by a multi-person hierarchical differential game approach. An equilibrium strategy of this problem is constructed and a corresponding equilibrium Hamilton-Jacobi-Bellman (HJB, for short) equation is established to characterize the associated equilibrium value function. Moreover, a well-posedness result of the equilibrium HJB equation is established under certain conditions.

math.OC↗

arXiv2016

Exact Controllability of Linear Stochastic Differential Equations and Related Problems

A notion of $L^p$-exact controllability is introduced for linear controlled (forward) stochastic differential equations, for which several sufficient conditions are established. Further, it is proved that the $L^p$-exact controllability, the validity of an observability inequality for the adjoint equation, the solvability of an optimization problem, and the solvability of an $L^p$-type norm optimal control problem are all equivalent.

math.OC↗

arXiv2016

Mean-Field Stochastic Linear Quadratic Optimal Control Problems: Closed-Loop Solvability

An optimal control problem is studied for a linear mean-field stochastic differential equation with a quadratic cost functional. The coefficients and the weighting matrices in the cost functional are all assumed to be deterministic. Closed-loop strategies are introduced, which require to be independent of initial states; and such a nature makes it very useful and convenient in applications. In this paper, the existence of an optimal closed-loop strategy for the system (also called the closed-loop solvability of the problem) is characterized by the existence of a regular solution to the coupled two (generalized) Riccati equations, together with some constraints on the adapted solution to a linear backward stochastic differential equation and a linear terminal value problem of an ordinary differential equation.

math.OC↗

arXiv2015

Forward-Backward Evolution Equations and Applications

Well-posedness is studied for a special system of two-point boundary value problem for evolution equations which is called a forward-backward evolution equation (FBEE, for short). Two approaches are introduced: A decoupling method with some brief discussions, and a method of continuation with some substantial discussions. For the latter, we have introduced Lyapunov operators for FBEEs, whose existence leads to some uniform a priori estimates for the mild solutions of FBEEs, which will be sufficient for the well-posedness. For some special cases, Lyapunov operators are constructed. Also, from some given Lyapunov operators, the corresponding solvable FBEEs are identified.

math.PR↗

arXiv2015

Open-Loop and Closed-Loop Solvabilities for Stochastic Linear Quadratic Optimal Control Problems

This paper is concerned with a stochastic linear quadratic (LQ, for short) optimal control problem. The notions of open-loop and closed-loop solvabilities are introduced. A simple example shows that these two solvabilities are different. Closed-loop solvability is established by means of solvability of the corresponding Riccati equation, which is implied by the uniform convexity of the quadratic cost functional. Conditions ensuring the convexity of the cost functional are discussed, including the issue that how negative the control weighting matrix-valued function R(s) can be. Finiteness of the LQ problem is characterized by the convergence of the solutions to a family of Riccati equations. Then, a minimizing sequence, whose convergence is equivalent to the open-loop solvability of the problem, is constructed. Finally, an illustrative example is presented.

math.OC↗

arXiv2014

Optimal Control Problems of Forward-Backward Stochastic Volterra Integral Equations

Optimal control problems of forward-backward stochastic Volterra integral equations (FBSVIEs in short) are formulated and studied. A general duality principle is established for linear backward stochastic integral equation and linear stochastic Fredholm-Volterra integral equation with mean-field. With the help of such a duality principle, together with some other new delicate and subtle skills, Pontryagin type maximum principles are proved for two optimal control problems of FBSVIEs.

math.OC↗

arXiv2014

Linear Quadratic Stochastic Two-Person Zero-Sum Differential Games in an Infinite Horizon

This paper is concerned with a linear quadratic stochastic two-person zero-sum differential game with constant coefficients in an infinite time horizon. Open-loop and closed-loop saddle points are introduced. The existence of closed-loop saddle points is characterized by the solvability of an algebraic Riccati equation with a certain stabilizing condition. A crucial result makes our approach work is the unique solvability of a class of linear backward stochastic differential equations in an infinite horizon.

math.OC↗

arXiv2014

Regularity Analysis for an Abstract System of Coupled Hyperbolic and Parabolic Equations

In this paper, we provide a complete regularity analysis for an abstract system of coupled hyperbolic and parabolic equations in a complex Hilbert space. We are able to decompose the unit square of the parameters into three parts where the semigroup associated with the system is analytic, of specific order Gevrey classes, and non-smoothing, respectively. Moreover, we will show that the orders of Gevrey class are sharp, under proper conditions.

math.AP↗