arXiv subjects

Jingrui Sun

Publications and source records attributed to Jingrui Sun.

29 records · Page 2Linked to original sources

arXiv2019

Optimal Control for Controllable Stochastic Linear Systems

This paper is concerned with a constrained stochastic linear-quadratic optimal control problem, in which the terminal state is fixed and the initial state is constrained to lie in a stochastic linear manifold. The controllability of stochastic linear systems is studied. Then the optimal control is explicitly obtained by considering a parameterized unconstrained backward LQ problem and an optimal parameter selection problem. A notable feature of our results is that, instead of solving an equation involving derivatives with respect to the parameter, the optimal parameter is characterized by an algebraic equation.

math.OC↗

arXiv2018

Weak Closed-Loop Solvability of Stochastic Linear-Quadratic Optimal Control Problems

Recently it has been found that for a stochastic linear-quadratic optimal control problem (LQ problem, for short) in a finite horizon, open-loop solvability is strictly weaker than closed-loop solvability which is equivalent to the regular solvability of the corresponding Riccati equation. Therefore, when an LQ problem is merely open-loop solvable not closed-loop solvable, which is possible, the usual Riccati equation approach will fail to produce a state feedback representation of open-loop optimal controls. The objective of this paper is to introduce and investigate the notion of weak closed-loop optimal strategy for LQ problems so that its existence is equivalent to the open-loop solvability of the LQ problem. Moreover, there is at least one open-loop optimal control admitting a state feedback representation. Finally, we present an example to illustrate the procedure for finding weak closed-loop optimal strategies.

math.OC↗

arXiv2017

Linear Quadratic Optimal Control Problems with Fixed Terminal States and Integral Quadratic Constraints

This paper is concerned with a linear quadratic (LQ, for short) optimal control problem with fixed terminal states and integral quadratic constraints. A Riccati equation with infinite terminal value is introduced, which is uniquely solvable and whose solution can be approximated by the solution for a suitable unconstrained LQ problem with penalized terminal state. Using results from duality theory, the optimal control is explicitly derived by solving the Riccati equation together with an optimal parameter selection problem. It turns out that the optimal control is not only a feedback of the current state, but also a feedback of the target (terminal state). Some examples are presented to illustrate the theory developed.

math.OC↗

arXiv2016

Stochastic Linear Quadratic Optimal Control Problems in Infinite Horizon

This paper is concerned with stochastic linear quadratic (LQ, for short) optimal control problems in an infinite horizon with constant coefficients. It is proved that the non-emptiness of the admissible control set for all initial state is equivalent to the $L^2$-stabilizability of the control system, which in turn is equivalent to the existence of a positive solution to an algebraic Riccati equation (ARE, for short). Different from the finite horizon case, it is shown that both the open-loop and closed-loop solvabilities of the LQ problem are equivalent to the existence of a static stabilizing solution to the associated generalized ARE. Moreover, any open-loop optimal control admits a closed-loop representation. Finally, the one-dimensional case is worked out completely to illustrate the developed theory.

math.OC↗

arXiv2016

Linear Quadratic Optimal Control Problems for Mean-Field Backward Stochastic Differential Equations

This paper is concerned with linear quadratic optimal control problems for mean-field backward stochastic differential equations (MF-BSDEs, for short) with deterministic coefficients. The optimality system, which is a linear mean-field forward-backward stochastic differential equation with constraint, is obtained by a variational method. By decoupling the optimality system, two coupled Riccati equations and an MF-BSDE are derived. It turns out that the coupled two Riccati equations are uniquely solvable. Then a complete and explicit representation is obtained for the optimal control.

math.OC↗

arXiv2016

Linear Quadratic Stochastic Two-Person Nonzero-Sum Differential Games: Open-Loop and Closed-Loop Nash Equilibria

In this paper, we consider a linear quadratic stochastic two-person nonzero-sum differential game. Open-loop and closed-loop Nash equilibria are introduced. The existence of the former is characterized by the solvability of a system of forward-backward stochastic differential equations, and that of the latter is characterized by the solvability of a system of coupled symmetric Riccati differential equations. Sometimes, open-loop Nash equilibria admit a closed-loop representation, via the solution to a system of non-symmetric Riccati equations, which is different from the outcome of the closed-loop Nash equilibria in general. However, it is found that for the case of zero-sum differential games, the Riccati equation system for the closed-loop representation of open-loop saddle points coincides with that for the closed-loop saddle points, which leads to the conclusion that the closed-loop representation of open-loop saddle points is the outcome of the corresponding closed-loop saddle point as long as both exist. In particular, for linear quadratic optimal control problem, the closed-loop representation of open-loop optimal controls coincides with the outcome of the corresponding closed-loop optimal strategy, provided both exist.

math.OC↗

arXiv2016

Mean-Field Stochastic Linear Quadratic Optimal Control Problems: Closed-Loop Solvability

An optimal control problem is studied for a linear mean-field stochastic differential equation with a quadratic cost functional. The coefficients and the weighting matrices in the cost functional are all assumed to be deterministic. Closed-loop strategies are introduced, which require to be independent of initial states; and such a nature makes it very useful and convenient in applications. In this paper, the existence of an optimal closed-loop strategy for the system (also called the closed-loop solvability of the problem) is characterized by the existence of a regular solution to the coupled two (generalized) Riccati equations, together with some constraints on the adapted solution to a linear backward stochastic differential equation and a linear terminal value problem of an ordinary differential equation.

math.OC↗

arXiv2015

Mean-Field Stochastic Linear Quadratic Optimal Control Problems: Open-Loop Solvabilities

This paper is concerned with a mean-field linear quadratic (LQ, for short) optimal control problem with deterministic coefficients. It is shown that convexity of the cost functional is necessary for the finiteness of the mean-field LQ problem, whereas uniform convexity of the cost functional is sufficient for the open-loop solvability of the problem. By considering a family of uniformly convex cost functionals, a characterization of the finiteness of the problem is derived and a minimizing sequence, whose convergence is equivalent to the open-loop solvability of the problem, is constructed. Then, it is proved that the uniform convexity of the cost functional is equivalent to the solvability of two coupled differential Riccati equations and the unique open-loop optimal control admits a state feedback representation in the case that the cost functional is uniformly convex. Finally, some examples are presented to illustrate the theory developed.

math.OC↗

arXiv2015

Open-Loop and Closed-Loop Solvabilities for Stochastic Linear Quadratic Optimal Control Problems

This paper is concerned with a stochastic linear quadratic (LQ, for short) optimal control problem. The notions of open-loop and closed-loop solvabilities are introduced. A simple example shows that these two solvabilities are different. Closed-loop solvability is established by means of solvability of the corresponding Riccati equation, which is implied by the uniform convexity of the quadratic cost functional. Conditions ensuring the convexity of the cost functional are discussed, including the issue that how negative the control weighting matrix-valued function R(s) can be. Finiteness of the LQ problem is characterized by the convergence of the solutions to a family of Riccati equations. Then, a minimizing sequence, whose convergence is equivalent to the open-loop solvability of the problem, is constructed. Finally, an illustrative example is presented.

math.OC↗

arXiv2014

Linear Quadratic Stochastic Two-Person Zero-Sum Differential Games in an Infinite Horizon

This paper is concerned with a linear quadratic stochastic two-person zero-sum differential game with constant coefficients in an infinite time horizon. Open-loop and closed-loop saddle points are introduced. The existence of closed-loop saddle points is characterized by the solvability of an algebraic Riccati equation with a certain stabilizing condition. A crucial result makes our approach work is the unique solvability of a class of linear backward stochastic differential equations in an infinite horizon.

math.OC↗

arXiv2014

Linear Quadratic Stochastic Differential Games: Open-Loop and Closed-Loop Saddle Points

In this paper, we consider a linear quadratic stochastic two-person zero-sum differential game. The controls for both players are allowed to appear in both drift and diffusion of the state equation. The weighting matrices in the performance functional are not assumed to be definite/non-singular. A necessary and sufficient condition for the existence of a closed-loop saddle point is established in terms of the solvability of a Riccati differential equation with certain regularity. It is possible that the closed-loop saddle point fails to exist, and at the same time, the corresponding Riccati equation admits a solution (which does not have needed regularity). Also, we will indicate that the solution of the Riccati equation may be non-unique.

math.OC↗