SearcharxivSearch

arXiv subjects

Jingrui Sun

Publications and source records attributed to Jingrui Sun.

At least 19 recordsLinked to original sources

Hautus-Type Criteria for Controllability and Stabilizability of Backward-Structured Stochastic Systems

This paper develops sharp Hautus-type criteria, stochastic counterparts of the classical Popov-Belevitch-Hautus test, for exact controllability and stabilizability of backwardstructured stochastic linear systems. The main finding is that the stochastic Hautus obstruction is not a left eigenvector, as in deterministic linear systems, nor an arbitrary symmetric eigenmatrix, but a positive semidefinite eigenmatrix of a Lyapunov-type operator. We prove that exact controllability is equivalent to the absence of such nonzero positive semidefinite eigenmatrices that are orthogonal to the control directions. This cone restriction is sharp: excluding all symmetric eigenmatrices with the same orthogonality property is sufficient but not necessary. We further show that stabilizability is characterized by the same cone-restricted Hautus condition imposed only on the nonstable spectral part of the Lyapunov-type operator. Thus the stochastic Hautus theory developed here is governed by a simultaneous spectral restriction and cone restriction. In addition to these criteria, we provide finite-rank and Gramian characterizations underlying exact controllability, establish the corresponding controllability decomposition, and show that exact controllability implies stabilizability.

math.OC

Partial Exponential Turnpike Phenomenon in Linear-Convex Optimal Control

This paper studies the long-time behavior of optimal solutions for a class of linear-convex optimal control problems. We focus on a partial exponential turnpike property, established without imposing controllability or stabilizability assumptions, where the turnpike behavior holds only for a subset of initial states. By means of a refined decomposition of the completely uncontrollable dynamics, we derive necessary structural conditions for the turnpike property and explicitly characterize the set of feasible initial states. For each such initial state, we associate a static optimization problem whose unique solution determines the corresponding steady state-control pair. For a class of convex stage cost functions, we prove the partial exponential turnpike property and quantify the convergence rate of the averaged finite-horizon optimal cost toward the steady optimal value.

math.OC

Near optimal controls for partially observed stochastic linear quadratic problems

In this article, we consider a stochastic linear quadratic control problem with partial observation. A near optimal control in the weak formulation is characterized. The main features of this paper are the presence of the control in the diffusion term of the state equation, the circular dependence between the control process and the filtration generated by the observation, and the observation process contains an unbounded drift term. We address these difficulties by first restricting the control to a smaller domain, which enables us to apply the Girsanov theorem using a conditional argument and thereby break the circular dependence. Subsequently, we study the restricted problem using a non-standard variation method. The desired near optimal control is then obtained by taking the limit of an approximating sequence.

math.OC

Periodic Exponential Turnpike Phenomenon in Mean-Field Stochastic Linear-Quadratic Optimal Control

The paper establishes the exponential turnpike property for a class of mean-field stochastic linear-quadratic (LQ) optimal control problems with periodic coefficients. It first introduces the concepts of stability, stabilizability, and detectability for stochastic linear systems. Then, the long-term behavior of the associated Riccati equations is analyzed under stabilizability and detectability conditions.Subsequently, a periodic mean-field stochastic LQ problem is formulated and solved. Finally, a linear transformation of the periodic extension of its optimal pair is shown to be the turnpike limit of the initial optimal control problem.

math.OC

Long-Time Behavior of Zero-Sum Linear-Quadratic Stochastic Differential Games

The paper investigates the long-time behavior of zero-sum linear-quadratic stochastic differential games, aiming to demonstrate that, under appropriate conditions, both the saddle strategy and the optimal state process exhibit the exponential turnpike property. Namely, for the majority of the time horizon, the distributions of the saddle strategy and the optimal state process closely stay near certain (time-invariant) distributions $\nu_1^*$, $\nu_2^*$ and $\mu^*$, respectively. Additionally, as a byproduct, we solve the infinite horizon version of the differential game and derive closed-loop representations for its open-loop saddle strategy, which has not been proved in the literature.

math.OC

Turnpike Properties for Mean-Field Linear-Quadratic Optimal Control Problems

This paper is concerned with an optimal control problem for a mean-field linear stochastic differential equation with a quadratic functional in the infinite time horizon. Under suitable conditions, including the stabilizability, the (strong) exponential, integral, and mean-square turnpike properties for the optimal pair are established. The keys are to correctly formulate the corresponding static optimization problem and find the equations determining the correction processes. These have revealed the main feature of the stochastic problems which are significantly different from the deterministic version of the theory.

math.OC

Stochastic Linear-Quadratic Optimal Control with Partial Observation

The paper studies a class of quadratic optimal control problems for partially observable linear dynamical systems. In contrast to the full information case, the control is required to be adapted to the filtration generated by the observation system, which in turn is influenced by the control. The variation method fails in this case due to the fact that the filtration is not fixed. To overcome the difficulty, we use the orthogonal decomposition of the state process to write the cost functional as the sum of two parts: one is a functional of the control and the filtering process and the other part is independent of the choice of the control. The first part possesses a mathematical structure similar to the full information problem. By completing the square, it is shown that the optimal control is given by a feedback representation via the filtering process. The optimal value is also obtained explicitly.

math.OC

General Indefinite Backward Stochastic Linear-Quadratic Optimal Control Problems

A general backward stochastic linear-quadratic optimal control problem is studied, in which both the state equation and the cost functional contain the nonhomogeneous terms. The main feature of the problem is that the weighting matrices in the cost functional are allowed to be indefinite and cross-product terms in the control and the state processes are present. Necessary and sufficient conditions for the solvability of the problem are obtained, and a characterization of the optimal control in terms of forward-backward stochastic differential equations is derived. By a Riccati equation approach, a general procedure for constructing optimal controls is developed and the value function is obtained explicitly.

math.OC

Turnpike Properties for Stochastic Linear-Quadratic Optimal Control Problems

This paper analyzes the limiting behavior of stochastic linear-quadratic optimal control problems in finite time horizon $[0,T]$ as $T\rightarrow\infty$. The so-called turnpike properties are established for such problems, under stabilizability condition which is weaker than the controllability, normally imposed in the similar problem for ordinary differential systems. In dealing with the turnpike problem, a crucial issue is to determine the corresponding static optimization problem. Intuitively mimicking deterministic situations, it seems to be natural to include both the drift and the diffusion as constraints in the static optimization problem. However, this would lead us to a wrong direction. It is found that the correct static problem should contain the diffusion as a part of the objective function, which reveals a deep feature of the stochastic turnpike problem.

math.OC

Zero-Sum Stackelberg Stochastic Linear-Quadratic Differential Games

The paper is concerned with a zero-sum Stackelberg stochastic linear-quadratic (LQ, for short) differential game over finite horizons. Under a fairly weak condition, the Stackelberg equilibrium is explicitly obtained by first solving a forward stochastic LQ optimal control problem (SLQ problem, for short) and then a backward SLQ problem. Two Riccati equations are derived in constructing the Stackelberg equilibrium. An interesting finding is that the difference of these two Riccati equations coincides with the Riccati equation associated with the zero-sum Nash stochastic LQ differential game, which implies that the Stackelberg equilibrium and the Nash equilibrium are actually identical. Consequently, the Stackelberg equilibrium admits a linear state feedback representation, and the Nash game can be solved in a leader-follower manner.

math.OC

Mean-Field Linear-Quadratic Stochastic Differential Games

The paper is concerned with two-person zero-sum mean-field linear-quadratic stochastic differential games over finite horizons. By a Hilbert space method, a necessary condition and a sufficient condition are derived for the existence of an open-loop saddle point. It is shown that under the sufficient condition, the associated two Riccati equations admit unique strongly regular solutions, in terms of which the open-loop saddle point can be represented as a linear feedback of the current state. When the game only satisfies the necessary condition, an approximate sequence is constructed by solving a family of Riccati equations and closed-loop systems.The convergence of the approximate sequence turns out to be equivalent to the open-loop solvability of the game, and the limit is exactly an open-loop saddle point, provided that the game is open-loop solvable.

math.OC

Linear-Quadratic Optimal Control for Backward Stochastic Differential Equations with Random Coefficients

This paper is concerned with a linear-quadratic (LQ, for short) optimal control problem for backward stochastic differential equations (BSDEs, for short), where the coefficients of the backward control system and the weighting matrices in the cost functional are allowed to be random. By a variational method, the optimality system, which is a coupled linear forward-backward stochastic differential equation (FBSDE, for short), is derived, and by a Hilbert space method, the unique solvability of the optimality system is obtained. In order to construct the optimal control, a new stochastic Riccati-type equation is introduced. It is proved that an adapted solution (possibly non-unique) to the Riccati equation exists and decouples the optimality system. With this solution, the optimal control is obtained in an explicit way.

math.OC

Indefinite Backward Stochastic Linear-Quadratic Optimal Control Problems

This paper is concerned with a backward stochastic linear-quadratic (LQ, for short) optimal control problem with deterministic coefficients. The weighting matrices are allowed to be indefinite, and cross-product terms in the control and state processes are present in the cost functional. Based on a Hilbert space method, necessary and sufficient conditions are derived for the solvability of the problem, and a general approach for constructing optimal controls is developed. The crucial step in this construction is to establish the solvability of a Riccati-type equation, which is accomplished under a fairly weak condition by investigating the connection with forward stochastic LQ optimal control problems.

math.OC

Two-Person Zero-Sum Stochastic Linear-Quadratic Differential Games

The paper studies the open-loop saddle point and the open-loop lower and upper values, as well as their relationship for two-person zero-sum stochastic linear-quadratic (LQ, for short) differential games with deterministic coefficients. It derives a necessary condition for the finiteness of the open-loop lower and upper values and a sufficient condition for the existence of an open-loop saddle point. It turns out that under the sufficient condition, a strongly regular solution to the associated Riccati equation uniquely exists, in terms of which a closed-loop representation is further established for the open-loop saddle point. Examples are presented to show that the finiteness of the open-loop lower and upper values does not ensure the existence of an open-loop saddle point in general. But for the classical deterministic LQ game, these two issues are equivalent and both imply the solvability of the Riccati equation, for which an explicit representation of the solution is obtained.

math.OC

Recursive Utility Processes, Dynamic Risk Measures and Quadratic Backward Stochastic Volterra Integral Equations

For an $\cF_T$-measurable payoff of a European type contingent claim, the recursive utility process/dynamic risk measure can be described by the adapted solution to a backward stochastic differential equation (BSDE). However, for an $\cF_T$-measurable stochastic process (called a position process, not necessarily $\dbF$-adapted), mimicking BSDE's approach will lead to a time-inconsistent recursive utility/dynamic risk measure. It is found that a more proper approach is to use the adapted solution to a backward stochastic Volterra integral equation (BSVIE). The corresponding notions are called equilibrium recursive utility and equilibrium dynamic risk measure, respectively. Motivated by this, the current paper is concerned with BSVIEs whose generators are allowed to have quadratic growth (in $Z(t,s)$). The existence and uniqueness for both the so-called adapted solutions and adapted M-solutions are established. A comparison theorem for adapted solutions to the so-called Type-I BSVIEs is established as well. As consequences of these results, some general continuous-time equilibrium dynamic risk measures and equilibrium recursive utility processes are constructed.

math.PR

Indefinite Stochastic Linear-Quadratic Optimal Control Problems with Random Coefficients: Closed-Loop Representation of Open-Loop Optimal Controls

This paper is concerned with a stochastic linear-quadratic optimal control problem in a finite time horizon, where the coefficients of the control system are allowed to be random, and the weighting matrices in the cost functional are allowed to be random and indefinite. It is shown, with a Hilbert space approach, that for the existence of an open-loop optimal control, the convexity of the cost functional (with respect to the control) is necessary; and the uniform convexity, which is slightly stronger, turns out to be sufficient, which also leads to the unique solvability of the associated stochastic Riccati equation. Further, it is shown that the open-loop optimal control admits a closed-loop representation. In addition, some sufficient conditions are obtained for the uniform convexity of the cost functional, which are strictly general than the classical conditions that the weighting matrix-valued processes are positive (semi-)definite.

math.OC

Mean-Field Stochastic Linear-Quadratic Optimal Control Problems: Weak Closed-Loop Solvability

This paper is concerned with mean-field stochastic linear-quadratic (MF-SLQ, for short) optimal control problems with deterministic coefficients. The notion of weak closed-loop optimal strategy is introduced. It is shown that the open-loop solvability is equivalent to the existence of a weak closed-loop optimal strategy. Moreover, when open-loop optimal controls exist, there is at least one of them admitting a state feedback representation, which is the outcome of a weak closed-loop optimal strategy. Finally, an example is presented to illustrate the procedure for finding weak closed-loop optimal strategies.

math.OC

Optimal Control for Controllable Stochastic Linear Systems

This paper is concerned with a constrained stochastic linear-quadratic optimal control problem, in which the terminal state is fixed and the initial state is constrained to lie in a stochastic linear manifold. The controllability of stochastic linear systems is studied. Then the optimal control is explicitly obtained by considering a parameterized unconstrained backward LQ problem and an optimal parameter selection problem. A notable feature of our results is that, instead of solving an equation involving derivatives with respect to the parameter, the optimal parameter is characterized by an algebraic equation.

math.OC