arXiv subjects

Junlin Xiong

Publications and source records attributed to Junlin Xiong.

24 records · Page 2Linked to original sources

arXiv2020

Model-free optimal control of discrete-time systems with additive and multiplicative noises

This paper investigates the optimal control problem for a class of discrete-time stochastic systems subject to additive and multiplicative noises. A stochastic Lyapunov equation and a stochastic algebra Riccati equation are established for the existence of the optimal admissible control policy. A model-free reinforcement learning algorithm is proposed to learn the optimal admissible control policy using the data of the system states and inputs without requiring any knowledge of the system matrices. It is proven that the learning algorithm converges to the optimal admissible control policy. The implementation of the model-free algorithm is based on batch least squares and numerical average. The proposed algorithm is illustrated through a numerical example, which shows our algorithm outperforms other policy iteration algorithms.

eess.SY↗

arXiv2020

Distributed Networked Controller Design for Large-scale Systems under Round-Robin Communication Protocol

This paper studies the distributed L2-gain control problem for continuous-time large-scale systems under Round-Robin communication protocol. In this protocol, each sub-controller obtains its own subsystem's state information continuously, while communicating with neighbors at discrete-time instants periodically. Distributed controllers are designed such that the closed-loop system is exponentially stable and that the prescribed L2-gain is satisfied. The design condition is obtained based on a time-delay approach and given in terms of linear matrix inequalities. Finally, three numerical examples are presented to illustrate the efficiency of the proposed scheme.

eess.SY↗

arXiv2019

Tracking Control of Nonlinear Networked and Quantized Control Systems with Communication Delays

This paper studies the tracking control problem of nonlinear networked and quantized control systems (NQCSs) with communication delays. The desired trajectory is generated by a reference system. The communication network is to guarantee the information transmission among the plant, the reference system and the controller. The communication network also brings about some undesired issues like time-varying transmission intervals, time-varying transmission delays, packet dropouts, scheduling and quantization effects, which lead to non-vanishing network-induced errors and affect the tracking performances. As a result, we develop a general hybrid system model for NQCSs with all aforementioned issues. Based on the Lyapunov approach, sufficient conditions are established to guarantee the stability of the tracking error with respect to the non-vanishing network-induced errors. The obtained conditions lead to a tradeoff between the maximally allowable transmission interval and the maximally allowable delay. Furthermore, the existence of Lyapunov functions satisfying the obtained conditions is studied. For specific time-scheduling protocols (e.g., Round-Robin protocol and Try-Once-Discard protocol) and quantizers (e.g., zoom quantizer and box quantizer), Lyapunov functions are constructed explicitly. Finally, a numerical example is presented to demonstrate the developed theory.

eess.SY↗

arXiv2013

Local Mode Dependent Decentralized $H_{\infty}$ Control of Uncertain Markovian Jump Large-scale Systems

This paper considers the problem of robust $H_{\infty}$ control using decentralized state feedback controllers for a class of large-scale systems with Markov jump parameters. A sufficient condition is developed to design controllers using local system states and local system operation modes. The sufficient condition is given in terms of rank constrained linear matrix inequalities. An illustrative numerical example is given to demonstrate the developed theory.

eess.SY↗

arXiv2013

Stability Analysis of Continuous-Time Switched Systems with a Random Switching Signal

This paper is concerned with the stability analysis of continuous-time switched systems with a random switching signal. The switching signal manifests its characteristics with that the dwell time in each subsystem consists of a fixed part and a random part. The stochastic stability of such switched systems is studied using a Lyapunov approach. A necessary and sufficient condition is established in terms of linear matrix inequalities. The effect of the random switching signal on system stability is illustrated by a numerical example and the results coincide with our intuition.

eess.SY↗

arXiv2013

Robust Decentralized Stabilization of Markovian Jump Large-Scale Systems: A Neighboring Mode Dependent Control Approach

This paper is concerned with the decentralized stabilization problem for a class of uncertain large-scale systems with Markovian jump parameters. The controllers use local subsystem states and neighboring mode information to generate local control inputs. A sufficient condition involving rank constrained linear matrix inequalities is proposed for the design of such controllers. A numerical example is given to illustrate the developed theory.

eess.SY↗