arXiv subjects

Michael Harlan

Publications and source records attributed to Michael Harlan.

3 recordsLinked to original sources

arXiv2020

Switched Optimal Control and Dwell Time Constraints: A Preliminary Study

Most modern control systems are switched, meaning they have continuous as well as discrete decision variables. Switched systems often have constraints called dwell-time constraints (e.g., cycling constraints in a heat pump) on the switching rate. This paper introduces an embedding-based-method to solve optimal control problems that have both discrete and continuous decision variables. Unlike existing methods, the developed technique can heuristically incorporate dwell-time constraints via an auxiliary cost, while also preserving other state and control constrains of the problem. Simulations results for a switched optimal control problem with and without the auxiliary cost showcase the utility of the developed method.

eess.SY↗

arXiv2019

Output-feedback online optimal control for a class of nonlinear systems

In this paper an output-feedback model-based reinforcement learning (MBRL) method for a class of second-order nonlinear systems is developed. The control technique uses exact model knowledge and integrates a dynamic state estimator within the model-based reinforcement learning framework to achieve output-feedback MBRL. Simulation results demonstrate the efficacy of the developed method.

eess.SY↗

arXiv2018

Online inverse reinforcement learning for nonlinear systems

This paper focuses on the development of an online inverse reinforcement learning (IRL) technique for a class of nonlinear systems. The developed approach utilizes observed state and input trajectories, and determines the unknown cost function and the unknown value function online. A parameter estimation technique is utilized to allow the developed IRL technique to determine the cost function weights in the presence of unknown dynamics. Simulation results are presented for a nonlinear system showing convergence of both unknown reward function weights and unknown dynamics.

eess.SY↗