arXiv subjects

Julian Berberich

Publications and source records attributed to Julian Berberich.

71 records · Page 4Linked to original sources

arXiv2021

Data-Driven Control of Nonlinear Systems: Beyond Polynomial Dynamics

In this paper, we present a data-driven controller design method for continuous-time nonlinear systems, using no model knowledge but only measured data affected by noise. While most existing approaches focus on systems with polynomial dynamics, our approach allows to design controllers for unknown systems with rational or general non-polynomial dynamics. We first derive a data-driven parametrization of unknown nonlinear systems with rational dynamics. By applying robust control techniques to this parametrization, we obtain sum-of-squares based criteria for designing controllers with closed-loop robust stability and performance guarantees for all systems which are consistent with the measured data and the assumed noise bound. We then apply this approach to control systems whose dynamics are linear in general non-polynomial basis functions by transforming them into polynomial systems. Finally, we apply the developed approaches to numerical examples.

eess.SY↗

arXiv2021

Data-driven model predictive control: closed-loop guarantees and experimental results

We provide a comprehensive review and practical implementation of a recently developed model predictive control (MPC) framework for controlling unknown systems using only measured data and no explicit model knowledge. Our approach relies on an implicit system parametrization from behavioral systems theory based on one measured input-output trajectory. The presented MPC schemes guarantee closed-loop stability for unknown linear time-invariant (LTI) systems, even if the data are affected by noise. Further, we extend this MPC framework to control unknown nonlinear systems by continuously updating the data-driven system representation using new measurements. The simple and intuitive applicability of our approach is demonstrated with a nonlinear four-tank system in simulation and in an experiment.

eess.SY↗

arXiv2021

On the design of terminal ingredients for data-driven MPC

We present a model predictive control (MPC) scheme to control linear time-invariant systems using only measured input-output data and no model knowledge. The scheme includes a terminal cost and a terminal set constraint on an extended state containing past input-output values. We provide an explicit design procedure for the corresponding terminal ingredients that only uses measured input-output data. Further, we prove that the MPC scheme based on these terminal ingredients exponentially stabilizes the desired setpoint in closed loop. Finally, we illustrate the advantages over existing data-driven MPC approaches with a numerical example.

math.OC↗

arXiv2021

Robust Dual Control based on Gain Scheduling

We present a novel strategy for robust dual control of linear time-invariant systems based on gain scheduling with performance guarantees. This work relies on prior results of determining uncertainty bounds of system parameters estimated through exploration. Existing approaches are unable to account for changes of the mean of system parameters in the exploration phase and thus to accurately capture the dual effect. We address this limitation by selecting the future (uncertain) mean as a scheduling variable in the control design. The result is a semi-definite program-based design that computes a suitable exploration strategy and a robust gain-scheduled controller with probabilistic quadratic performance bounds after the exploration phase.

eess.SY↗

arXiv2021

Data-driven analysis and control of continuous-time systems under aperiodic sampling

We investigate stability analysis and controller design of unknown continuous-time systems under state-feedback with aperiodic sampling, using only noisy data but no model knowledge. We first derive a novel data-dependent parametrization of all linear time-invariant continuous-time systems which are consistent with the measured data and the assumed noise bound. Based on this parametrization and by combining tools from robust control theory and the time-delay approach to sampled-data control, we compute lower bounds on the maximum sampling interval (MSI) for closed-loop stability under a given state-feedback gain, and beyond that, we design controllers which exhibit a possibly large MSI. Our methods guarantee the stability properties robustly for all systems consistent with the measured data. As a technical contribution, the proposed approach embeds existing methods for sampled-data control into a general robust control framework, which can be directly extended to model-based robust controller design for uncertain time-delay systems under general uncertainty descriptions.

math.OC↗

arXiv2021

Offset-free setpoint tracking using neural network controllers

In this paper, we present a method to analyze local and global stability in offset-free setpoint tracking using neural network controllers and we provide ellipsoidal inner approximations of the corresponding region of attraction. We consider a feedback interconnection of a linear plant in connection with a neural network controller and an integrator, which allows for offset-free tracking of a desired piecewise constant reference that enters the controller as an external input. Exploiting the fact that activation functions used in neural networks are slope-restricted, we derive linear matrix inequalities to verify stability using Lyapunov theory. After stating a global stability result, we present less conservative local stability conditions (i) for a given reference and (ii) for any reference from a certain set. The latter result even enables guaranteed tracking under setpoint changes using a reference governor which can lead to a significant increase of the region of attraction. Finally, we demonstrate the applicability of our analysis by verifying stability and offset-free tracking of a neural network controller that was trained to stabilize a linearized inverted pendulum.

eess.SY↗

arXiv2021

Data-Driven Controller Design via Finite-Horizon Dissipativity

Given one open-loop measured trajectory of a single-input single-output discrete-time linear time-invariant system, we present a framework for data-driven controller design for closed-loop finite-horizon dissipativity. First, we parametrize all closed-loop trajectories using the given data of the plant and a model of the controller. We then provide an approach to validate the controller by verifying closed-loop dissipativity in the standard feedback loop based on this parametrization. We use these conditions to design controllers leading to closed-loop dissipativity based on a quadratic matrix inequality feasibility problem. Finally, the results are illustrated with a simulation example.

eess.SY↗

arXiv2021

Data-Driven Tracking MPC for Changing Setpoints

We propose a data-driven tracking model predictive control (MPC) scheme to control unknown discrete-time linear time-invariant systems. The scheme uses a purely data-driven system parametrization to predict future trajectories based on behavioral systems theory. The control objective is tracking of a given input-output setpoint. We prove that this setpoint is exponentially stable for the closed loop of the proposed MPC, if it is reachable by the system dynamics and constraints. For an unreachable setpoint, our scheme guarantees closed-loop exponential stability of the optimal reachable equilibrium. Moreover, in case the system dynamics are known, the presented results extend the existing results for model-based setpoint tracking to the case where the stage cost is only positive semidefinite in the state. The effectiveness of the proposed approach is illustrated by means of a practical example.

eess.SY↗

arXiv2021

Data-Driven Model Predictive Control with Stability and Robustness Guarantees

We propose a robust data-driven model predictive control (MPC) scheme to control linear time-invariant (LTI) systems. The scheme uses an implicit model description based on behavioral systems theory and past measured trajectories. In particular, it does not require any prior identification step, but only an initially measured input-output trajectory as well as an upper bound on the order of the unknown system. First, we prove exponential stability of a nominal data-driven MPC scheme with terminal equality constraints in the case of no measurement noise. For bounded additive output measurement noise, we propose a robust modification of the scheme, including a slack variable with regularization in the cost. We prove that the application of this robust MPC scheme in a multi-step fashion leads to practical exponential stability of the closed loop w.r.t. the noise level. The presented results provide the first (theoretical) analysis of closed-loop properties, resulting from a simple, purely data-driven MPC scheme.

eess.SY↗

arXiv2021

Robust Constraint Satisfaction in Data-Driven MPC

We propose a purely data-driven model predictive control (MPC) scheme to control unknown linear time-invariant systems with guarantees on stability and constraint satisfaction in the presence of noisy data. The scheme predicts future trajectories based on data-dependent Hankel matrices, which span the full system behavior if the input is persistently exciting. This paper extends previous work on data-driven MPC by including a suitable constraint tightening which ensures that the closed-loop trajectory satisfies desired pointwise-in-time output constraints. Furthermore, we provide estimation procedures to compute system constants related to controllability and observability, which are required to implement the constraint tightening. The practicality of the proposed approach is illustrated via a numerical example.

eess.SY↗

arXiv2021

Robust and optimal predictive control of the COVID-19 outbreak

We investigate adaptive strategies to robustly and optimally control the COVID-19 pandemic via social distancing measures based on the example of Germany. Our goal is to minimize the number of fatalities over the course of two years without inducing excessive social costs. We consider a tailored model of the German COVID-19 outbreak with different parameter sets to design and validate our approach. Our analysis reveals that an open-loop optimal control policy can significantly decrease the number of fatalities when compared to simpler policies under the assumption of exact model knowledge. In a more realistic scenario with uncertain data and model mismatch, a feedback strategy that updates the policy weekly using model predictive control (MPC) leads to a reliable performance, even when applied to a validation model with deviant parameters. On top of that, we propose a robust MPC-based feedback policy using interval arithmetic that adapts the social distancing measures cautiously and safely, thus leading to a minimum number of fatalities even if measurements are inaccurate and the infection rates cannot be precisely specified by social distancing. Our theoretical findings support various recent studies by showing that 1) adaptive feedback strategies are required to reliably contain the COVID-19 outbreak, 2) well-designed policies can significantly reduce the number of fatalities compared to simpler ones while keeping the amount of social distancing measures on the same level, and 3) imposing stronger social distancing measures early on is more effective and cheaper in the long run than opening up too soon and restoring stricter measures at a later time.

q-bio.PE↗

arXiv2020

Robust data-driven state-feedback design

We consider the problem of designing robust state-feedback controllers for discrete-time linear time-invariant systems, based directly on measured data. The proposed design procedures require no model knowledge, but only a single open-loop data trajectory, which may be affected by noise. First, a data-driven characterization of the uncertain class of closed-loop matrices under state-feedback is derived. By considering this parametrization in the robust control framework, we design data-driven state-feedback gains with guarantees on stability and performance, containing, e.g., the $\mathcal{H}_\infty$-control problem as a special case. Further, we show how the proposed framework can be extended to take partial model knowledge into account. The validity of the proposed approach is illustrated via a numerical example.

eess.SY↗

arXiv2020

A trajectory-based framework for data-driven system analysis and control

The vector space of all input-output trajectories of a discrete-time linear time-invariant (LTI) system is spanned by time-shifts of a single measured trajectory, given that the respective input signal is persistently exciting. This fact, which was proven in the behavioral control framework, shows that a single measured trajectory can capture the full behavior of an LTI system and might therefore be used directly for system analysis and controller design, without explicitly identifying a model. In this paper, we translate the result from the behavioral context to the classical state-space control framework and we extend it to certain classes of nonlinear systems, which are linear in suitable input-output coordinates. Moreover, we show how this extension can be applied to the data-driven simulation problem, where we introduce kernel-methods to obtain a rich set of basis functions.

eess.SY↗

arXiv2020

Provably robust verification of dissipativity properties from data

Dissipativity properties have proven to be very valuable for systems analysis and controller design. With the rising amount of available data, there has therefore been an increasing interest in determining dissipativity properties from (measured) trajectories directly, while an explicit model of the system remains undisclosed. Most existing approaches for data-driven dissipativity, however, guarantee the dissipativity condition only over a finite time horizon and provide weak or no guarantees on robustness in the presence of noise. In this paper, we present a framework for verifying dissipativity properties from measured data with desirable guarantees. We first consider the case of input-state measurements, where we provide non-conservative and computationally attractive conditions in the presence of noise. We extend this approach to input-output data, where similar results hold in the noise-free case. We then provide results for the noisy input-output data case, which is particularly challenging. Finally, we apply the proposed approach in a real-world experiment and illustrate its applicability and advantages compared to established methods based on system identification.

eess.SY↗

arXiv2020

Training robust neural networks using Lipschitz bounds

Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map defined by an NN. In this work, we propose a framework to train multi-layer NNs while at the same time encouraging robustness by keeping their Lipschitz constant small, thus addressing the robustness issue. More specifically, we design an optimization scheme based on the Alternating Direction Method of Multipliers that minimizes not only the training loss of an NN but also its Lipschitz constant resulting in a semidefinite programming based training procedure that promotes robustness. We design two versions of this training procedure. The first one includes a regularizer that penalizes an accurate upper bound on the Lipschitz constant. The second one allows to enforce a desired Lipschitz bound on the NN at all times during training. Finally, we provide two examples to show that the proposed framework successfully increases the robustness of NNs.

cs.LG↗

arXiv2020

Verifying dissipativity properties from noise-corrupted input-state data

There exists a vast amount of literature how dissipativity properties can be exploited to design controllers for stability and performance guarantees for the closed loop. With the rising availability of data, there has therefore been an increasing interest in determining dissipativity properties from data as a means for data-driven systems analysis and control with rigorous guarantees. Most existing approaches, however, consider dissipativity properties that hold only over a finite horizon and mostly only qualitative statements can be made in the presence of noisy data. In this work, we present a novel approach to determine dissipativity of linear time-invariant systems from data where we inherently consider properties that hold over the infinite horizon. Furthermore, we provide rigorous guarantees in the case of noisy state measurements.

eess.SY↗

arXiv2020

Determining optimal input-output properties: A data-driven approach

Due to their relevance in systems analysis and (robust) controller design, we consider the problem of determining control-theoretic system properties of an a priori unknown system from data only. More specifically, we introduce a necessary and sufficient condition for a discrete-time linear time-invariant system to satisfy a given integral quadratic constraint (IQC) over a finite time horizon using only one input-output trajectory of finite length. Furthermore, for certain classes of IQCs, we provide convex optimization problems in form of semidefinite programs (SDPs) to retrieve the optimal, i.e. the tightest, system property description that is satisfied by the unknown system. Finally, we provide bounds on the difference between finite and infinite horizon IQCs and illustrate the effectiveness of the proposed scheme in a variety of simulation studies including noisy measurements and a high dimensional system.

eess.SY↗