Searcharxiv⌕ Search

arXiv subjects

John Lygeros

Publications and source records attributed to John Lygeros.

At least 181 records · Page 10Linked to original sources

Input Convex Neural Networks for Building MPC

Model Predictive Control in buildings can significantly reduce their energy consumption. The cost and effort necessary for creating and maintaining first principle models for buildings make data-driven modelling an attractive alternative in this domain. In MPC the models form the basis for an optimization problem whose solution provides the control signals to be applied to the system. The fact that this optimization problem has to be solved repeatedly in real-time implies restrictions on the learning architectures that can be used. Here, we adapt Input Convex Neural Networks that are generally only convex for one-step predictions, for use in building MPC. We introduce additional constraints to their structure and weights to achieve a convex input-output relationship for multistep ahead predictions. We assess the consequences of the additional constraints for the model accuracy and test the models in a real-life MPC experiment in an apartment in Switzerland. In two five-day cooling experiments, MPC with Input Convex Neural Networks is able to keep room temperatures within comfort constraints while minimizing cooling energy consumption.

eess.SY↗

Performance-Driven Cascade Controller Tuning with Bayesian Optimization

We propose a performance-based autotuning method for cascade control systems, where the parameters of a linear axis drive motion controller from two control loops are tuned jointly. Using Bayesian optimization as all parameters are tuned simultaneously, the method is guaranteed to converge asymptotically to the global optimum of the cost. The data-efficiency and performance of the method are studied numerically for several training configurations and compared numerically to those achieved with classical tuning methods and to the exhaustive evaluation of the cost. On the real system, the tracking performance and robustness against disturbances are compared experimentally to nominal tuning. The numerical study and the experimental data both demonstrate that the proposed automated tuning method is efficient in terms of required tuning iterations, robust to disturbances, and results in improved tracking.

eess.SY↗

Multiperiod Stochastic Peak Shaving Using Storage

We present an online stochastic model predictive control framework for demand charge management for a grid-connected consumer with attached electrical energy storage. The consumer we consider must satisfy an inflexible but stochastic electricity demand, and also receives a stochastic electricity inflow. The optimization problem formulated solves a stochastic cost minimization problem, with given weather forecast scenarios converted into forecast demand and inflow. We introduce a novel weighting scheme to account for cases where the optimization horizon spans multiple demand charge periods. The optimization scheme is tested in a setting with building demand and photovoltaic array inflow data from a real office building. The simulation study allows us to compare various design and modeling alternatives, ultimately proposing a policy based on causal affine decision rules.

eess.SY↗

GPU Acceleration of ADMM for Large-Scale Quadratic Programming

The alternating direction method of multipliers (ADMM) is a powerful operator splitting technique for solving structured convex optimization problems. Due to its relatively low per-iteration computational cost and ability to exploit sparsity in the problem data, it is particularly suitable for large-scale optimization. However, the method may still take prohibitively long to compute solutions to very large problem instances. Although ADMM is known to be parallelizable, this feature is rarely exploited in real implementations. In this paper we exploit the parallel computing architecture of a graphics processing unit (GPU) to accelerate ADMM. We build our solver on top of OSQP, a state-of-the-art implementation of ADMM for quadratic programming. Our open-source CUDA C implementation has been tested on many large-scale problems and was shown to be up to two orders of magnitude faster than the CPU implementation.

math.OC↗

Cascade Control: Data-Driven Tuning Approach Based on Bayesian Optimization

Cascaded controller tuning is a multi-step iterative procedure that needs to be performed routinely upon maintenance and modification of mechanical systems. An automated data-driven method for cascaded controller tuning based on Bayesian optimization is proposed. The method is tested on a linear axis drive, modeled using a combination of first principles model and system identification. A custom cost function based on performance indicators derived from system data at different candidate configurations of controller parameters is modeled by a Gaussian process. It is further optimized by minimization of an acquisition function which serves as a sampling criterion to determine the subsequent candidate configuration for experimental trial and improvement of the cost model iteratively, until a minimum according to a termination criterion is found. This results in a data-efficient procedure that can be easily adapted to varying loads or mechanical modifications of the system. The method is further compared to several classical methods for auto-tuning, and demonstrates higher performance according to the defined data-driven performance indicators. The influence of the training data on a cost prior on the number of iterations required to reach optimum is studied, demonstrating the efficiency of the Bayesian optimization tuning method.

eess.SY↗

An Extended Kalman Filter for Data-enabled Predictive Control

The literature dealing with data-driven analysis and control problems has significantly grown in the recent years. Most of the recent literature deals with linear time-invariant systems in which the uncertainty (if any) is assumed to be deterministic and bounded; relatively little attention has been devoted to stochastic linear time-invariant systems. As a first step in this direction, we propose to equip the recently introduced Data-enabled Predictive Control algorithm with a data-based Extended Kalman Filter to make use of additional available input-output data for reducing the effect of noise, without increasing the computational load of the optimization procedure.

math.OC↗

Distributed Model Predictive Control with Asymmetric Adaptive Terminal Sets for the Regulation of Large-scale Systems

In this paper, a novel distributed model predictive control (MPC) scheme with asymmetric adaptive terminal sets is developed for the regulation of large-scale systems with a distributed structure. Similar to typical MPC schemes, a structured Lyapunov matrix and a distributed terminal controller, respecting the distributed structure of the system, are computed offline. However, in this scheme, a distributed positively invariant terminal set is computed online and updated at each time instant taking into consideration the current state of the system. In particular, we consider ellipsoidal terminal sets as they are easy to compute for large-scale systems. The size and the center of these terminal sets, together with the predicted state and input trajectories, are considered as decision variables in the online phase. Determining the terminal set center online is found to be useful specifically in the presence of asymmetric constraints. Finally, a relaxation of the resulting online optimal control problem is provided. The efficacy of the proposed scheme is illustrated in simulation by comparing it to a recent distributed MPC scheme with adaptive terminal sets.

eess.SY↗

Control of Networked Systems by Clustering: The Degree of Freedom Concept

We address the problem of local flux redistribution in networked systems. The aim is to detect a suitable cluster which is able to locally adsorb a disturbance by means of an appropriate redistribution of control load among its nodes, such that no external node is affected. Traditional clustering measures are not suitable for our purpose, since they do not explicitly take into account the structural conditions for disturbance containment. We propose a new measure based on the concept of degree of freedom for a cluster, and we introduce a heuristic procedure to quickly select a set of nodes according to this measure. Finally, we show an application of the method in the context of DC microgrids voltage control.

eess.SY↗

Data-Driven Control of Unknown Systems: A Linear Programming Approach

We consider the problem of discounted optimal state-feedback regulation for general unknown deterministic discrete-time systems. It is well known that open-loop instability of systems, non-quadratic cost functions and complex nonlinear dynamics, as well as the on-policy behavior of many reinforcement learning (RL) algorithms, make the design of model-free optimal adaptive controllers a challenging task. We depart from commonly used least-squares and neural network approximation methods in conventional model-free control theory, and propose a novel family of data-driven optimization algorithms based on linear programming, off-policy Q-learning and randomized experience replay. We develop both policy iteration (PI) and value iteration (VI) methods to compute an approximate optimal feedback controller with high precision and without the knowledge of a system model and stage cost function. Simulation studies confirm the effectiveness of the proposed methods.

eess.SY↗

Optimization-Based Hierarchical Motion Planning for Autonomous Racing

In this paper we propose a hierarchical controller for autonomous racing where the same vehicle model is used in a two level optimization framework for motion planning. The high-level controller computes a trajectory that minimizes the lap time, and the low-level nonlinear model predictive path following controller tracks the computed trajectory online. Following a computed optimal trajectory avoids online planning and enables fast computational times. The efficiency is further enhanced by the coupling of the two levels through a terminal constraint, computed in the high-level controller. Including this constraint in the real-time optimization level ensures that the prediction horizon can be shortened, while safety is guaranteed. This proves crucial for the experimental validation of the approach on a full size driverless race car. The vehicle in question won two international student racing competitions using the proposed framework; moreover, our hierarchical controller achieved an improvement of 20% in the lap time compared to the state of the art result achieved using a very similar car and track.

cs.RO↗

Reference design for closed loop system optimization

An optimization-based method for improving the productivity of precision machine tools is proposed, where the reference path is computed in local coordinates, and information about the machine tool performance is learned from experimental data. The optimization yields a modified reference that is tracked by the existing low-level controller. The method is tested in simulation for a biaxial positioning system. The positioning system is modelled as double integrator, and the controller characteristic is modelled from experimental data using a least-squares fit. Simulation results show that the method is effective in designing optimal references even for challenging geometries such as sharp corners. The application of this procedure allows the retrofit of the control of existing machines with minimal overhead, by providing a modified reference file to track.

eess.SY↗

Two-Stage Dual Dynamic Programming with Application to Nonlinear Hydro Scheduling

We present an approximate method for solving nonlinear control problems over long time horizons, in which the full nonlinear model is preserved over an initial part of the horizon, while the remainder of the horizon is modeled using a linear relaxation. As this approximate problem may still be too large to solve directly, we present a Benders decomposition-based solution algorithm that iterates between solving the nonlinear and linear parts of the horizon. This extends the Dual Dynamic Programming approach commonly employed for optimization of linearized hydro power systems. We prove that the proposed algorithm converges after a finite number of iterations, even when the nonlinear initial stage problems are solved inexactly. We also bound the suboptimality of the split-horizon method with respect to the original nonlinear problem, in terms of the properties of a map between the linear and nonlinear state-input trajectories. We then apply this method to a case study concerning a multiple reservoir hydro system, approximating the nonlinear head effects in the second stage using McCormick envelopes. We demonstrate that near-optimal solutions can be obtained in a shrinking horizon setting when the full nonlinear model is used for only a short initial section of the horizon. For this example, the approach is shown to be more practical than both conventional dynamic programming and a multi-cell McCormick envelope approximation from literature.

math.OC↗

Regularized and Distributionally Robust Data-Enabled Predictive Control

In this paper, we study a data-enabled predictive control (DeePC) algorithm applied to unknown stochastic linear time-invariant systems. The algorithm uses noise-corrupted input/output data to predict future trajectories and compute optimal control policies. To robustify against uncertainties in the input/output data, the control policies are computed to minimize a worst-case expectation of a given objective function. Using techniques from distributionally robust stochastic optimization, we prove that for certain objective functions, the worst-case optimization problem coincides with a regularized version of the DeePC algorithm. These results support the previously observed advantages of the regularized algorithm and provide probabilistic guarantees for its performance. We illustrate the robustness of the regularized algorithm through a numerical case study.

math.OC↗

The Nash Equilibrium with Inertia in Population Games

In the traditional game-theoretic set up, where agents select actions and experience corresponding utilities, an equilibrium is a configuration where no agent can improve their utility by unilaterally switching to a different action. In this work, we introduce the novel notion of inertial Nash equilibrium to account for the fact that, in many practical situations, action changes do not come for free. Specifically, we consider a population game and introduce the coefficients $c_{ij}$ describing the cost an agent incurs by switching from action $i$ to action $j$. We define an inertial Nash equilibrium as a distribution over the action space where no agent benefits in moving to a different action, while taking into account the cost of this change. First, we show that the set of inertial Nash equilibria contains all the Nash equilibria, but is in general not convex. Second, we argue that classical algorithms for computing Nash equilibria cannot be used in the presence of switching costs. We then propose a natural better-response dynamics and prove its convergence to an inertial Nash equilibrium. We apply our results to predict the drivers' distribution of an on-demand ride-hailing platform.

eess.SY↗

Generalized maximum entropy estimation

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel approximation scheme using a smoothed fast gradient method that is equipped with explicit bounds on the approximation error. We further demonstrate how the presented scheme can be used for approximating the chemical master equation through the zero-information moment closure method, and for an approximate dynamic programming approach in the context of constrained Markov decision processes with uncountable state and action spaces.

math.OC↗

Real-Time Predictive Control for Precision Machining

Precise positioning and fast traversal times are crucial in achieving high productivity and scale in machining. This paper compares two optimization-based predictive control approaches that achieve high performance. In the first approach, the contour error is defined using the global position, the position on the path is inferred through a virtual path parameter, and the cost function combines the corresponding states and inputs to achieve a trade-off between high speed and positioning accuracy. The second approach is based on a local definition of both the error and the progress along the path, and results in a system with a reduced number of states and inputs that enables real-time optimization. Terminal and trust region constraints are required to achieve precise tracking of geometries where a fast or instantaneous change in direction is present. The performance of both approaches using different quadratic programming solvers is evaluated in simulations for geometries that are challenging in machine tools applications.

eess.SY↗

ADMM for Exploiting Structure in MPC Problems

We consider a model predictive control (MPC) setting, where we use the alternating direction method of multipliers (ADMM) to exploit problem structure. We take advantage of interacting components in the controlled system by decomposing its dynamics with virtual subsystems and virtual inputs. We introduce subsystem-individual penalty parameters together with optimal selection techniques. Further, we propose a novel measure of system structure, which we call separation tendency. For a sufficiently structured system, the resulting structure-exploiting method has the following characteristics: (i) its computational complexity scales favorably with the problem size; (ii) it is highly parallelizable; (iii) it is highly adaptable to the problem at hand; and (iv), even for a single-thread implementation, it improves the overall performance. We show a simulation study for cascade systems and compare the new method to conventional ADMM.

math.OC↗

AMZ Driverless: The Full Autonomous Racing System

This paper presents the algorithms and system architecture of an autonomous racecar. The introduced vehicle is powered by a software stack designed for robustness, reliability, and extensibility. In order to autonomously race around a previously unknown track, the proposed solution combines state of the art techniques from different fields of robotics. Specifically, perception, estimation, and control are incorporated into one high-performance autonomous racecar. This complex robotic system, developed by AMZ Driverless and ETH Zurich, finished 1st overall at each competition we attended: Formula Student Germany 2017, Formula Student Italy 2018 and Formula Student Germany 2018. We discuss the findings and learnings from these competitions and present an experimental evaluation of each module of our solution.

cs.RO↗