arXiv subjects

Moritz Diehl

Publications and source records attributed to Moritz Diehl.

At least 109 records · Page 6Linked to original sources

arXiv2020

A Kernel Mean Embedding Approach to Reducing Conservativeness in Stochastic Programming and Control

We apply kernel mean embedding methods to sample-based stochastic optimization and control. Specifically, we use the reduced-set expansion method as a way to discard sampled scenarios. The effect of such constraint removal is improved optimality and decreased conservativeness. This is achieved by solving a distributional-distance-regularized optimization problem. We demonstrated this optimization formulation is well-motivated in theory, computationally tractable and effective in numerical algorithms.

math.OC↗

arXiv2020

An NMPC Approach using Convex Inner Approximations for Online Motion Planning with Guaranteed Collision Avoidance

Even though mobile robots have been around for decades, trajectory optimization and continuous time collision avoidance remain subject of active research. Existing methods trade off between path quality, computational complexity, and kinodynamic feasibility. This work approaches the problem using a nonlinear model predictive control (NMPC) framework, that is based on a novel convex inner approximation of the collision avoidance constraint. The proposed Convex Inner ApprOximation (CIAO) method finds kinodynamically feasible and continuous time collision free trajectories, in few iterations, typically one. For a feasible initialization, the approach is guaranteed to find a feasible solution, i.e. it preserves feasibility. Our experimental evaluation shows that CIAO outperforms state of the art baselines in terms of planning efficiency and path quality. Experiments on a robot with 12 states show that it also scales to high-dimensional systems. Furthermore real-world experiments demonstrate its capability of unifying trajectory optimization and tracking for safe motion planning in dynamic environments.

cs.RO↗

arXiv2020

The BLAS API of BLASFEO: optimizing performance for small matrices

BLASFEO is a dense linear algebra library providing high-performance implementations of BLAS- and LAPACK-like routines for use in embedded optimization and other applications targeting relatively small matrices. BLASFEO defines an API which uses a packed matrix format as its native format. This format is analogous to the internal memory buffers of optimized BLAS, but it is exposed to the user and it removes the packing cost from the routine call. For matrices fitting in cache, BLASFEO outperforms optimized BLAS implementations, both open-source and proprietary. This paper investigates the addition of a standard BLAS API to the BLASFEO framework, and proposes an implementation switching between two or more algorithms optimized for different matrix sizes. Thanks to the modular assembly framework in BLASFEO, tailored linear algebra kernels with mixed column- and panel-major arguments are easily developed. This BLAS API has lower performance than the BLASFEO API, but it nonetheless outperforms optimized BLAS and especially LAPACK libraries for matrices fitting in cache. Therefore, it can boost a wide range of applications, where standard BLAS and LAPACK libraries are employed and the matrix size is moderate. In particular, this paper investigates the benefits in scientific programming languages such as Octave, SciPy and Julia.

cs.MS↗

arXiv2019

Considering Slow Manifold Based Model Reduction for Multiscale Chemical Optimal Control Problems

Finite-dimensional dissipative dynamical systems with multiple time-scales are obtained when modeling chemical reaction kinetics with ordinary differential equations. Such stiff systems are computationally hard to solve and therefore, optimal control problems which contain ordinary differential equations as infinitesimal constraints are even more difficult to handle. Model reduction might offer an approach to improve numerical efficiency as well as avoiding stiffness of such models. We show in this paper in benchmark fashion how attracting manifold computation methods could be exploited to solve optimal control more efficiently while having in mind the ambitious long-term goal to apply them to real-time control problems in chemical kinetics.

math.OC↗

arXiv2019

A whole-year simulation study on nonlinear mixed-integer model predictive control for a thermal energy supply system with multi-use components

This work presents a whole-year simulation study on nonlinear mixed-integer Model Predictive Control (MPC) for a complex thermal energy supply system which consists of a heat pump, stratified water storages, free cooling facilities, and a large underground thermal storage. For solution of the arising Mixed-Integer Non-Linear Programs (MINLPs) we apply an existing general and optimal-control-suitable decomposition approach. To compensate deviation of forecast inputs from measured disturbances, we introduce a moving horizon estimation step within the MPC strategy. The MPC performance for this study, which consists of more than 50,000 real time suitable MINLP solutions, is compared to an elaborate conventional control strategy for the system. It is shown that MPC can significantly reduce the yearly energy consumption while providing a similar degree of constraint satisfaction, and autonomously identify previously unknown, beneficial operation modes.

math.OC↗

arXiv2018

System Identification of a Rigid Wing Airborne Wind Energy System

Airborne Wind Energy (AWE) refers to a novel technology capable of harvesting energy from wind by flying crosswind patterns with tethered autonomous aircraft. Successful design of flight controllers for AWE systems rely on the availability of accurate mathematical models. Due to the non-conventional structure of the airborne component, the system identification procedure must be ultimately addressed via an intensive flight test campaign to gain additional insight about the aerodynamic properties. In this paper, aerodynamic coefficients are estimated from experimental data obtained within flight tests using an multiple experiment Model Based Parameter Estimation (MBPE) algorithm.

math.OC↗

arXiv2018

BLASFEO: basic linear algebra subroutines for embedded optimization

BLASFEO is a dense linear algebra library providing high-performance implementations of BLAS- and LAPACK-like routines for use in embedded optimization. A key difference with respect to existing high-performance implementations of BLAS is that the computational performance is optimized for small to medium scale matrices, i.e., for sizes up to a few hundred. BLASFEO comes with three different implementations: a high-performance implementation aiming at providing the highest performance for matrices fitting in cache, a reference implementation providing portability and embeddability and optimized for very small matrices, and a wrapper to standard BLAS and LAPACK providing high-performance on large matrices. The three implementations of BLASFEO together provide high-performance dense linear algebra routines for matrices ranging from very small to large. Compared to both open-source and proprietary highly-tuned BLAS libraries, for matrices of size up to about one hundred the high-performance implementation of BLASFEO is about 20-30% faster than the corresponding level 3 BLAS routines and 2-3 times faster than the corresponding LAPACK routines.

cs.MS↗

arXiv2017

A Family of Iterative Gauss-Newton Shooting Methods for Nonlinear Optimal Control

This paper introduces a family of iterative algorithms for unconstrained nonlinear optimal control. We generalize the well-known iLQR algorithm to different multiple-shooting variants, combining advantages like straight-forward initialization and a closed-loop forward integration. All algorithms have similar computational complexity, i.e. linear complexity in the time horizon, and can be derived in the same computational framework. We compare the full-step variants of our algorithms and present several simulation examples, including a high-dimensional underactuated robot subject to contact switches. Simulation results show that our multiple-shooting algorithms can achieve faster convergence, better local contraction rates and much shorter runtimes than classical iLQR, which makes them a superior choice for nonlinear model predictive control applications.

eess.SY↗

arXiv2017

Optimal Input Design for Autonomous Aircraft

Accurate mathematical models of aerodynamic properties play an important role in the aerospace field. In some cases, system parameters of an aircraft can be estimated reliably only via flight tests. In order to obtain meaningful experimental data, the aircraft dynamics need to be excited via suitable maneuvers. In this paper, optimal maneuvers are obtained for an autonomous aircraft by solving a time domain model-based optimum experimental design problem that aims to obtain more accurate parameter estimates while enforcing safety constraints.The optimized inputs are compared with respect to conventional maneuvers widely used in the aerospace field and tested within real experiments.

math.OC↗

arXiv2016

Robust MPC via Min-Max Differential Inequalities

This paper is concerned with tube-based model predictive control (MPC) for both linear and nonlinear, input-affine continuous-time dynamic systems that are affected by time-varying disturbances. We derive a min-max differential inequality describing the support function of positive robust forward invariant tubes, which can be used to construct a variety of tube-based model predictive controllers. These constructions are conservative, but computationally tractable and their complexity scales linearly with the length of the prediction horizon. In contrast to many existing tube-based MPC implementations, the proposed framework does not involve discretizing the control policy and, therefore, the conservatism of the predicted tube depends solely on the accuracy of the set parameterization. The proposed approach is then used to construct a robust MPC scheme based on tubes with ellipsoidal cross-sections. This ellipsoidal MPC scheme is based on solving an optimal control problem under linear matrix inequality constraints. We illustrate these results with the numerical case study of a spring-mass-damper system.

math.OC↗

arXiv2015

A quaternion-based model for optimal control of the SkySails airborne wind energy system

Airborne wind energy systems are capable of extracting energy from higher wind speeds at higher altitudes. The configuration considered in this paper is based on a tethered kite flown in a pumping orbit. This pumping cycle generates energy by winching out at high tether forces and driving a generator while flying figures-of-eight, or lemniscates, as crosswind pattern. Then, the tether is reeled in while keeping the kite at a neutral position, thus leaving a net amount of generated energy. In order to achieve an economic operation, optimization of pumping cycles is of great interest. In this paper, first the principles of airborne wind energy will be briefly revisited. The first contribution is a singularity-free model for the tethered kite dynamics in quaternion representation, where the model is derived from first principles. The second contribution is an optimal control formulation and numerical results for complete pumping cycles. Based on the developed model, the setup of the optimal control problem (OCP) is described in detail along with its numerical solution based on the direct multiple shooting method in the CasADi optimization environment. Optimization results for a pumping cycle consisting of six lemniscates show that the approach is capable to find an optimal orbit in a few minutes of computation time. For this optimal orbit, the power output is increased by a factor of two compared to a sophisticated initial guess for the considered test scenario.

math.OC↗

arXiv2014

An Inequality Constrained SL/QP Method for Minimizing the Spectral Abscissa

We consider a problem in eigenvalue optimization, in particular finding a local minimizer of the spectral abscissa - the value of a parameter that results in the smallest value of the largest real part of the spectrum of a matrix system. This is an important problem for the stabilization of control systems. Many systems require the spectra to lie in the left half plane in order for them to be stable. The optimization problem, however, is difficult to solve because the underlying objective function is nonconvex, nonsmooth, and non-Lipschitz. In addition, local minima tend to correspond to points of non-differentiability and locally non-Lipschitz behavior. We present a sequential linear and quadratic programming algorithm that solves a series of linear or quadratic subproblems formed by linearizing the surfaces corresponding to the largest eigenvalues. We present numerical results comparing the algorithms to the state of the art.

math.OC↗

arXiv2013

Fast Inexact Decomposition Algorithms For Large-Scale Separable Convex Optimization

In this paper we propose a new inexact dual decomposition algorithm for solving separable convex optimization problems. This algorithm is a combination of three techniques: dual Lagrangian decomposition, smoothing and excessive gap. The algorithm requires only one primal step and two dual steps at each iteration and allows one to solve the subproblem of each component inexactly and in parallel. Moreover, the algorithmic parameters are updated automatically without any tuning strategy as in augmented Lagrangian approaches. We analyze the convergence of the algorithm and estimate its $O(\frac{1}{\varepsilon})$ worst-case complexity. Numerical examples are implemented to verify the theoretical results.

math.OC↗

arXiv2012

Path-Following Gradient-Based Decomposition Algorithms For Separable Convex Optimization

A new decomposition optimization algorithm, called \textit{path-following gradient-based decomposition}, is proposed to solve separable convex optimization problems. Unlike path-following Newton methods considered in the literature, this algorithm does not requires any smoothness assumption on the objective function. This allows us to handle more general classes of problems arising in many real applications than in the path-following Newton methods. The new algorithm is a combination of three techniques, namely smoothing, Lagrangian decomposition and path-following gradient framework. The algorithm decomposes the original problem into smaller subproblems by using dual decomposition and smoothing via self-concordant barriers, updates the dual variables using a path-following gradient method and allows one to solve the subproblem in parallel. Moreover, the algorithmic parameters are updated automatically without any tuning strategy as in augmented Lagrangian approaches. We prove the global convergence of the new algorithm and analyze its local convergence rate. Then, we modify the proposed algorithm by applying Nesterov's accelerating scheme to get a new variant which has a better local convergence rate. Finally, we present preliminary numerical tests that confirm the theory development.

math.OC↗

arXiv2012

An Inner Convex Approximation Algorithm for BMI Optimization and Applications in Control

In this work, we propose a new local optimization method to solve a class of nonconvex semidefinite programming (SDP) problems. The basic idea is to approximate the feasible set of the nonconvex SDP problem by inner positive semidefinite convex approximations via a parameterization technique. This leads to an iterative procedure to search a local optimum of the nonconvex problem. The convergence of the algorithm is analyzed under mild assumptions. Applications in static output feedback control are benchmarked and numerical tests are implemented based on the data from the COMPLeib library.

math.OC↗

arXiv2011

Combining Lagrangian Decomposition and Excessive Gap Smoothing Technique for Solving Large-Scale Separable Convex Optimization Problems

A new algorithm for solving large-scale convex optimization problems with a separable objective function is proposed. The basic idea is to combine three techniques: Lagrangian dual decomposition, excessive gap and smoothing. The main advantage of this algorithm is that it dynamically updates the smoothness parameters which leads to numerically robust performance. The convergence of the algorithm is proved under weak conditions imposed on the original problem. The rate of convergence is $O(\frac{1}{k})$, where $k$ is the iteration counter. In the second part of the paper, the algorithm is coupled with a dual scheme to construct a switching variant of the dual decomposition. We discuss implementation issues and make a theoretical comparison. Numerical examples confirm the theoretical results.

math.OC↗

arXiv2011

Combining Convex-Concave Decompositions and Linearization Approaches for solving BMIs, with application to Static Output Feedback

A novel optimization method is proposed to minimize a convex function subject to bilinear matrix inequality (BMI) constraints. The key idea is to decompose the bilinear mapping as a difference between two positive semidefinite convex mappings. At each iteration of the algorithm the concave part is linearized, leading to a convex subproblem.Applications to various output feedback controller synthesis problems are presented. In these applications the subproblem in each iteration step can be turned into a convex optimization problem with linear matrix inequality (LMI) constraints. The performance of the algorithm has been benchmarked on the data from COMPleib library.

math.OC↗

arXiv2011

An inexact perturbed path-following method for Lagrangian decomposition in large-scale separable convex optimization

In this paper, we propose an inexact perturbed path-following algorithm in the framework of Lagrangian dual decomposition for solving large-scale structured convex optimization problems. Unlike the exact versions considered in literature, we allow one to solve the primal problem inexactly up to a given accuracy. The inexact perturbed algorithm allows to use both approximate Hessian matrices and approximate gradient vectors to compute Newton-type directions for the dual problem. The algorithm is divided into two phases. The first phase computes an initial point which makes use of inexact perturbed damped Newton-type iterations, while the second one performs the path-following algorithm with inexact perturbed full-step Newton-type iterations. We analyze the convergence of both phases and estimate the worst-case complexity. As a special case, an exact path- following algorithm for Lagrangian relaxation is derived and its worst-case complexity is estimated. This variant possesses some differences compared to the previously known methods. Implementation details are discussed and numerical results are reported.

math.OC↗