Searcharxiv⌕ Search

arXiv subjects

Tobias Breiten

Publications and source records attributed to Tobias Breiten.

At least 37 records · Page 2Linked to original sources

Local well-posedness of the Mortensen observer

The analytical background of nonlinear observers based on minimal energy estimation is discussed. It is shown that locally the derivation of the observer equation based on a trajectory with pointwise minimal energy can be done rigorously. The result is obtained by a local sensitivity analysis of the value function based on Pontryagin's maximum principle and the Hamilton-Jacobi-Bellman equation. The consideration of a differential Riccati equation reveals that locally the second derivative of the value function is a positive definite matrix. The local convexity ensures existence of a trajectory minimizing the energy, which is then shown to satisfy the observer equation.

math.OC↗

Towards a modeling class for port-Hamiltonian systems with time-delay

The framework of port-Hamiltonian (pH) systems is a powerful and broadly applicable modeling paradigm. In this paper, we extend the scope of pH systems to time-delay systems. Our definition of a delay pH system is motivated by investigating the Kalman-Yakubovich-Popov inequality on the corresponding infinite-dimensional operator equation. Moreover, we show that delay pH systems are passive and closed under interconnection. We describe an explicit way to construct a Lyapunov-Krasovskii functional and discuss implications for delayed feedback.

math.DS↗

Structure Preserving $H_\infty$ Control for Port-Hamiltonian Systems

We study $H_\infty$ control design for linear time-invariant port-Hamiltonian systems. By a modification of the two central algebraic Riccati equations, we ensure that the resulting controller will be port-Hamiltonian. Using these modified equations, we proceed to show that a corresponding balanced truncation approach preserves port-Hamiltonian structure. We illustrate the theoretical findings using numerical examples and observe that the chosen representation of the port-Hamiltonian system can have an influence on the approximation qualities of the reduced order model.

math.OC↗

Passivity preserving model reduction via spectral factorization

We present a novel model-order reduction (MOR) method for linear time-invariant systems that preserves passivity and is thus suited for structure-preserving MOR for port-Hamiltonian (pH) systems. Our algorithm exploits the well-known spectral factorization of the Popov function by a solution of the Kalman-Yakubovich-Popov (KYP) inequality. It performs MOR directly on the spectral factor inheriting the original system's sparsity enabling MOR in a large-scale context. Our analysis reveals that the spectral factorization corresponding to the minimal solution of an associated algebraic Riccati equation is preferable from a model reduction perspective and benefits pH-preserving MOR methods such as a modified version of the iterative rational Krylov algorithm (IRKA). Numerical examples demonstrate that our approach can produce high-fidelity reduced-order models close to (unstructured) $\mathcal{H}_2$-optimal reduced-order models.

math.DS↗

Error bounds for port-Hamiltonian model and controller reduction based on system balancing

We study linear quadratic Gaussian (LQG) control design for linear port-Hamiltonian systems. To this end, we exploit the freedom in choosing the weighting matrices and propose a specific choice which leads to an LQG controller which is port-Hamiltonian and, thus, in particular stable and passive. Furthermore, we construct a reduced-order controller via balancing and subsequent truncation. This approach is closely related to classical LQG balanced truncation and shares a similar a priori error bound with respect to the gap metric. By exploiting the non-uniqueness of the Hamiltonian, we are able to determine an optimal pH representation of the full-order system in the sense that the error bound is minimized. In addition, we discuss consequences for pH-preserving balanced truncation model reduction which results in two different classical H-infinity-error bounds. Finally, we illustrate the theoretical findings by means of two numerical examples.

math.OC↗

Stochastic gradient descent and fast relaxation to thermodynamic equilibrium: a stochastic control approach

We study the convergence to equilibrium of an underdamped Langevin equation that is controlled by a linear feedback force. Specifically, we are interested in sampling the possibly multimodal invariant probability distribution of a Langevin system at small noise (or low temperature), for which the dynamics can easily get trapped inside metastable subsets of the phase space. We follow [Chen et al., J. Math. Phys. 56, 113302, 2015] and consider a Langevin equation that is simulated at a high temperature, with the control playing the role of a friction that balances the additional noise so as to restore the original invariant measure at a lower temperature. We discuss different limits as the temperature ratio goes to infinity and prove convergence to a limit dynamics. It turns out that, depending on whether the lower ("target") or the higher ("simulation") temperature is fixed, the controlled dynamics converges either to the overdamped Langevin equation or to a deterministic gradient flow. This implies that (a) the ergodic limit and the large temperature separation limit do not commute in general, and that (b) it is not possible to accelerate the speed of convergence to the ergodic limit by making the temperature separation larger and larger. We discuss the implications of these observation from the perspective of stochastic optimisation algorithms and enhanced sampling schemes in molecular dynamics.

math.OC↗

Funnel control for the monodomain equations with the FitzHugh-Nagumo model

We consider a nonlinear reaction diffusion system of parabolic type known as the monodomain equations, which model the interaction of the electric current in a cell. Together with the FitzHugh-Nagumo model for the nonlinearity they represent defibrillation processes of the human heart. We study a fairly general type with co-located inputs and outputs describing both boundary and distributed control and observation. The control objective is output trajectory tracking with prescribed performance. To achieve this we employ the funnel controller, which is model-free and of low complexity. The controller introduces a nonlinear and time-varying term in the closed-loop system, for which we prove existence and uniqueness of solutions. Additionally, exploiting the parabolic nature of the problem, we obtain Hölder continuity of the state, inputs and outputs. We illustrate our results by a simulation of a standard test example for the termination of reentry waves.

math.OC↗

Neural Network Based Nonlinear Observers

Nonlinear observers based on the well-known concept of minimum energy estimation are discussed. The approach relies on an output injection operator determined by a Hamilton-Jacobi-Bellman equation and is subsequently approximated by a neural network. A suitable optimization problem allowing to learn the network parameters is proposed and numerically investigated for linear and nonlinear oscillators.

math.OC↗

On the Turnpike Property and the Receding-Horizon Method for Linear-Quadratic Optimal Control Problems

Optimal control problems with a very large time horizon can be tackled with the Receding Horizon Control (RHC) method, which consists in solving a sequence of optimal control problems with small prediction horizon. The main result of this article is the proof of the exponential convergence (with respect to the prediction horizon) of the control generated by the RHC method towards the exact solution of the problem. The result is established for a class of infinite-dimensional linear-quadratic optimal control problems with time-independent dynamics and integral cost. Such problems satisfy the turnpike property: the optimal trajectory remains most of the time very close to the solution to the associated static optimization problem. Specific terminal cost functions, derived from the Lagrange multiplier associated with the static optimization problem, are employed in the implementation of the RHC method.

math.OC↗

Solving differential Riccati equations: A nonlinear space-time method using tensor trains

Differential algebraic Riccati equations are at the heart of many applications in control theory. They are time-depent, matrix-valued, and in particular nonlinear equations that require special methods for their solution. Low-rank methods have been used heavily computing a low-rank solution at every step of a time-discretization. We propose the use of an all-at-once space-time solution leading to a large nonlinear space-time problem for which we propose the use of a Newton-Kleinman iteration. Approximating the space-time problem in low-rank form requires fewer applications of the discretized differential operator and gives a low-rank approximation to the overall solution.

math.NA↗

Feedback Stabilization of the Three-Dimensional Navier-Stokes Equations using Generalized Lyapunov Equations

The approximation of the value function associated to a stabilization problem formulated as optimal control problem for the Navier-Stokes equations in dimension three by means of solutions to generalized Lyapunov equations is proposed and analyzed. The specificity, that the value function is not differentiable on the state space must be overcome. For this purpose a new class of generalized Lyapunov equations is introduced. Existence of unique solutions to these equations is demonstrated. They provide the basis for feedback operators, which approximate the value function, the optimal states and controls, up to arbitrary order.

math.OC↗

$\mathcal{H}_2$-gap model reduction for stabilizable and detectable systems

We formulate here an approach to model reduction that is well-suited for linear time-invariant control systems that are stabilizable and detectable but may otherwise be unstable. We introduce a modified $\mathcal{H}_2$-error metric, the $\mathcal{H}_2$-gap, that provides an effective measure of model fidelity in this setting. While the direct evaluation of the $\mathcal{H}_2$-gap requires the solutions of a pair of algebraic Riccati equations associated with related closed-loop systems, we are able to work entirely within an interpolatory framework, developing algorithms and supporting analysis that do not reference full-order closed-loop Gramians. This leads to a computationally effective strategy yielding reduced models designed so that the corresponding reduced closed-loop systems will interpolate the full-order closed-loop system at specially adapted interpolation points, without requiring evaluation of the full-order closed-loop system nor even computation of the feedback law that determines it. The analytical framework and computational algorithm presented here provides an effective new approach toward constructing reduced-order models for unstable systems. Numerical examples for an unstable convection diffusion equation and a linearized incompressible Navier-Stokes equation illustrate the effectiveness of this approach.

math.NA↗

Feedback Stabilization of the Two-Dimensional Navier-Stokes Equations by Value Function Approximation

The value function associated with an optimal control problem subject to the Navier-Stokes equations in dimension two is analyzed. Its smoothness is established around a steady state, moreover, its derivatives are shown to satisfy a Riccati equation at the order two and generalized Lyapunov equations at the higher orders. An approximation of the optimal feedback law is then derived from the Taylor expansion of the value function. A convergence rate for the resulting controls and closed-loop systems is demonstrated.

math.OC↗

Residual-based iterations for the generalized Lyapunov equation

This paper treats iterative solution methods to the generalized Lyapunov equation. Specifically it expands the existing theoretical justification for the alternating linear scheme (ALS) from the stable Lyapunov equation to the stable generalized Lyapunov equation. Moreover, connections between the energy-norm minimization in ALS and the theory to H2-optimality of an associated bilinear control system are established. It is also shown that a certain ALS-based iteration can be seen as iteratively constructing rank-1 model reduction subspaces for bilinear control systems associated with the residual. Similar to the ALS-based iteration, the fixed-point iteration can also be seen as a residual-based method minimizing an upper bound of the associated energy norm. Lastly a residual-based generalized rational-Krylov-type subspace is proposed for the generalized Lyapunov equation.

math.NA↗

Numerical Study of Polynomial Feedback Laws for a Bilinear Control Problem

An infinite-dimensional bilinear optimal control problem with infinite-time horizon is considered. The associated value function can be expanded in a Taylor series around the equilibrium, the Taylor series involving multilinear forms which are uniquely characterized by generalized Lyapunov equations. A numerical method for solving these equations is proposed. It is based on a generalization of the balanced truncation model reduction method and some techniques of tensor calculus, in order to attenuate the curse of dimensionality. Polynomial feedback laws are derived from the Taylor expansion and are numerically investigated for a control problem of the Fokker-Planck equation. Their efficiency is demonstrated for initial values which are sufficiently close to the equilibrium.

math.OC↗

Control Strategies for the Fokker-Planck Equation

Using a projection-based decoupling of the Fokker-Planck equation, control strategies that allow to speed up the convergence to the stationary distribution are investigated. By means of an operator theoretic framework for a bilinear control system, two different feedback control laws are proposed. Projected Riccati and Lyapunov equations are derived and properties of the associated solutions are given. The well-posedness of the closed loop systems is shown and local and global stabilization results, respectively, are obtained. An essential tool in the construction of the controls is the choice of appropriate control shape functions. Results for a two dimensional double well potential illustrate the theoretical findings in a numerical setup.

math.OC↗

Model reduction of controlled Fokker--Planck and Liouville-von Neumann equations

Model reduction methods for bilinear control systems are compared by means of practical examples of Liouville-von Neumann and Fokker--Planck type. Methods based on balancing generalized system Gramians and on minimizing an H2-type cost functional are considered. The focus is on the numerical implementation and a thorough comparison of the methods. Structure and stability preservation are investigated, and the competitiveness of the approaches is shown for practically relevant, large-scale examples.

math.NA↗

Taylor Expansions of the Value Function Associated with a Bilinear Optimal Control Problem

A general bilinear optimal control problem subject to an infinite-dimensional state equation is considered. Polynomial approximations of the associated value function are derived around the steady state by repeated formal differentiation of the Hamilton-Jacobi-Bellman equation. The terms of the approximations are described by multilinear forms, which can be obtained as solutions to generalized Lyapunov equations with recursively defined right-hand sides. They form the basis for defining a suboptimal feedback law. The approximation properties of this feedback law are investigated. An application to the optimal control of a Fokker-Planck equation is also provided.

math.OC↗