SearcharxivSearch

arXiv subjects

Tobias Breiten

Publications and source records attributed to Tobias Breiten.

At least 19 recordsLinked to original sources

Unifying HJB and Riccati equations: A Koopman operator approach to nonlinear optimal control

This paper proposes an operator-theoretic framework that recasts the minimal value function of a nonlinear optimal control problem as an abstract bilinear form on a suitable function space. The resulting bilinear form is shown to satisfy an operator equation with quadratic nonlinearity obtained by formulating the Lyapunov equation for a Koopman lift of the optimal closed-loop dynamics to an infinite-dimensional state space. It is proven that the minimal value function admits a rapidly convergent sum-of-squares expansion, a direct consequence of the fast spectral decay of the bilinear form. The framework thereby establishes a natural link between the Hamilton-Jacobi-Bellman and a Riccati-like operator equation and further motivates numerical low-rank schemes.

math.OC

Data Driven Modeling of Nonlinear Dynamics in a Rotating Detonation Combustor via Finite Dimensional Approximations of the Koopman Operator

A Rotating Detonation Combustor (RDC) is a promising technology for increasing efficiency in propulsion and power generation applications. The dynamics of the RDC are governed by continuously propagating detonation waves within an annular combustion chamber. Multiple operating modes can be observed, including nonlinear interactions between counter-rotating waves and the emergence of standing wave patterns. Koopman operator theory provides a framework to globally linearize nonlinear dynamical systems by representing their evolution in the space of observables rather than states. In this work, finite-dimensional approximations of the Koopman operator are constructed using variants of Dynamic Mode Decomposition (DMD) applied to high-speed video data capturing the natural flame luminosity of the detonation waves in the RDC at the Technical University (TU) Berlin. By introducing time-delay embeddings as a dictionary of observables, this approach overcomes the limitations of standard DMD methods, particularly for accurate reconstruction of standing wave patterns and for capturing nonlinear interactions. In addition, a technique is presented to mitigate the influence of sensor noise in the luminosity measurements. Finally, it is shown that the DMD-based models provide insight into the dynamics of different operating modes by decomposing the reconstructed signal into its characteristic features.

math.OC

A first-optimize-then-reduce framework for optimal control with the shifted proper orthogonal decomposition

Overcoming the Kolmogorov barrier for constructing efficient reduced-order models (ROMs) for transport-dominated problems remains a challenge. This has impeded their use as computationally cheap surrogates for partial differential equations (PDEs) associated with optimal control problems. Since such problems require multiple computations of the full PDE, employing their reduced-order surrogates instead could speed up the overall optimal control problem. Motivated by this idea, in this paper we explore the use of a nonlinear model-order reduction technique, namely, the shifted proper orthogonal decomposition (sPOD) in an optimal control context. In doing so, we explore the framework of first-optimize-then-reduce (FOTR) where an optimality system for the full PDE problem is constructed first, followed by approximating the optimality system with reduced-order models. We consider this framework for a linear quadratic optimal control problem constrained by a 1D linear advection equation and compare the computational performance of the sPOD method against the use of the standard POD.

math.OC

Approximations of the Mortensen observer using higher order extended Kalman filters

A polynomial approximation of the minimum energy estimator, also called Mortensen observer, is discussed. The method relies on successive differentiations of an underlying value function and the Hamilton-Jacobi-Bellman equation, respectively. By means of neglecting higher order derivatives of the value function along the unknown observer trajectory, a coupled set of nonlinear tensor structured differential equations is derived. In its simplest form, the approach boils down to the well-known extended Kalman filter. Numerical experiments with polynomials up to the order eight illustrate the potential of the new approach and indicate local convergence to the Mortensen observer.

math.OC

From Interpolation to $\mathcal{H}_2$ Optimality: Model Reduction for Infinite-Dimensional Linear Control Systems

We develop the interpolatory $\mathcal{H}_2$ optimal model reduction framework for linear control systems posed on infinite dimensional state, input and output spaces. Specifically, we consider linear systems formulated as controlled abstract Cauchy problems on a Banach space and approximate them via Petrov-Galerkin projection onto finite dimensional trial and test subspaces. We show that the resulting reduced order transfer function interpolates the original at prescribed points, and we characterize precisely how the projection subspaces must be constructed to enforce this interpolation. Building on this, we develop a data-driven realization framework -- an infinite dimensional analogue of the Loewner approach -- that recovers the system behavior directly from input-output data without requiring access to the underlying operators. Finally, we derive $\mathcal{H}_2$ optimality conditions for the reduced model and show that the classical interpolatory characterization persists in this infinite dimensional setting: first-order optimality requires Hermite interpolation of the transfer function at the mirror images of the reduced model's poles. Taken together, these results establish that the interpolatory $\mathcal{H}_2$ optimal model reduction theory extends naturally and completely to infinite dimensional linear control systems with infinite dimensional input and output spaces.

math.OC

Optimal control with the shifted proper orthogonal decomposition via a first-reduce-then-optimize framework

Solving optimal control problems for transport-dominated partial differential equations (PDEs) can become computationally expensive, especially when dealing with high-dimensional systems. To overcome this challenge, we focus on developing and deriving reduced-order models that can replace the full PDE system in solving the optimal control problem. Specifically, we explore the use of the shifted proper orthogonal decomposition (POD) as a reduced-order model, which is particularly effective for capturing low-dimensional representations of high-fidelity transport-dominated phenomena. In this work, a reduced-order model is constructed first, followed by the optimization of the reduced system. We consider a 1D linear advection equation problem and prove existence and uniqueness of solutions for the reduced-order model as well as the existence of an optimal control. Moreover, we compare the computational performance of the shifted POD method against the standard POD.

math.OC

When do World Models Successfully Learn Dynamical Systems?

In this work, we explore the use of compact latent representations with learned time dynamics ('World Models') to simulate physical systems. Drawing on concepts from control theory, we propose a theoretical framework that explains why projecting time slices into a low-dimensional space and then concatenating to form a history ('Tokenization') is so effective at learning physics datasets, and characterise when exactly the underlying dynamics admit a reconstruction mapping from the history of previous tokenized frames to the next. To validate these claims, we develop a sequence of models with increasing complexity, starting with least-squares regression and progressing through simple linear layers, shallow adversarial learners, and ultimately full-scale generative adversarial networks (GANs). We evaluate these models on a variety of datasets, including modified forms of the heat and wave equations, the chaotic regime 2D Kuramoto-Sivashinsky equation, and a challenging computational fluid dynamics (CFD) dataset of a 2D Kármán vortex street around a fixed cylinder, where our model is successfully able to recreate the flow.

math.NA

Nonlinear systems and passivity: feedback control, model reduction, and time discretization

Dynamical systems can be used to model a broad class of physical processes, and conservation laws give rise to system properties like passivity or port-Hamiltonian structure. An important problem in practical applications is to steer dynamical systems to prescribed target states, and feedback controllers combining a regulator and an observer are a powerful tool to do so. However, controllers designed using classical methods do not necessarily obey energy principles, which makes it difficult to model the controller-plant interaction in a structured manner. In this paper, we show that the combination of an optimal feedback law characterized by the Hamilton-Jacobi-Bellman equation and output feedback gives rise to passivity properties of the controller that are independent of the plant structure. Furthermore, we state conditions for the controller to have a port-Hamiltonian realization and show that a model order reduction scheme can be deduced using the framework of nonlinear balanced truncation. To illustrate our results, we numerically realize the controller using the policy iteration and computationally verify passivity via a custom passivity-preserving discrete gradient scheme suitable for a wide class of passive systems.

math.OC

Data-driven optimal approximation on Hardy spaces in simply connected domains

We consider optimal interpolation of functions analytic in simply connected domains in the complex plane. By choosing a specific structure for the approximant, we show that the resulting first order optimality conditions can be interpreted as optimal $\mathcal{H}_2$ interpolation conditions for discrete-time dynamical systems. Connections to the implicit Euler method, the midpoint method, and backward differentiation methods are also established. A data-driven algorithm is developed to compute a (locally) optimal approximant. Our method is tested on three numerical experiments.

math.NA

Passivity encoding representations of nonlinear systems

Passive systems are characterized by their inability to generate energy internally, providing a powerful tool for modeling physical phenomena. Additionally, algebraically encoding passivity in the system description can be advantageous. For this, port-Hamiltonian systems are a prominent approach. Another possibility is writing the system in suitable coordinates. In this paper, we investigate the equivalence between passivity and the feasibility of passivity encoding representations, thereby elaborating upon existing results for port-Hamiltonian systems. Based on our findings, we present a method to construct port-Hamiltonian representations of a passive system if the dynamics and the Hamiltonian are known.

math.DS

Balanced truncation with conformal maps

We consider the problem of constructing reduced models for large scale systems with poles in general domains in the complex plane (as opposed to, e.g., the open left-half plane or the open unit disk). Our goal is to design a model reduction scheme, building upon theoretically established methodologies, yet encompassing this new class of models. To this aim, we develop a balanced truncation framework through conformal maps to handle poles in general domains. The major difference from classical balanced truncation resides in the formulation of the Gramians. We show that these new Gramians can still be computed by solving modified Lyapunov equations for specific conformal maps. A numerical algorithm to perform balanced truncation with conformal maps is developed and is tested on three numerical examples, namely a heat model, the Schrödinger equation, and the undamped linear wave equation, the latter two having spectra on the imaginary axis.

math.NA

Improving the Convergence Rates for the Kinetic Fokker-Planck Equation by Optimal Control

The long time behavior and detailed convergence analysis of Langevin equations has received increased attention over the last years. Difficulties arise from a lack of coercivity, usually termed hypocoercivity, of the underlying kinetic Fokker-Planck operator which is a consequence of the partially deterministic nature of a second order stochastic differential equation. In this manuscript, the effect of controlling the confinement potential without altering the original invariant measure is investigated. This leads to an abstract bilinear control system with an unbounded but infinite-time admissible control operator which, by means of an artificial diffusion approach, is shown to possess a unique solution. The compactness of the underlying semigroup is further used to define an infinite-horizon optimal control problem on an appropriately reduced state space. Under smallness assumptions on the initial data, feasibility of and existence of a solution to the optimal control problem are discussed. Numerical results based on a local approximation based on a shifted Riccati equation illustrate the theoretical findings.

math.OC

Optimal control of a nonlinear kinetic Fokker-Planck equation

A tracking type optimal control problem for a nonlinear and nonlocal kinetic Fokker-Planck equation which arises as the mean field limit of an interacting particle systems that is subject to distance dependent random fluctuations is studied. As the equation of interest is only hypocoercive and the control operator is unbounded with respect to the canonical state space, classical variational solution techniques cannot be utilized directly. Instead, the concept of admissible control operators is employed. For the underlying nonlinearities, local Lipschitz estimates are derived and subsequently used within a fixed point argument to obtain local existence of solutions. Again, due to hypocoercivity, existence of optimal controls requires non standard techniques as (compensated) compactness arguments are not readily available.

math.OC

Optimal control for a class of linear transport-dominated systems via the shifted proper orthogonal decomposition

Solving optimal control problems for transport-dominated partial differential equations (PDEs) can become computationally expensive, especially when dealing with high-dimensional systems. To overcome this challenge, we focus on developing and deriving reduced-order models that can replace the full PDE system in solving the optimal control problem. Specifically, we explore the use of the shifted proper orthogonal decomposition (POD) as a reduced-order model, which is particularly effective for capturing high-fidelity, low-dimensional representations of transport-dominated phenomena. Furthermore, we propose two distinct frameworks for addressing these problems: one where the reduced-order model is constructed first, followed by optimization of the reduced system, and another where the original PDE system is optimized first, with the reduced-order model subsequently applied to the optimality system. We consider a 1D linear advection equation problem and compare the computational performance of the shifted POD method against the conventional methods like the standard POD when the reduced-order models are used as surrogates within a backtracking line search.

math.OC

Structure-Preserving Linear Quadratic Gaussian Balanced Truncation for Port-Hamiltonian Descriptor Systems

We present a new balancing-based structure-preserving model reduction technique for linear port-Hamiltonian descriptor systems. The proposed method relies on a modification of a set of two dual generalized algebraic Riccati equations that arise in the context of linear quadratic Gaussian balanced truncation for differential algebraic systems. We derive an a priori error bound with respect to a right coprime factorization of the underlying transfer function thereby allowing for an estimate with respect to the gap metric. We further theoretically and numerically analyze the influence of the Hamiltonian and a change thereof, respectively. With regard to this change of the Hamiltonian, we provide a novel procedure that is based on a recently introduced Kalman-Yakubovich-Popov inequality for descriptor systems. Numerical examples demonstrate how the quality of reduced-order models can significantly be improved by first computing an extremal solution to this inequality.

math.OC

H2 optimal rational approximation on general domains

Optimal model reduction for large-scale linear dynamical systems is studied. In contrast to most existing works, the systems under consideration are not required to be stable, neither in discrete nor in continuous time. As a consequence, the underlying rational transfer functions are allowed to have poles in general domains in the complex plane. In particular, this covers the case of specific conservative partial differential equations such as the linear Schrödinger and the undamped linear wave equation with spectra on the imaginary axis. By an appropriate modification of the classical continuous time Hardy space $\mathcal{H}_2$, a new $\mathcal{H}_2$ like optimal model reduction problem is introduced and first order optimality conditions are derived. As in the classical $\mathcal{H}_2$ case, these conditions exhibit a rational Hermite interpolation structure for which an iterative model reduction algorithm is proposed. Numerical examples demonstrate the effectiveness of the new method.

math.NA

Numerical realization of the Mortensen observer via a Hessian-augmented polynomial approximation of the value function

Two related numerical schemes for the realization of the Mortensen observer or minimum energy estimator for the state reconstruction of non-linear dynamical systems subject to deterministic disturbances are proposed and compared. Both approaches rely on a polynomial approximation of the value function associated with the energy of the disturbances of the system. Such an approximation is obtained via interpolation considering not only the values but also first and second order derivatives of the value function in a set of sampling points. The scheme is applied to four examples and the results are compared with the well known extended Kalman filter.

math.OC

On the approximability of Koopman-based operator Lyapunov equations

Lyapunov functions play a vital role in the context of control theory for nonlinear dynamical systems. Besides its classical use for stability analysis, Lyapunov functions also arise in iterative schemes for computing optimal feedback laws such as the well-known policy iteration. In this manuscript, the focus is on the Lyapunov function of a nonlinear autonomous finite-dimensional dynamical system which will be rewritten as an infinite-dimensional linear system using the Koopman or composition operator. Since this infinite-dimensional system has the structure of a weak-* continuous semigroup, in a specially weighted $\mathrm{L}^p$-space one can establish a connection between the solution of an operator Lyapunov equation and the desired Lyapunov function. It will be shown that the solution to this operator equation attains a rapid eigenvalue decay which justifies finite rank approximations with numerical methods. The potential benefit for numerical computations will be demonstrated with two short examples.

math.OC