Searcharxiv⌕ Search

arXiv subjects

Bernard Haasdonk

Publications and source records attributed to Bernard Haasdonk.

At least 37 records · Page 2Linked to original sources
arXiv2024

Model reduction on manifolds: A differential geometric framework

Using nonlinear projections and preserving structure in model order reduction (MOR) are currently active research fields. In this paper, we provide a novel differential geometric framework for model reduction on smooth manifolds, which emphasizes the geometric nature of the objects involved. The crucial ingredient is the construction of an embedding for the low-dimensional submanifold and a compatible reduction map, for which we discuss several options. Our general framework allows capturing and generalizing several existing MOR techniques, such as structure preservation for Lagrangian- or Hamiltonian dynamics, and using nonlinear projections that are, for instance, relevant in transport-dominated problems. The joint abstraction can be used to derive shared theoretical properties for different methods, such as an exact reproduction result. To connect our framework to existing work in the field, we demonstrate that various techniques for data-driven construction of nonlinear projections can be included in our framework.

math.NA↗
arXiv2023

Approximation Bounds for Model Reduction on Polynomially Mapped Manifolds

For projection-based linear-subspace model order reduction (MOR), it is well known that the Kolmogorov n-width describes the best-possible error for a reduced order model (ROM) of size n. In this paper, we provide approximation bounds for ROMs on polynomially mapped manifolds. In particular, we show that the approximation bounds depend on the polynomial degree p of the mapping function as well as on the linear Kolmogorov n-width for the underlying problem. This results in a Kolmogorov (n, p)-width, which describes a lower bound for the best-possible error for a ROM on polynomially mapped manifolds of polynomial degree p and reduced size n.

math.NA↗
arXiv2023

On the optimality of target-data-dependent kernel greedy interpolation in Sobolev Reproducing Kernel Hilbert Spaces

Kernel interpolation is a versatile tool for the approximation of functions from data, and it can be proven to have some optimality properties when used with kernels related to certain Sobolev spaces. In the context of interpolation, the selection of optimal function sampling locations is a central problem, both from a practical perspective, and as an interesting theoretical question. Greedy interpolation algorithms provide a viable solution for this task, being efficient to run and provably accurate in their approximation. In this paper we close a gap that is present in the convergence theory for these algorithms by employing a recent result on general greedy algorithms. This modification leads to new convergence rates which match the optimal ones when restricted to the $P$-greedy target-data-independent selection rule, and can additionally be proven to be optimal when they fully exploit adaptivity ($f$-greedy). Other than closing this gap, the new results have some significance in the broader setting of the optimality of general approximation algorithms in Reproducing Kernel Hilbert Spaces, as they allow us to compare adaptive interpolation with non-adaptive best nonlinear approximation.

math.NA↗
arXiv2023

Stability of convergence rates: Kernel interpolation on non-Lipschitz domains

Error estimates for kernel interpolation in Reproducing Kernel Hilbert Spaces (RKHS) usually assume quite restrictive properties on the shape of the domain, especially in the case of infinitely smooth kernels like the popular Gaussian kernel. In this paper we leverage an analysis of greedy kernel algorithms to prove that it is possible to obtain convergence results (in the number of interpolation points) for kernel interpolation for arbitrary domains $Ω\subset \mathbb{R}^d$, thus allowing for non-Lipschitz domains including e.g. cusps and irregular boundaries. Especially we show that, when going to a smaller domain $\tildeΩ \subset Ω\subset \mathbb{R}^d$, the convergence rate does not deteriorate - i.e. the convergence rates are stable with respect to going to a subset. The impact of this result is explained on the examples of kernels of finite as well as infinite smoothness like the Gaussian kernel. A comparison to approximation in Sobolev spaces is drawn, where the shape of the domain $Ω$ has an impact on the approximation properties. Numerical experiments illustrate and confirm the experiments.

math.NA↗
arXiv2023

Hermite kernel surrogates for the value function of high-dimensional nonlinear optimal control problems

Numerical methods for the optimal feedback control of high-dimensional dynamical systems typically suffer from the curse of dimensionality. In the current presentation, we devise a mesh-free data-based approximation method for the value function of optimal control problems, which partially mitigates the dimensionality problem. The method is based on a greedy Hermite kernel interpolation scheme and incorporates context-knowledge by its structure. Especially, the value function surrogate is elegantly enforced to be 0 in the target state, non-negative and constructed as a correction of a linearized model. The algorithm is proposed in a matrix-free way, which circumvents the large-matrix-problem for multivariate Hermite interpolation. For finite time horizons, both convergence of the surrogate to the value function as well as for the surrogate vs. the optimal controlled dynamical system are proven. Experiments support the effectiveness of the scheme, using among others a new academic model that has a scalable dimension and an explicitly given value function. It may also be useful for the community to validate other optimal control approaches.

math.OC↗
arXiv2023

Dictionary-based Online-adaptive Structure-preserving Model Order Reduction for Parametric Hamiltonian Systems

Classical model order reduction (MOR) for parametric problems may become computationally inefficient due to large sizes of the required projection bases, especially for problems with slowly decaying Kolmogorov n-widths. Additionally, Hamiltonian structure of dynamical systems may be available and should be preserved during the reduction. In the current presentation, we address these two aspects by proposing a corresponding dictionary-based, online-adaptive MOR approach. The method requires dictionaries for the state-variable, non-linearities and discrete empirical interpolation (DEIM) points. During the online simulation, local basis extensions/simplifications are performed in an online-efficient way, i.e. the runtime complexity of basis modifications and online simulation of the reduced models do not depend on the full state dimension. Experiments on a linear wave equation and a non-linear Sine-Gordon example demonstrate the efficiency of the approach.

math.NA↗
arXiv2023

Improved a posteriori Error Bounds for Reduced port-Hamiltonian Systems

Projection-based model order reduction of dynamical systems usually introduces an error between the high-fidelity model and its counterpart of lower dimension. This unknown error can be bounded by residual-based methods, which are typically known to be highly pessimistic in the sense of largely overestimating the true error. This work applies two improved error bounding techniques, namely (a) a hierarchical error bound and (b) an error bound based on an auxiliary linear problem, to the case of port-Hamiltonian systems. The approaches rely on a second approximation of (a) the dynamical system and (b) the error system. In this paper, these methods are for the first time adapted to port-Hamiltonian systems by exploiting their structure. The mathematical relationship between the two methods is discussed both, theoretically and numerically. The effectiveness of the described methods is demonstrated using a challenging three-dimensional port-Hamiltonian model of a classical guitar with fluid-structure interaction.

math.NA↗
arXiv2023

Randomized Symplectic Model Order Reduction for Hamiltonian Systems

Simulations of large scale dynamical systems in multi-query or real-time contexts require efficient surrogate modelling techniques, as e.g. achieved via Model Order Reduction (MOR). Recently, symplectic methods like the complex singular value decomposition (cSVD) or the SVD-like decomposition have been developed for preserving Hamiltonian structure during MOR. In the current contribution, we show how symplectic structure preserving basis generation can be made more efficient with randomized matrix factorizations. We present a randomized complex SVD (rcSVD) algorithm and a randomized SVD-like (rSVD-like) decomposition. We demonstrate the efficiency of the approaches with numerical experiments on high dimensional systems.

math.NA↗
arXiv2023

Application of Deep Kernel Models for Certified and Adaptive RB-ML-ROM Surrogate Modeling

In the framework of reduced basis methods, we recently introduced a new certified hierarchical and adaptive surrogate model, which can be used for efficient approximation of input-output maps that are governed by parametrized partial differential equations. This adaptive approach combines a full order model, a reduced order model and a machine-learning model. In this contribution, we extend the approach by leveraging novel kernel models for the machine learning part, especially structured deep kernel networks as well as two layered kernel models. We demonstrate the usability of those enhanced kernel models for the RB-ML-ROM surrogate modeling chain and highlight their benefits in numerical experiments.

math.NA↗
arXiv2022

An adaptive model hierarchy for data-augmented training of kernel models for reactive flow

We consider machine-learning of time-dependent quantities of interest derived from solution trajectories of parabolic partial differential equations. For large-scale or long-time integration scenarios, where using a full order model (FOM) to generate sufficient training data is computationally prohibitive, we propose an adaptive hierarchy of intermediate Reduced Basis reduced order models (ROM) to augment the FOM training data by certified ROM training data required to fit a kernel model.

math.NA↗
arXiv2022

Port-Hamiltonian Fluid-Structure Interaction Modeling and Structure-Preserving Model Order Reduction of a Classical Guitar

A fluid-structure interaction model in a port-Hamiltonian representation is derived for a classical guitar. We combine the laws of continuum mechanics for solids and fluids within a unified port-Hamiltonian (pH) modeling approach by adapting the discretized equations on second-order level in order to obtain a damped multi-physics model. The high-dimensionality of the resulting system is reduced by model order reduction. The article focuses on pH-systems in different state transformations, a variety of basis generation techniques as well as structure-preserving model order reduction approaches that are independent from the projection basis. As main contribution a thorough comparison of these method combinations is conducted. In contrast to typical frequency-based simulations in acoustics, transient time simulations of the system are presented. The approach is embedded into a straightforward workflow of sophisticated commercial software modeling and flexible in-house software for multi-physics coupling and model order reduction.

math.DS↗
arXiv2021

Symplectic Model Reduction of Hamiltonian Systems on Nonlinear Manifolds

Classical model reduction techniques project the governing equations onto linear subspaces of the high-dimensional state-space. For problems with slowly decaying Kolmogorov-n-widths such as certain transport-dominated problems, however, classical linear-subspace reduced-order models (ROMs) of low dimension might yield inaccurate results. Thus, the concept of classical linear-subspace ROMs has to be extended to more general concepts, like Model Order Reduction (MOR) on manifolds. Moreover, as we are dealing with Hamiltonian systems, it is crucial that the underlying symplectic structure is preserved in the reduced model, as otherwise it could become unphysical in the sense that the energy is not conserved or stability properties are lost. To the best of our knowledge, existing literature addresses either MOR on manifolds or symplectic model reduction for Hamiltonian systems, but not their combination. In this work, we bridge the two aforementioned approaches by providing a novel projection technique called symplectic manifold Galerkin (SMG), which projects the Hamiltonian system onto a nonlinear symplectic trial manifold such that the reduced model is again a Hamiltonian system. We derive analytical results such as stability, energy-preservation and a rigorous a-posteriori error bound. Moreover, we construct a weakly symplectic deep convolutional autoencoder as a computationally practical approach to approximate a nonlinear symplectic trial manifold. Finally, we numerically demonstrate the ability of the method to outperform (non-)structure-preserving linear-subspace ROMs and non-structure-preserving MOR on manifold techniques.

math.NA↗
arXiv2021

Surrogate-data-enriched Physics-Aware Neural Networks

Neural networks can be used as surrogates for PDE models. They can be made physics-aware by penalizing underlying equations or the conservation of physical properties in the loss function during training. Current approaches allow to additionally respect data from numerical simulations or experiments in the training process. However, this data is frequently expensive to obtain and thus only scarcely available for complex models. In this work, we investigate how physics-aware models can be enriched with computationally cheaper, but inexact, data from other surrogate models like Reduced-Order Models (ROMs). In order to avoid trusting too-low-fidelity surrogate solutions, we develop an approach that is sensitive to the error in inexact data. As a proof of concept, we consider the one-dimensional wave equation and show that the training accuracy is increased by two orders of magnitude when inexact data from ROMs is incorporated.

cs.LG↗
arXiv2021

Reduced Basis Methods for Efficient Simulation of a Rigid Robot Hand Interacting with Soft Tissue

We present efficient reduced basis (RB) methods for the simulation of the coupled problem consisting of a rigid robot hand interacting with soft tissue material which is modeled by the linear elasticity equation and discretized with the Finite Element Method. We look at two different scenarios: (i) the forward simulation and (ii) a feedback control formulation of the model. In both cases, large-scale systems of equations appear, which need to be solved in real-time. This is essential in practice for the implementation in a real robot. For the feedback-scenario, in the context of the linear quadratic regulator, we encounter a high-dimensional Algebraic Riccati Equation (ARE). To overcome the real-time constraint by significantly reducing the computational complexity, we use several structure-preserving and non-structure-preserving reduction methods. These include proper orthogonal decomposition-based reduced basis techniques. For the ARE, instead of solving a full dimensional problem we compute a low-rank-factor and hence a low-dimensional ARE is solved. Numerical examples for both cases are provided. These illustrate the approximation quality of the reduced solution and speedup factors of the different reduction approaches.

math.NA↗
arXiv2021

Analysis of target data-dependent greedy kernel algorithms: Convergence rates for $f$-, $f \cdot P$- and $f/P$-greedy

Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been presented. This situation is unsatisfactory especially when compared to the case of the data-independent $P$-greedy algorithm, for which optimal convergence rates are available, despite its performances being usually inferior to the ones of target data-dependent algorithms. In this work we fill this gap by first defining a new scale of greedy algorithms for interpolation that comprises all the existing ones in a unique analysis, where the degree of dependency of the selection criterion on the functional data is quantified by a real parameter. We then prove new convergence rates where this degree is taken into account and we show that, possibly up to a logarithmic factor, target data-dependent selection strategies provide faster convergence. In particular, for the first time we obtain convergence rates for target data adaptive interpolation that are faster than the ones given by uniform points, without the need of any special assumption on the target function. The rates are confirmed by a number of examples. These results are made possible by a new analysis of greedy algorithms in general Hilbert spaces.

math.NA↗
arXiv2021

Structured Deep Kernel Networks for Data-Driven Closure Terms of Turbulent Flows

Standard kernel methods for machine learning usually struggle when dealing with large datasets. We review a recently introduced Structured Deep Kernel Network (SDKN) approach that is capable of dealing with high-dimensional and huge datasets - and enjoys typical standard machine learning approximation properties. We extend the SDKN to combine it with standard machine learning modules and compare it with Neural Networks on the scientific challenge of data-driven prediction of closure terms of turbulent flows. We show experimentally that the SDKNs are capable of dealing with large datasets and achieve near-perfect accuracy on the given application.

cs.LG↗
arXiv2020

Kernel methods for center manifold approximation and a data-based version of the Center Manifold Theorem

For dynamical systems with a non hyperbolic equilibrium, it is possible to significantly simplify the study of stability by means of the center manifold theory. This theory allows to isolate the complicated asymptotic behavior of the system close to the equilibrium point and to obtain meaningful predictions of its behavior by analyzing a reduced order system on the so-called center manifold. Since the center manifold is usually not known, good approximation methods are important as the center manifold theorem states that the stability properties of the origin of the reduced order system are the same as those of the origin of the full order system. In this work, we establish a data-based version of the center manifold theorem that works by considering an approximation in place of an exact manifold. Also the error between the approximated and the original reduced dynamics are quantified. We then use an apposite data-based kernel method to construct a suitable approximation of the manifold close to the equilibrium, which is compatible with our general error theory. The data are collected by repeated numerical simulation of the full system by means of a high-accuracy solver, which generates sets of discrete trajectories that are then used as a training set. The method is tested on different examples which show promising performance and good accuracy.

math.NA↗