Searcharxiv⌕ Search

arXiv subjects

Peter Benner

Publications and source records attributed to Peter Benner.

At least 73 records · Page 4Linked to original sources

A Robust SINDy Approach by Combining Neural Networks and an Integral Form

The discovery of governing equations from data has been an active field of research for decades. One widely used methodology for this purpose is sparse regression for nonlinear dynamics, known as SINDy. Despite several attempts, noisy and scarce data still pose a severe challenge to the success of the SINDy approach. In this work, we discuss a robust method to discover nonlinear governing equations from noisy and scarce data. To do this, we make use of neural networks to learn an implicit representation based on measurement data so that not only it produces the output in the vicinity of the measurements but also the time-evolution of output can be described by a dynamical system. Additionally, we learn such a dynamic system in the spirit of the SINDy framework. Leveraging the implicit representation using neural networks, we obtain the derivative information -- required for SINDy -- using an automatic differentiation tool. To enhance the robustness of our methodology, we further incorporate an integral condition on the output of the implicit networks. Furthermore, we extend our methodology to handle data collected from multiple initial conditions. We demonstrate the efficiency of the proposed methodology to discover governing equations under noisy and scarce data regimes by means of several examples and compare its performance with existing methods.

math.DS↗

Deep Learning for Structure-Preserving Universal Stable Koopman-Inspired Embeddings for Nonlinear Canonical Hamiltonian Dynamics

Discovering a suitable coordinate transformation for nonlinear systems enables the construction of simpler models, facilitating prediction, control, and optimization for complex nonlinear systems. To that end, Koopman operator theory offers a framework for global linearization for nonlinear systems, thereby allowing the usage of linear tools for design studies. In this work, we focus on the identification of global linearized embeddings for canonical nonlinear Hamiltonian systems through a symplectic transformation. While this task is often challenging, we leverage the power of deep learning to discover the desired embeddings. Furthermore, to overcome the shortcomings of Koopman operators for systems with continuous spectra, we apply the lifting principle and learn global cubicized embeddings. Additionally, a key emphasis is paid to enforce the bounded stability for the dynamics of the discovered embeddings. We demonstrate the capabilities of deep learning in acquiring compact symplectic coordinate transformation and the corresponding simple dynamical models, fostering data-driven learning of nonlinear canonical Hamiltonian systems, even those with continuous spectra.

cs.LG↗

Periodic optimal control of a plug flow reactor model with an isoperimetric constraint

We study a class of nonlinear hyperbolic partial differential equations with boundary control. This class describes chemical reactions of the type ``$A \to$ product'' carried out in a plug flow reactor (PFR) in the presence of an inert component. An isoperimetric optimal control problem with periodic boundary conditions and input constraints is formulated for the considered mathematical model in order to maximize the mean amount of product over the period. For the single-input system, the optimality of a bang-bang control strategy is proved in the class of bounded measurable inputs. The case of controlled flow rate input is also analyzed by exploiting the method of characteristics. A case study is performed to illustrate the performance of the reaction model under different control strategies.

math.OC↗

Parameterized Interpolation of Passive Systems

We study the tangential interpolation problem for a passive transfer function in standard state-space form. We derive new interpolation conditions based on the computation of a deflating subspace associated with a selection of spectral zeros of a parameterized para-Hermitian transfer function. We show that this technique improves the robustness of the low order model and that it can also be applied to non-passive systems, provided they have sufficiently many spectral zeros in the open right half plane. We analyze the accuracy needed for the computation of the deflating subspace, in order to still have a passive lower order model and we derive a novel selection procedure of spectral zeros in order to obtain low order models with a small approximation error.

math.NA↗

Linearly Implicit Global Energy Preserving Reduced-order Models for Cubic Hamiltonian Systems

This work discusses the model reduction problem for large-scale multi-symplectic PDEs with cubic invariants. For this, we present a linearly implicit global energy-preserving method to construct reduced-order models. This allows to construct reduced-order models in the form of Hamiltonian systems suitable for long-time integration. Furthermore, We prove that the constructed reduced-order models preserve global energy, and the spatially discrete equations also preserve the spatially-discrete local energy conversation law. We illustrate the efficiency of the proposed method using three numerical examples, namely a linear wave equation, the Korteweg-de Vries equation, and the Camassa-Holm equation, and present a comparison with the classical POD-Galerkin method.

math.NA↗

Parametric Dynamic Mode Decomposition for nonlinear parametric dynamical systems

A non-intrusive model order reduction (MOR) method that combines features of the dynamic mode decomposition (DMD) and the radial basis function (RBF) network is proposed to predict the dynamics of parametric nonlinear systems. In many applications, we have limited access to the information of the whole system, which motivates non-intrusive model reduction. One bottleneck is capturing the dynamics of the solution without knowing the physics inside the "black-box" system. DMD is a powerful tool to mimic the dynamics of the system and give a reliable approximation of the solution in the time domain using only the dominant DMD modes. However, DMD cannot reproduce the parametric behavior of the dynamics. Our contribution focuses on extending DMD to parametric DMD by RBF interpolation. Specifically, a RBF network is first trained using snapshot matrices at limited parameter samples. The snapshot matrix at any new parameter sample can be quickly learned from the RBF network. DMD will use the newly generated snapshot matrix at the online stage to predict the time patterns of the dynamics corresponding to the new parameter sample. The proposed framework and algorithm are tested and validated by numerical examples including models with parametrized and time-varying inputs.

math.NA↗

A Low-rank Method for Parameter-dependent Fluid-structure Interaction Discretizations With Hyperelasticity

Fluid-structure interaction models are used to study how a material interacts with different fluids at different Reynolds numbers. Examining the same model not only for different fluids but also for different solids allows to optimize the choice of materials for construction even better. A possible answer to this demand is parameter-dependent discretization. Furthermore, low-rank techniques can reduce the complexity needed to compute approximations to parameter-dependent fluid-structure interaction discretizations. Low-rank methods have been applied to parameter-dependent linear fluid-structure interaction discretizations. The linearity of the operators involved allows to translate the resulting equations to a single matrix equation. The solution is approximated by a low-rank method. In this paper, we propose a new method that extends this framework to nonlinear parameter-dependent fluid-structure interaction problems by means of the Newton iteration. The parameter set is split into disjoint subsets. On each subset, the Newton approximation of the problem related to the upper median parameter is computed and serves as initial guess for one Newton step on the whole subset. This Newton step yields a matrix equation whose solution can be approximated by a low-rank method. The resulting method requires a smaller number of Newton steps if compared with a direct approach that applies the Newton iteration to the separate problems consecutively. In the experiments considered, the proposed method allows to compute a low-rank approximation up to twenty times faster than by the direct approach.

math.NA↗

Accurate error estimation for model reduction of nonlinear dynamical systems via data-enhanced error closure

Accurate error estimation is crucial in model order reduction, both to obtain small reduced-order models and to certify their accuracy when deployed in downstream applications such as digital twins. In existing a posteriori error estimation approaches, knowledge about the time integration scheme is mandatory, e.g., the residual-based error estimators proposed for the reduced basis method. This poses a challenge when automatic ordinary differential equation solver libraries are used to perform the time integration. To address this, we present a data-enhanced approach for a posteriori error estimation. Our new formulation enables residual-based error estimators to be independent of any time integration method. To achieve this, we introduce a corrected reduced-order model which takes into account a data-driven closure term for improved accuracy. The closure term, subject to mild assumptions, is related to the local truncation error of the corresponding time integration scheme. We propose efficient computational schemes for approximating the closure term, at the cost of a modest amount of training data. Furthermore, the new error estimator is incorporated within a greedy process to obtain parametric reduced-order models. Numerical results on three different systems show the accuracy of the proposed error estimation approach and its ability to produce ROMs that generalize well.

math.NA↗

Towards a Benchmark Framework for Model Order Reduction in the Mathematical Research Data Initiative (MaRDI)

The race for the most efficient, accurate, and universal algorithm in scientific computing drives innovation. At the same time, this healthy competition is only beneficial if the research output is actually comparable to prior results. Fairly comparing algorithms can be a complex endeavor, as the implementation, configuration, compute environment, and test problems need to be well-defined. Due to the increase in computer-based experiments, new infrastructure for facilitating the exchange and comparison of new algorithms is also needed. To this end, we propose a benchmark framework, as a set of generic specifications for comparing implementations of algorithms using test cases native to a community. Its value lies in its ability to fairly compare and validate existing methods for new applications, as well as compare newly developed methods with existing ones. As a prototype for a more general framework, we have begun building a benchmark tool for the model order reduction (MOR) community. The data basis of the tool is the collection of the Model Order Reduction Wiki (MORWiki). The wiki features three main categories: benchmarks, methods, and software. An editorial board curates submissions and patrols edited entries. Data sets for linear and parametric-linear models are already well represented in the existing collection. Data sets for non-linear or procedural models, for which only evaluation data, or codes / algorithmic descriptions, rather than equations, are available, are being added and extended. Properties and interesting characteristics used for benchmark selection and later assessments are recorded in the model metadata. Our tool, the Model Order Reduction Benchmarker (MORB) is under active development for linear time-invariant systems and solvers.

cs.MS↗

Adjacency-based, Non-intrusive Reduced-order Modeling for Fluid-Structure Interactions

Non-intrusive model reduction is a promising solution to system dynamics prediction, especially in cases where data are collected from experimental campaigns or proprietary software simulations. In this work, we present a method for non-intrusive model reduction applied to Fluid-Structure Interaction (FSI) problems. The approach is based on the a priori known sparsity of the full-order system operators, which is dictated by grid adjacency information. In order to enforce this type of sparsity, we solve a local, regularized least-squares problem for each degree of freedom on a grid, considering only the training data from adjacent degrees of freedom, thus making computation and storage of the inferred full-order operators feasible. After constructing the non-intrusive, sparse full-order model, Proper Orthogonal Decomposition (POD) is used for its projection to a reduced dimension subspace and thus the construction of a reduced-order model (ROM). The methodology is applied to the challenging Hron-Turek benchmark FSI3, for Re = 200. A physics-informed, non-intrusive ROM is constructed to predict the two-way coupled dynamics of a solid with a deformable, slender tail, subject to an incompressible, laminar flow. Results considering the accuracy and predictive capabilities of the inferred reduced models are discussed.

physics.flu-dyn↗

Solution decomposition for the nonlinear Poisson-Boltzmann equation using the range-separated tensor format

The Poisson-Boltzmann equation (PBE) is an implicit solvent continuum model for calculating the electrostatic potential and energies of ionic solvated biomolecules. However, its numerical solution remains a significant challenge due strong singularities and nonlinearity caused by the singular source terms and the exponential nonlinear terms, respectively. An efficient method for the treatment of singularities in the linear PBE was introduced in \cite{BeKKKS:18}, that is based on the RS tensor decomposition for both electrostatic potential and the discretized Dirac delta distribution. In this paper, we extend this regularization method to the nonlinear PBE. We apply the PBE only to the regular part of the solution corresponding to the modified right-hand side via extraction of the long-range part in the discretized Dirac delta distribution. The total electrostatic potential is obtained by adding the long-range solution to the directly precomputed short-range potential. The main computational benefit of the approach is the automatic maintaining of the continuity in the Cauchy data on the solute-solvent interface. The boundary conditions are also obtained from the long-range component of the precomputed canonical tensor representation of the Newton kernel. In the numerical experiments, we illustrate the accuracy of the nonlinear regularized PBE (NRPBE) over the classical variant.

math.NA↗

Active-Learning-Driven Surrogate Modeling for Efficient Simulation of Parametric Nonlinear Systems

When repeated evaluations for varying parameter configurations of a high-fidelity physical model are required, surrogate modeling techniques based on model order reduction are desired. In absence of the governing equations describing the dynamics, we need to construct the parametric reduced-order surrogate model in a non-intrusive fashion. In this setting, the usual residual-based error estimate for optimal parameter sampling associated with the reduced basis method is not directly available. Our work provides a non-intrusive optimality criterion to efficiently populate the parameter snapshots, thereby, enabling us to effectively construct a parametric surrogate model. We consider separate parameter-specific proper orthogonal decomposition (POD) subspaces and propose an active-learning-driven surrogate model using kernel-based shallow neural networks, abbreviated as ActLearn-POD-KSNN surrogate model. To demonstrate the validity of our proposed ideas, we present numerical experiments using two physical models, namely Burgers' equation and shallow water equations. Both the models have mixed -- convective and diffusive -- effects within their respective parameter domains, with each of them dominating in certain regions. The proposed ActLearn-POD-KSNN surrogate model efficiently predicts the solution at new parameter locations, even for a setting with multiple interacting shock profiles.

cs.LG↗

Frequency-dependent Switching Control for Disturbance Attenuation of Linear Systems

The generalized Kalman-Yakubovich-Popov lemma as established by Iwasaki and Hara in 2005 marks a milestone in the analysis and synthesis of linear systems from a finite-frequency perspective. Given a pre-specified frequency band, it allows us to produce passive controllers with excellent in-band disturbance attenuation performance at the expense of some of the out-of-band performance. This paper focuses on control design of linear systems in the presence of disturbances with non-strictly or non-stationary limited frequency spectrum. We first propose a class of frequency-dependent excited energy functions (FD-EEF) as well as frequency-dependent excited power functions (FD-EPF), which possess a desirable frequency-selectiveness property with regard to the in-band and out-of-band excited energy as well as excited power of the system. Based upon a group of frequency-selective passive controllers, we then develop a frequency-dependent switching control (FDSC) scheme that selects the most appropriate controller at runtime. We show that our FDSC scheme is capable to approximate the solid in-band performance while maintaining acceptable out-of-band performance with regard to global time horizons as well as localized time horizons. The method is illustrated by a commonly used benchmark model.

eess.SY↗

Semi-active damping optimization of vibrational systems using the reduced basis method

In this article, we consider vibrational systems with semi-active damping that are described by a second-order model. In order to minimize the influence of external inputs to the system response, we are optimizing some damping values. As minimization criterion, we evaluate the energy response, that is the $\cH_2$-norm of the corresponding transfer function of the system. Computing the energy response includes solving Lyapunov equations for different damping parameters. Hence, the minimization process leads to high computational costs if the system is of large dimension. We present two techniques that reduce the optimization problem by applying the reduced basis method to the corresponding parametric Lyapunov equations. In the first method, we determine a reduced solution space on which the Lyapunov equations and hence the resulting energy response values are computed approximately in a reasonable time. The second method includes the reduced basis method in the minimization process. To evaluate the quality of the approximations, we introduce error estimators that evaluate the error in the controllability Gramians and the energy response. Finally, we illustrate the advantages of our methods by applying them to two different examples.

math.DS↗

Structured interpolation for multivariate transfer functions of quadratic-bilinear systems

High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simulated for a variety of situations such as different forcing terms. This motivates model reduction where the goal is to replace the full-order dynamics with accurate reduced-order surrogates. Interpolation-based model reduction has been proven to be an effective tool for the construction of cheap-to-evaluate surrogate models that preserve the internal structure in the case of weak nonlinearities. In this paper, we consider the construction of multivariate interpolants in frequency domain for structured quadratic-bilinear systems. We propose definitions for structured variants of the symmetric subsystem and generalized transfer functions of quadratic-bilinear systems and provide conditions for structure-preserving interpolation by projection. The theoretical results are illustrated using two numerical examples including the simulation of molecular dynamics in crystal structures.

math.NA↗

Inf-Sup-Constant-Free State Error Estimator for Model Order Reduction of Parametric Systems in Electromagnetics

A reliable model order reduction process for parametric analysis in electromagnetics is detailed. Special emphasis is placed on certifying the accuracy of the reduced-order model. For this purpose, a sharp state error estimator is proposed. Standard a posteriori state error estimation for model order reduction relies on the inf-sup constant. For parametric systems, the inf-sup constant is parameter-dependent. The a posteriori error estimation for systems with very small or vanishing inf-sup constant poses a challenge, since it is inversely proportional to the inf-sup constant, resulting in rather useless, overly pessimistic error estimators. Such systems appear in electromagnetics since the inf-sup constant values are close to zero at points close to resonant frequencies, where they eventually vanish. We propose a novel a posteriori state error estimator which avoids the calculation of the inf-sup constant. The proposed state error estimator is compared with the standard error estimator and a recently proposed one in the literature. It is shown that our proposed error estimator outperforms both existing estimators. Numerical experiments are performed on real-life microwave devices such as narrowband and wideband antennas, two types of dielectric resonator filters as well as a dual-mode waveguide filter. These examples show the capabilities and efficiency of the proposed methodology.

math.NA↗

Exponential Lag Synchronization of Cohen-Grossberg Neural Networks with Discrete and Distributed Delays on Time Scales

In this article, we investigate exponential lag synchronization results for the Cohen-Grossberg neural networks (C-GNNs) with discrete and distributed delays on an arbitrary time domain by applying feedback control. We formulate the problem by using the time scales theory so that the results can be applied to any uniform or non-uniform time domains. Also, we provide a comparison of results that shows that obtained results are unified and generalize the existing results. Mainly, we use the unified matrix-measure theory and Halanay inequality to establish these results. In the last section, we provide two simulated examples for different time domains to show the effectiveness and generality of the obtained analytical results.

math.OC↗

Adjacency-based, non-intrusive model reduction for Vortex-Induced Vibrations

Vortex-induced vibrations (VIV) pose computationally expensive problems of high practical interest to several engineering fields. In this work we develop a non-intrusive, reduced-order modelling methodology for two-dimensional (2D) VIV simulations. We consider an elliptical, non-deformable solid mounted on springs, subject to a laminar, incompressible flow. Approximating the Arbitrary Lagrangian-Eulerian (ALE) incompressible Navier-Stokes (NS) formulation, a discrete-time, quadratic-bilinear data-driven model structure is assigned for the velocity flowfield prediction. The full-order, data-driven model operators have a predefined sparsity pattern, following the adjacency-based sparsity of the discretized ALE-NS operators. Thus, the data-driven operators inference requires solving many low-dimensional least squares problems, isolating the contribution of "nearest neighbours" for each degree of freedom. Numerical aspects such as data centering and regularization are extensively discussed. With this approach, Dirichlet boundary conditions at the inlet and the fluid/solid interface can be enforced on the full-order, non-intrusive level. Consequently, a non-intrusive reduced-order model (ROM) for the velocity flowfield is obtained after linear projection. The resulting ROM is coupled with the first-principle, 2D solid oscillation equations and is simulated using an implicit time integration scheme. The coupled solution is then mapped on the deformed grid through the inverse ALE map. This methodology is showcased for two testcases, at different Reynolds numbers (Re = 90, 180). Numerical results indicate a successful coupling between the data-driven velocity flowfield and the solid oscillation, with prediction errors of less than 3% for both the flowfield and the solid oscillation. A comparative study with respect to the ROM dimension indicates the robustness and potential of the approach.

physics.flu-dyn↗