arXiv subjects

Serkan Gugercin

Publications and source records attributed to Serkan Gugercin.

At least 37 records · Page 2Linked to original sources

arXiv2025

Energy-Based Approximation of Linear Systems with Polynomial Outputs

Controllability and observability energy functions play a fundamental role in model order reduction and are inherently connected to optimal control problems. For linear dynamical systems the energy functions are known to be quadratic polynomials and various low-rank approximation techniques allow for computing them in a large-scale setting. For nonlinear problems computing the energy functions is significantly more challenging. In this paper, we investigate a special class of nonlinear systems that have a linear state and a polynomial output equation. We show that the energy functions of these systems are again polynomials and investigate under which conditions they can effectively be approximated using low-rank tensors. Further, we introduce a new perspective on the well-established balanced truncation method for linear systems which then readily generalizes to the nonlinear systems under consideration. This new perspective yields a novel energy-based model order reduction procedure that accurately captures the input-output behavior of linear systems with polynomial outputs via a low-dimensional reduced order model. We demonstrate the effectiveness of our approach via two numerical experiments.

math.DS↗

arXiv2025

Balanced truncation with conformal maps

We consider the problem of constructing reduced models for large scale systems with poles in general domains in the complex plane (as opposed to, e.g., the open left-half plane or the open unit disk). Our goal is to design a model reduction scheme, building upon theoretically established methodologies, yet encompassing this new class of models. To this aim, we develop a balanced truncation framework through conformal maps to handle poles in general domains. The major difference from classical balanced truncation resides in the formulation of the Gramians. We show that these new Gramians can still be computed by solving modified Lyapunov equations for specific conformal maps. A numerical algorithm to perform balanced truncation with conformal maps is developed and is tested on three numerical examples, namely a heat model, the Schrödinger equation, and the undamped linear wave equation, the latter two having spectra on the imaginary axis.

math.NA↗

arXiv2025

Multivariate Rational Approximation via Low-Rank Tensors and the p-AAA Algorithm

Approximations based on rational functions are widely used in various applications across computational science and engineering. For univariate functions, the adaptive Antoulas-Anderson algorithm (AAA), which uses the barycentric form of a rational approximant, has established itself as a powerful tool for efficiently computing such approximations. The p-AAA algorithm, an extension of the AAA algorithm specifically designed to address multivariate approximation problems, has been recently introduced. A common challenge in multivariate approximation methods is that multivariate problems with a large number of variables often pose significant memory and computational demands. To tackle this hurdle in the setting of p-AAA, we first introduce barycentric forms that are represented in the terms of separable functions. This then leads to the low-rank p-AAA algorithm which leverages low-rank tensor decompositions in the setting of barycentric rational approximations. We discuss various theoretical and practical aspects of the proposed computational framework and showcase its effectiveness on four numerical examples. We focus specifically on applications in parametric reduced-order modeling for which higher-dimensional data sets can be tackled effectively with our novel procedure.

math.NA↗

arXiv2024

Empirical sparse regression on quadratic manifolds

Approximating field variables and data vectors from sparse samples is a key challenge in computational science. Widely used methods such as gappy proper orthogonal decomposition and empirical interpolation rely on linear approximation spaces, limiting their effectiveness for data representing transport-dominated and wave-like dynamics. To address this limitation, we introduce quadratic manifold sparse regression, which trains quadratic manifolds with a sparse greedy method and computes approximations on the manifold through novel nonlinear projections of sparse samples. The nonlinear approximations obtained with quadratic manifold sparse regression achieve orders of magnitude higher accuracies than linear methods on data describing transport-dominated dynamics in numerical experiments.

math.NA↗

arXiv2024

Interpolatory Necessary Optimality Conditions for Reduced-order Modeling of Parametric Linear Time-invariant Systems

Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of non-parametric linear time-invariant (LTI) systems are known and well-investigated. In this work, using the general framework of $\mathcal{L}_2$-optimal reduced-order modeling of parametric stationary problems, we derive interpolatory $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimality conditions for parametric LTI systems with a general pole-residue form. We then specialize this result to recover known conditions for systems with parameter-independent poles and develop new conditions for a certain class of systems with parameter-dependent poles.

math.OC↗

arXiv2024

Interpolatory $\mathcal{H}_2$-optimality Conditions for Structured Linear Time-invariant Systems

Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of unstructured linear time-invariant (LTI) systems are well-known. Based on previous work on $\mathcal{L}_2$-optimal reduced-order modeling of stationary parametric problems, in this paper we develop and investigate optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of structured LTI systems, in particular, for second-order, port-Hamiltonian, and time-delay systems. Under certain diagonalizability assumptions, we show that across all these different structured settings, bitangential Hermite interpolation is the common form for optimality, thus proving a unifying optimality framework for structured reduced-order modeling.

math.NA↗

arXiv2024

A non-intrusive data-based reformulation of a hybrid projection-based model reduction method

We present a novel data-driven reformulation of the iterative SVD-rational Krylov algorithm (ISRK), in its original formulation a Petrov-Galerkin (two-sided) projection-based iterative method for model reduction combining rational Krylov subspaces (on one side) with Gramian/SVD based subspaces (on the other side). We show that in each step of ISRK, we do not necessarily require access to the original system matrices, but only to input/output data in the form of the system's transfer function, evaluated at particular values (frequencies). Numerical examples illustrate the efficiency of the new data-driven formulation.

math.NA↗

arXiv2024

Time-Domain Iterative Rational Krylov Method

The Realization Independent Iterative Rational Krylov Algorithm (TF-IRKA) is a frequency-based data-driven reduced order modeling (DDROM) method that constructs $\mathcal H_2$ optimal DDROMs. However, as the $\mathcal H_2$ optimal approximation theory dictates, TF-IRKA requires repeated sampling of frequency data, that is, values of the system transfer function and its derivative, outside the unit circle. This repeated evaluation of frequency data requires repeated full model computations and may not be feasible. The data-informativity framework for moment matching provides a method for obtaining such frequency data from a single time-domain simulation. However, this framework usually requires solving linear systems with prohibitively ill-conditioned matrices, especially when recovering frequency data from off the unit circle as required for optimality. In this paper, building upon our previous work with the data informativity framework for moment matching, we provide a formula for the nonzero extreme eigenvalues of a symmetric rank-$1$ perturbation to an orthogonal projection, which then leads to an optimal scaling of the aforementioned linear systems. We also establish connections between the underlying dynamical system and conditioning of these linear systems. This analysis then leads to our algorithmic development, time-domain IRKA, which allows us to implement a time-domain variant of TF-IRKA, constructing $\mathcal H_2$ optimal DDROMs from a single time-domain simulation without requiring repeated frequency data evaluations. The numerical examples illustrate the effectiveness of the proposed algorithm.

math.NA↗

arXiv2024

IRKA is a Riemannian Gradient Descent Method

The iterative rational Krylov algorithm (IRKA) is a commonly used fixed-point iteration developed to minimize the $\mathcal{H}_2$ model order reduction error. In this work, IRKA is recast as a Riemannian gradient descent method with a fixed step size over the manifold of rational functions having fixed degree. This interpretation motivates the development of a Riemannian gradient descent method utilizing as a natural extension variable step size and line search. Comparisons made between IRKA and this extension on a few examples demonstrate significant benefits.

math.NA↗

arXiv2024

Scalable Computation of Energy Functions for Nonlinear Balanced Truncation

Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. A computational challenges that has so far prevented its deployment on large-scale systems is that the energy functions required for characterization of controllability and observability are solutions of various high-dimensional Hamilton-Jacobi-(Bellman) equations, which are computationally intractable in high dimensions. This work proposes a unifying and scalable approach to this challenge by considering a Taylor-series-based approximation to solve a class of parametrized Hamilton-Jacobi-Bellman equations that are at the core of nonlinear balancing. The value of a formulation parameter provides either open-loop balancing or a variety of closed-loop balancing options. To solve for the coefficients of Taylor-series approximations to the energy functions, the presented method derives a linear tensor system and heavily utilizes it to numerically solve structured linear systems with billions of unknowns. The strength and scalability of the algorithm is demonstrated on two semi-discretized partial differential equations, namely the Burgers and the Kuramoto-Sivashinsky equations.

math.OC↗

arXiv2024

On the balanced truncation error bound and sign parameters from arrowhead realizations

Balanced truncation and singular perturbation approximation for linear dynamical systems yield reduced-order models that satisfy a well-known error bound involving the Hankel singular values. We show that this bound holds with equality for single-input, single-output systems, if the sign parameters corresponding to the truncated Hankel singular values are all equal. These signs are determined by a generalized state-space symmetry property of the corresponding linear model. For a special class of systems having arrowhead realizations, the signs can be determined directly from the off-diagonal entries of the corresponding arrowhead matrix. We describe how such arrowhead systems arise naturally in certain applications of network modeling, and illustrate these results with a power system model that motivated this study.

eess.SY↗

arXiv2024

Frequency-Based Reduced Models from Purely Time-Domain Data via Data Informativity

Frequency-based methods have been successfully employed in creating high fidelity data-driven reduced order models (DDROMs) for linear dynamical systems. These methods require access to values (and sometimes derivatives) of the frequency-response function (transfer function) in the complex plane. These frequency domain values can at times be costly or difficult to obtain (especially if the method of choice requires resampling); instead one may have access to only time-domain input-output data. The data informativity approach to moment matching provides a powerful new framework for recovering the required frequency data from a single time-domain trajectory. In this work, we analyze and extend upon this framework, resulting in vastly improved conditioning of the associated linear systems, an error indicator, and removal of an assumption that the system order is known. This analysis leads to a robust algorithm for recovering frequency information from time-domain data, suitable for large scale systems. We demonstrate the effectiveness of our algorithm by forming frequency based DDROMs from time-domain data of several dynamical systems.

math.NA↗

arXiv2023

A Unifying Framework for Interpolatory $\mathcal{L}_2$-optimal Reduced-order Modeling

We develop a unifying framework for interpolatory $\mathcal{L}_2$-optimal reduced-order modeling for a wide classes of problems ranging from stationary models to parametric dynamical systems. We first show that the framework naturally covers the well-known interpolatory necessary conditions for $\mathcal{H}_2$-optimal model order reduction and leads to the interpolatory conditions for $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimal model order reduction of multi-input/multi-output parametric dynamical systems. Moreover, we derive novel interpolatory optimality conditions for rational discrete least-squares minimization and for $\mathcal{L}_2$-optimal model order reduction of a class of parametric stationary models. We show that bitangential Hermite interpolation appears as the main tool for optimality across different domains. The theoretical results are illustrated on two numerical examples.

math.NA↗

arXiv2023

Structured interpolation for multivariate transfer functions of quadratic-bilinear systems

High-dimensional/high-fidelity nonlinear dynamical systems appear naturally when the goal is to accurately model real-world phenomena. Many physical properties are thereby encoded in the internal differential structure of these resulting large-scale nonlinear systems. The high-dimensionality of the dynamics causes computational bottlenecks, especially when these large-scale systems need to be simulated for a variety of situations such as different forcing terms. This motivates model reduction where the goal is to replace the full-order dynamics with accurate reduced-order surrogates. Interpolation-based model reduction has been proven to be an effective tool for the construction of cheap-to-evaluate surrogate models that preserve the internal structure in the case of weak nonlinearities. In this paper, we consider the construction of multivariate interpolants in frequency domain for structured quadratic-bilinear systems. We propose definitions for structured variants of the symmetric subsystem and generalized transfer functions of quadratic-bilinear systems and provide conditions for structure-preserving interpolation by projection. The theoretical results are illustrated using two numerical examples including the simulation of molecular dynamics in crystal structures.

math.NA↗

arXiv2023

Structured barycentric forms for interpolation-based data-driven reduced modeling of second-order systems

An essential tool in data-driven modeling of dynamical systems from frequency response measurements is the barycentric form of the underlying rational transfer function. In this work, we propose structured barycentric forms for modeling dynamical systems with second-order time derivatives using their frequency domain input-output data. By imposing a set of interpolation conditions, the systems' transfer functions are rewritten in different barycentric forms using different parametrizations. Loewner-like algorithms are developed for the explicit computation of second-order systems from data based on the developed barycentric forms. Numerical experiments show the performance of these new structured data driven modeling methods compared to other interpolation-based data-driven modeling techniques from the literature.

math.NA↗

arXiv2023

Nonlinear Balanced Truncation: Part 2 -- Model Reduction on Manifolds

Nonlinear balanced truncation is a model order reduction technique that reduces the dimension of nonlinear systems in a manner that accounts for either open- or closed-loop observability and controllability aspects of the system. Two computational challenges have so far prevented its deployment on large-scale systems: (a) the energy functions required for characterization of controllability and observability are solutions of high-dimensional Hamilton-Jacobi-(Bellman) equations, which have been computationally intractable and (b) the transformations to construct the reduced-order models (ROMs) are potentially ill-conditioned and the resulting ROMs are difficult to simulate on the nonlinear balanced manifolds. Part~1 of this two-part article addressed challenge (a) via a scalable tensor-based method to solve for polynomial approximations of the open- and closed-loop energy functions. This article, (Part~2), addresses challenge (b) by presenting a novel and scalable method to reduce the dimensionality of the full-order model via model reduction on polynomially-nonlinear balanced manifolds. The associated nonlinear state transformation simultaneously 'diagonalizes' relevant energy functions in the new coordinates. Since this nonlinear balancing transformation can be ill-conditioned and expensive to evaluate, inspired by the linear case we develop a computationally efficient balance-and-reduce strategy, resulting in a scalable and better conditioned truncated transformation to produce balanced nonlinear ROMs. The algorithm is demonstrated on a semi-discretized partial differential equation, namely Burgers equation, which illustrates that higher-degree transformations can improve the accuracy of ROM outputs.

math.OC↗

arXiv2022

$\mathcal{L}_2$-optimal Reduced-order Modeling Using Parameter-separable Forms

We provide a unifying framework for $\mathcal{L}_2$-optimal reduced-order modeling for linear time-invariant dynamical systems and stationary parametric problems. Using parameter-separable forms of the reduced-model quantities, we derive the gradients of the $\mathcal{L}_2$ cost function with respect to the reduced matrices, which then allows a non-intrusive, data-driven, gradient-based descent algorithm to construct the optimal approximant using only output samples. By choosing an appropriate measure, the framework covers both continuous (Lebesgue) and discrete cost functions. We show the efficacy of the proposed algorithm via various numerical examples. Furthermore, we analyze under what conditions the data-driven approximant can be obtained via projection.

math.NA↗

arXiv2022

The p-AAA algorithm for data driven modeling of parametric dynamical systems

The AAA algorithm has become a popular tool for data-driven rational approximation of single variable functions, such as transfer functions of a linear dynamical system. In the setting of parametric dynamical systems appearing in many prominent applications, the underlying (transfer) function to be modeled is a multivariate function. With this in mind, we develop the AAA framework for approximating multivariate functions where the approximant is constructed in the multivariate barycentric form. The method is data-driven, in the sense that it does not require access to full state-space model and requires only function evaluations. We discuss an extension to the case of matrix-valued functions, i.e., multi-input/multi-output dynamical systems, and provide a connection to the tangential interpolation theory. Several numerical examples illustrate the effectiveness of the proposed approach.

math.NA↗