Searcharxiv⌕ Search

arXiv subjects

Peter Benner

Publications and source records attributed to Peter Benner.

At least 37 records · Page 2Linked to original sources

Fast tensor-based electrostatic energy calculations in the perspective of protein-ligand docking problem

We propose and justify a new approach for fast calculation of the electrostatic interaction energy of clusters of charged particles in constrained energy minimization in the framework of rigid protein-ligand docking. Our ``blind search'' docking technique is based on the low-rank range-separated (RS) tensor-based representation of the free-space electrostatic potential of the biomolecule represented on large $n\times n\times n$ 3D grid. We show that both the collective electrostatic potential of a complex protein-ligand system and the respective electrostatic interaction energy can be calculated by tensor techniques in $O(n)$-complexity, such that the numerical cost for energy calculation only mildly (logarithmically) depends on the number of particles in the system. Moreover, tensor representation of the electrostatic potential enables usage of large 3D Cartesian grids (of the order of $n^3 \sim 10^{12}$), which could allow the accurate modeling of complexes with several large proteins. In our approach selection of the correct geometric pose predictions in the localized posing process is based on the control of van der Waals distance between the target molecular clusters. Here, we confine ourselves by constrained minimization of the energy functional by using only fast tensor-based free-space electrostatic energy recalculation for various rotations and translations of both clusters. Numerical tests of the electrostatic energy-based ``protein-ligand docking'' algorithm applied to synthetic and realistic input data present a proof of concept for rather complex particle configurations. The method may be used in the framework of the traditional stochastic or deterministic posing/docking techniques.

math.NA↗

Time-adaptive HénonNets for separable Hamiltonian systems

Measurement data is often sampled irregularly, i.e., not on equidistant time grids. This is also true for Hamiltonian systems. However, existing machine learning methods, which learn symplectic integrators, such as SympNets [1] and HénonNets [2] still require training data generated by fixed step sizes. To learn time-adaptive symplectic integrators, an extension to SympNets called TSympNets is introduced in [3]. The aim of this work is to do a similar extension for HénonNets. We propose a novel neural network architecture called T-HénonNets, which is symplectic by design and can handle adaptive time steps. We also extend the T-HénonNet architecture to non-autonomous Hamiltonian systems. Additionally, we provide universal approximation theorems for both new architectures for separable Hamiltonian systems and discuss why it is difficult to handle non-separable Hamiltonian systems with the proposed methods. To investigate these theoretical approximation capabilities, we perform different numerical experiments.

cs.LG↗

GN-SINDy: Greedy Sampling Neural Network in Sparse Identification of Nonlinear Partial Differential Equations

The sparse identification of nonlinear dynamical systems (SINDy) is a data-driven technique employed for uncovering and representing the fundamental dynamics of intricate systems based on observational data. However, a primary obstacle in the discovery of models for nonlinear partial differential equations (PDEs) lies in addressing the challenges posed by the curse of dimensionality and large datasets. Consequently, the strategic selection of the most informative samples within a given dataset plays a crucial role in reducing computational costs and enhancing the effectiveness of SINDy-based algorithms. To this aim, we employ a greedy sampling approach to the snapshot matrix of a PDE to obtain its valuable samples, which are suitable to train a deep neural network (DNN) in a SINDy framework. SINDy based algorithms often consist of a data collection unit, constructing a dictionary of basis functions, computing the time derivative, and solving a sparse identification problem which ends to regularised least squares minimization. In this paper, we extend the results of a SINDy based deep learning model discovery (DeePyMoD) approach by integrating greedy sampling technique in its data collection unit and new sparsity promoting algorithms in the least squares minimization unit. In this regard we introduce the greedy sampling neural network in sparse identification of nonlinear partial differential equations (GN-SINDy) which blends a greedy sampling method, the DNN, and the SINDy algorithm. In the implementation phase, to show the effectiveness of GN-SINDy, we compare its results with DeePyMoD by using a Python package that is prepared for this purpose on numerous PDE discovery

math.DS↗

Time-adaptive SympNets for separable Hamiltonian systems

Measurement data is often sampled irregularly i.e. not on equidistant time grids. This is also true for Hamiltonian systems. However, existing machine learning methods, which learn symplectic integrators, such as SympNets [20] and HénonNets [4] still require training data generated by fixed step sizes. To learn time-adaptive symplectic integrators, an extension to SympNets, which we call TSympNets, was introduced in [20]. We adapt the architecture of TSympNets and extend them to non-autonomous Hamiltonian systems. So far the approximation qualities of TSympNets were unknown. We close this gap by providing a universal approximation theorem for separable Hamiltonian systems and show that it is not possible to extend it to non-separable Hamiltonian systems. To investigate these theoretical approximation capabilities, we perform different numerical experiments. Furthermore we fix a mistake in a proof of a substantial theorem [25, Theorem 2] for the approximation of symplectic maps in general, but specifically for symplectic machine learning methods.

cs.LG↗

Extension of generalized KYP lemma: from LTI systems to LPV systems

The generalized Kalman-Yakubovich-Popov (gKYP) lemma, established by Iwasaki and Hara (2005 IEEE TAC), has served as a fundamental tool for finite-frequency analysis and synthesis of linear time-invariant (LTI) systems. Over the past two decades, efforts to extend the gKYP lemma from LTI systems to linear parameter varying (LPV) systems have been hindered by the intricate time-frequency inter-modulation effect between the input signal and the time-varying scheduling parameter. A key element in this framework is the frequency-dependent Integral Quadratic Constraint (IQC) function, which enables time-domain interpretation of the gKYP lemma, as demonstrated by Iwasaki et al in their companion 2005 System and Control Letter paper. The non-negativity property of this IQC function plays a crucial role in characterizing system behavior under frequency-limited inputs. In this paper, we first demonstrate through a counterexample that the IQC non-negativity property may fail for LPV systems, thereby invalidating existing results that rely on this assumption. To address this issue, we propose a reformulation strategy that replaces the original frequency range with an enlarged one, thereby restoring the non-negativity property for LPV systems. Moreover, we establish that the minimal required expansion depends on the interaction(or gap) between the system poles and the original frequency range, as well as a set of controllability Gramians. Building upon this results, an extension of gKYP lemma is presented, which allows us to conduct finite-frequency analysis of LPV systems in a direct and reliable manner. The potential and efficiency compared to existing results are demonstrated through numerical examples.

math.DS↗

Application of operator inference to reduced-order modeling of constrained mechanical systems

Constrained mechanical systems occur in many applications, such as modeling of robots and other multibody systems. In this case, the motion is governed by a system of differential-algebraic equations (DAE), often with large and sparse system matrices. The problem dimension strongly influences the effectiveness of simulations for system analysis, optimization, and control, given limited computational resources. Therefore, we aim to obtain a simplified surrogate model with a few degrees of freedom that is able to accurately represent the motion and other important properties of the original high-dimensional DAE model. Classical model reduction methods intrusively exploit the system matrices to construct the projection of the high-fidelity model onto a low-dimensional subspace. In practice, the dynamical equations are frequently an inaccessible part of proprietary software products. In this work, we show an application of the non-intrusive operator inference (OpInf) method to DAE systems of index 2 and 3. Considering the fact that for proper DAEs there exists an ODE realization on the so-called hidden manifold, the OpInf optimization problem directly provides the underlying ODE representation of the given DAE system in the reduced subspace. A significant advantage is that only the DAE solution snapshots in a compressed form are required for identification of the reduced system matrices. Stability and interpretability of the reduced-order model is guaranteed by enforcing the symmetric positive definite structure of the system operators using semidefinite programming. The numerical results demonstrate the implementation of the proposed methodology for different examples of constrained mechanical systems, tested for various loading conditions.

math.DS↗

Subspace-Distance-Enabled Active Learning for Efficient Data-Driven Model Reduction of Parametric Dynamical Systems

In situations where the solution of a high-fidelity dynamical system needs to be evaluated repeatedly, over a vast pool of parametric configurations and in absence of access to the underlying governing equations, data-driven model reduction techniques are preferable. We propose a novel active learning approach to build a parametric data-driven reduced-order model (ROM) by greedily picking the most important parameter samples from the parameter domain. As a result, during the ROM construction phase, the number of high-fidelity solutions dynamically grow in a principled fashion. The high-fidelity solution snapshots are expressed in several parameter-specific linear subspaces, with the help of proper orthogonal decomposition (POD), and the relative distance between these subspaces is used as a guiding mechanism to perform active learning. For successfully achieving this, we provide a distance measure to evaluate the similarity between pairs of linear subspaces with different dimensions, and also show that this distance measure is a metric. The usability of the proposed subspace-distance-enabled active learning (SDE-AL) framework is demonstrated by augmenting two existing non-intrusive reduced-order modeling approaches, and providing their active-learning-driven (ActLearn) extensions, namely, SDE-ActLearn-POD-KSNN, and SDE-ActLearn-POD-NN. Furthermore, we report positive results for two parametric physical models, highlighting the efficiency of the proposed SDE-AL approach.

math.NA↗

An adaptive scheme for the optimization of damping positions by decoupling controllability spaces in vibrational systems

In this work, the problem of optimizing damper positions in vibrational systems is investigated. The objective is to determine the positions of external dampers in such a way that the influence of the input on the output is minimized. The energy response serves as an optimization criterion, whose computation involves solving Lyapunov equations. Hence, in order to find the best positions, many of these equations need to be solved, and so the minimization process can have a high computational cost. To accelerate the process of finding the optimal positions, we propose a new reduction method. Our algorithm generates a basis spanning an approximation to the solution space of the Lyapunov equations for all possible positions of the dampers. We derive an adaptive scheme that generates the reduced solution space by adding the subspaces of interest, and then we define the corresponding reduced optimization problem that is solvable in a reasonable amount of time. We decouple the solution spaces of the problem to obtain a space that corresponds to the system without external dampers and serves as a starting point for the reduction of the optimization problem. In addition, we derive spaces corresponding to the different damper positions that are used to expand the reduced basis if needed. To evaluate the quality of the basis, we introduce an error indicator based on the space decomposition. Our new technique produces a reduced optimization problem of significantly smaller dimension that is faster to solve than the original problem, which we illustrate with some numerical examples.

math.NA↗

Iterative approximations of periodic trajectories for nonlinear systems with discontinuous inputs

Nonlinear control-affine systems described by ordinary differential equations with bounded measurable input functions are considered. The solvability of general boundary value problems for these systems is formulated in the sense of Carathéodory solutions. It is shown that, under the dominant linearization assumption, the considered class of boundary value problems admits a unique solution for any admissible control. These solutions can be obtained as the limit of the proposed simple iterative scheme and, in the case of periodic boundary conditions, via the developed Newton-type schemes. Under additional technical assumptions, sufficient contraction conditions of the corresponding generating operators are derived analytically. The proposed iterative approach is applied to compute periodic solutions of a realistic chemical reaction model with discontinuous control inputs.

math.OC↗

Inference of Substructured Reduced-Order Models for Dynamic Contact from Contact-free Simulations

In this paper, we propose an operator-inference-based reduction approach for contact problems, leveraging snapshots from simulations without active contact. Contact problems are solved using adjoint methods, by switching to the dual system, where the corresponding Lagrange multipliers represent the contact pressure. The Craig-Bampton-like substructuring method is incorporated into the inference process to provide the reduced system matrices and the coupling of the contact and interior nodes. The maximum possible set of contact nodes must be known a priori. Characteristic properties of the inferred matrices, such as symmetry and positive definiteness, are enforced by appending additional constraints to the underlying least-squares problem. The resulting dual system, which forms a linear complementarity problem, is well-defined and can be effectively solved using methods such as Lemke's algorithm. The performance of the proposed method is validated on three-dimensional finite element models.

math.NA↗

Non-intrusive reduced-order modeling for dynamical systems with spatially localized features

This work presents a non-intrusive reduced-order modeling framework for dynamical systems with spatially localized features characterized by slow singular value decay. The proposed approach builds upon two existing methodologies for reduced and full-order non-intrusive modeling, namely Operator Inference (OpInf) and sparse Full-Order Model (sFOM) inference. We decompose the domain into two complementary subdomains that exhibit fast and slow singular value decay. The dynamics of the subdomain exhibiting slow singular value decay are learned with sFOM while the dynamics with intrinsically low dimensionality on the complementary subdomain are learned with OpInf. The resulting, coupled OpInf-sFOM formulation leverages the computational efficiency of OpInf and the high resolution of sFOM, and thus enables fast non-intrusive predictions for conditions beyond those sampled in the training data set. A novel regularization technique with a closed-form solution based on the Gershgorin disk theorem is introduced to promote stable sFOM and OpInf models. We also provide a data-driven indicator for subdomain selection and ensure solution smoothness over the interface via a post-processing interpolation step. We evaluate the efficiency of the approach in terms of offline and online speedup through a quantitative, parametric computational cost analysis. We demonstrate the coupled OpInf-sFOM formulation for two test cases: a one-dimensional Burgers' model for which accurate predictions beyond the span of the training snapshots are presented, and a two-dimensional parametric model for the Pine Island Glacier ice thickness dynamics, for which the OpInf-sFOM model achieves an average prediction error on the order of $1 \%$ with an online speedup factor of approximately $8\times$ compared to the numerical simulation.

math.DS↗

A CFL-type Condition and Theoretical Insights for Discrete-Time Sparse Full-Order Model Inference

In this work, we investigate the data-driven inference of a discrete-time dynamical system via a sparse Full-Order Model (sFOM). We first formulate the involved Least Squares (LS) problem and discuss the need for regularization, indicating a connection between the typically employed $l_2$ regularization and the stability of the inferred discrete-time sFOM. We then provide theoretical insights considering the consistency and stability properties of the inferred numerical schemes that form the sFOM and exemplify them via illustrative, 1D test cases of linear diffusion and linear advection. For linear advection, we analytically derive a "sampling CFL" condition, which dictates a bound for the ratio of spatial and temporal discretization steps in the training data that ensures stability of the inferred sFOM. Finally, we investigate the sFOM inference for two nonlinear problems, namely a 2D Burgers' test case and the incompressible flow in an oscillating lid driven cavity, and draw connections between the theoretical findings and the properties of the inferred, nonlinear sFOMs.

math.DS↗

Stability and decay rate estimates for a nonlinear dispersed flow reactor model with boundary control

We investigate a nonlinear parabolic partial differential equation whose boundary conditions contain a single control input. This model describes a chemical reaction of the type ``$A \to $ product'', occurring in a dispersed flow tubular reactor. The existence and uniqueness of solutions to the nonlinear Cauchy problem under consideration are established by applying the theory of strongly continuous semigroups of operators. We also prove the stability of the equilibrium of the closed-loop system with a proposed feedback law. Additionally, using Lyapunov's direct method, we evaluate the exponential decay rate of the solutions.

math.AP↗

On the representation of energy-preserving quadratic operators with application to Operator Inference

In this work, we investigate a skew-symmetric parameterization for energy-preserving quadratic operators. Earlier, [Goyal et al., 2023] proposed this parameterization to enforce energy-preservation for quadratic terms in the context of dynamical system data-driven inference. We here prove that every energy-preserving quadratic term can be equivalently formulated using a parameterization of the corresponding operator via skew-symmetric matrix blocks. Based on this main finding, we develop an algorithm to compute an equivalent quadratic operator with skew-symmetric sub-matrices, given an arbitrary energy-preserving operator. Consequently, we employ the skew-symmetric sub-matrix representation in the framework of non-intrusive reduced-order modeling (ROM) via Operator Inference (OpInf) for systems with an energy-preserving nonlinearity. To this end, we propose a sequential, linear least-squares (LS) problems formulation for the inference task, to ensure energy-preservation of the data-driven quadratic operator. The potential of this approach is indicated by the numerical results for a 2D Burgers' equation benchmark, compared to classical OpInf. The inferred system dynamics are accurate, while the corresponding operators are faithful to the underlying physical properties of the system.

math.NA↗

SIGGRAPH: G: Improved Projective Dynamics Global Using Snapshots-based Reduced Bases

We propose a snapshots-based method to compute reduction subspaces for physics-based simulations. Our method is applicable to any mesh with some artistic prior knowledge of the solution and only requires a record of existing solutions during, for instance, the range-of-motion test that is required before approving a mesh character for an application. Our subspaces span a wider range of motion, especially large deformations, and rotations by default. Compared to the state-of-the-art, we achieve improved numerical stability, computational efficiency, and more realistic simulations with a smaller sub-space.

math.DS↗

A physics-encoded Fourier neural operator approach for surrogate modeling of divergence-free stress fields in solids

The purpose of the current work is the development of a so-called physics-encoded Fourier neural operator (PeFNO) for surrogate modeling of the quasi-static equilibrium stress field in solids. Rather than accounting for constraints from physics in the loss function as done in the (now standard) physics-informed approach, the physics-encoded approach incorporates or "encodes" such constraints directly into the network or operator architecture. As a result, in contrast to the physics-informed approach in which only training is physically constrained, both training and output are physically constrained in the physics-encoded approach. For the current constraint of divergence-free stress, a novel encoding approach based on a stress potential is proposed. As a "proof-of-concept" example application of the proposed PeFNO, a heterogeneous polycrystalline material consisting of isotropic elastic grains subject to uniaxial extension is considered. Stress field data for training are obtained from the numerical solution of a corresponding boundary-value problem for quasi-static mechanical equilibrium. This data is also employed to train an analogous physics-guided FNO (PgFNO) and physics-informed FNO (PiFNO) for comparison. As confirmed by this comparison and as expected on the basis of their differences, the output of the trained PeFNO is significantly more accurate in satisfying mechanical equilibrium than the output of either the trained PgFNO or the trained PiFNO.

cs.CE↗

Interpolatory Necessary Optimality Conditions for Reduced-order Modeling of Parametric Linear Time-invariant Systems

Interpolatory necessary optimality conditions for $\mathcal{H}_2$-optimal reduced-order modeling of non-parametric linear time-invariant (LTI) systems are known and well-investigated. In this work, using the general framework of $\mathcal{L}_2$-optimal reduced-order modeling of parametric stationary problems, we derive interpolatory $\mathcal{H}_2 \otimes \mathcal{L}_2$-optimality conditions for parametric LTI systems with a general pole-residue form. We then specialize this result to recover known conditions for systems with parameter-independent poles and develop new conditions for a certain class of systems with parameter-dependent poles.

math.OC↗

Discrete empirical interpolation in the tensor t-product framework

The discrete empirical interpolation method (DEIM) is a well-established approach, widely used for state reconstruction using sparse sensor/measurement data, nonlinear model reduction, and interpretable feature selection. We introduce the tensor t-product Q-DEIM (t-Q-DEIM), an extension of the DEIM framework for dealing with tensor-valued data. The proposed approach seeks to overcome one of the key drawbacks of DEIM, viz., the need for matricizing the data, which can distort any structural and/or geometric information. Our method leverages the recently developed tensor t-product algebra to avoid reshaping the data. In analogy with the standard DEIM, we formulate and solve a tensor-valued least-squares problem, whose solution is achieved through an interpolatory projection. We develop a rigorous, computable upper bound for the error resulting from the t-Q-DEIM approximation. Using five different tensor-valued datasets, we numerically illustrate the better approximation properties of t-Q-DEIM and the significant computational cost reduction it offers.

math.NA↗