SearcharxivSearch

arXiv subjects

Wil Schilders

Publications and source records attributed to Wil Schilders.

9 recordsLinked to original sources

A non-intrusive approach to index-aware learning

We present a non-intrusive version of the index-aware learning framework introduced in arXiv:2309.00958. Index-aware learning itself is an approach for learning the time and parameter dependent solutions of differential-algebraic equations (DAEs), in particular those describing electric circuits. A central feature of the approach is that it ensures the learned solutions to fulfill the inherent constraints of the DAE, such as e.g. Kirchhoff's laws in the case of electric circuits. This is achieved by leveraging a decoupling of the DAE into its differential and algebraic parts, with the non-intrusive version of the approach additionally relying on results from arXiv:2604.20475 and arXiv:2107.07755. We illustrate the approach using a filtered buck converter as an example and compare both the intrusive and non-intrusive versions. The code for the example is openly available.

cs.CE

Generalizing Reduced Rank Extrapolation to Low-Rank Matrix Sequences

Reduced rank extrapolation (RRE) is an acceleration method typically used to accelerate the iterative solution of nonlinear systems of equations using a fixed-point process. In this context, the iterates are vectors generated from a fixed-point mapping function. However, when considering the iterative solution of large-scale matrix equations, the iterates are low-rank matrices generated from a fixed-point process for which, generally, the mapping function changes in each iteration. To enable acceleration of the iterative solution for these problems, we propose two novel generalizations of RRE. First, we show how to effectively compute RRE for sequences of low-rank matrices. Second, we derive a formulation of RRE that is suitable for fixed-point processes for which the mapping function changes each iteration. We demonstrate the potential of the methods on several numerical examples involving the iterative solution of large-scale Lyapunov and Riccati matrix equations.

math.NA

A topological decoupling of modified nodal analysis including controlled sources

We derive a topological decoupling of the equations of modified nodal analysis (MNA) to a semi-explicit index one differential-algebraic equation. The decoupling explicitly allows for controlled sources, which play a crucial role in engineering design workflows. Furthermore, the proof is constructive and provides a graph-based algorithmic framework for the computation of the decoupling, enabling its application to a variety of industry problems. These include the generation of consistent initial conditions, model order reduction, (scientific) machine learning, as well as speeding up conventional circuit simulation. In addition, the decoupling preserves the structure of MNA, i.e. the resulting systems remain sparse and key parts remain positive definite. We illustrate the decoupling using multiple examples, including some of the most common subcircuits containing controlled sources. Lastly, we also provide a first software implementation of the decoupling.

math.NA

Fraudulent Publishing in the Mathematical Sciences

This report is the first of two publications of a joint Working Group of the International Mathematical Union (IMU) and the International Council of Industrial and Applied Mathematics (ICIAM). In it, we shall analyze the current state of publishing in the mathematical sciences and explain the resulting problems. Our second publication will offer concrete recommendations, guidelines, and best practices for researchers, policymakers, and evaluators of mathematical research. It will explain how to detect and counteract attempts to game bibliometric measures, empowering the community to reclaim control over research evaluation and drive necessary change.

math.HO

Stable Sparse Operator Inference for Nonlinear Structural Dynamics

Structural dynamics models with nonlinear stiffness appear, for example, when analyzing systems with nonlinear material behavior or undergoing large deformations. For complex systems, these models become too large for real-time applications or multi-query workflows. Hence, model reduction is needed. However, the mathematical operators of these models are often not available since, as is common in industry practice, the models are constructed using commercial simulation software. In this work, we propose an operator inference-based approach aimed at inferring, from data generated by the simulation model, reduced-order models (ROMs) of structural dynamics systems with stiffness terms represented by polynomials of arbitrary degree. To ensure physically meaningful models, we impose constraints on the inference such that the model is guaranteed to exhibit stability properties. Convexity of the optimization problem associated with the inference is maintained by applying a sum-of-squares relaxation to the polynomial term. To further reduce the size of the ROM and improve numerical conditioning of the inference, we also propose a novel clustering-based sparsification of the polynomial term. We validate the proposed method on several numerical examples, including a representative 3D Finite Element Model (FEM) of a steel piston rod.

math.NA

Systematic construction of continuous-time neural networks for linear dynamical systems

Discovering a suitable neural network architecture for modeling complex dynamical systems poses a formidable challenge, often involving extensive trial and error and navigation through a high-dimensional hyper-parameter space. In this paper, we discuss a systematic approach to constructing neural architectures for modeling a subclass of dynamical systems, namely, Linear Time-Invariant (LTI) systems. We use a variant of continuous-time neural networks in which the output of each neuron evolves continuously as a solution of a first-order or second-order Ordinary Differential Equation (ODE). Instead of deriving the network architecture and parameters from data, we propose a gradient-free algorithm to compute sparse architecture and network parameters directly from the given LTI system, leveraging its properties. We bring forth a novel neural architecture paradigm featuring horizontal hidden layers and provide insights into why employing conventional neural architectures with vertical hidden layers may not be favorable. We also provide an upper bound on the numerical errors of our neural networks. Finally, we demonstrate the high accuracy of our constructed networks on three numerical examples.

cs.LG

Index-aware learning of circuits

Electrical circuits are present in a variety of technologies, making their design an important part of computer aided engineering. The growing number of parameters that affect the final design leads to a need for new approaches to quantify their impact. Machine learning may play a key role in this regard, however current approaches often make suboptimal use of existing knowledge about the system at hand. In terms of circuits, their description via modified nodal analysis is well-understood. This particular formulation leads to systems of differential-algebraic equations (DAEs) which bring with them a number of peculiarities, e.g. hidden constraints that the solution needs to fulfill. We use the recently introduced dissection index that can decouple a given system of DAEs into ordinary differential equations, only depending on differential variables, and purely algebraic equations, that describe the relations between differential and algebraic variables. The idea is to then only learn the differential variables and reconstruct the algebraic ones using the relations from the decoupling. This approach guarantees that the algebraic constraints are fulfilled up to the accuracy of the nonlinear system solver, and it may also reduce the learning effort as only the differential variables need to be learned.

cs.CE

Stochastic Optimization of Large-Scale Parametrized Dynamical Systems

Many relevant problems in the area of systems and control, such as controller synthesis, observer design and model reduction, can be viewed as optimization problems involving dynamical systems: for instance, maximizing performance in the synthesis setting or minimizing error in the reduction setting. When the involved dynamics are large-scale (e.g., high-dimensional semi-discretizations of partial differential equations), the optimization becomes computationally infeasible. Existing methods in literature lack computational scalability or solve an approximation of the problem (thereby losing guarantees with respect to the original problem). In this paper, we propose a novel method that circumvents these issues. The method is an extension of Stochastic Gradient Descent (SGD) which is widely used in the context of large-scale machine learning problems. The proposed SGD scheme minimizes the $\mathcal{H}_2$ norm of a (differentiable) parametrized dynamical system, and we prove that the scheme is guaranteed to preserve stability with high probability under boundedness conditions on the step size. Conditioned on the stability preservation, we also obtain probabilistic convergence guarantees to local minimizers. The method is also applicable to problems involving non-realizable dynamics as it only requires frequency-domain input-output samples. We demonstrate the potential of the approach on two numerical examples: fixed-order observer design for a large-scale thermal model and controller tuning for an infinite-dimensional system.

math.OC