SearcharxivSearch

arXiv subjects

Philip Hannebohm

Publications and source records attributed to Philip Hannebohm.

3 recordsLinked to original sources

Residual-Informed Learning of Solutions to Algebraic Loops

This paper presents a residual-informed machine learning approach for replacing algebraic loops in equation-based Modelica models with neural network surrogates. A feedforward neural network is trained using the residual (error) of the algebraic loop directly in its loss function, eliminating the need for a supervised dataset. This training strategy also resolves the issue of ambiguous solutions, allowing the surrogate to converge to a consistent solution rather than averaging multiple valid ones. Applied to the large-scale IEEE 14-Bus system, our method achieves a 60% reduction in simulation time compared to conventional simulations, while maintaining the same level of accuracy through error control mechanisms.

cs.LG

Efficient Training of Physics-enhanced Neural ODEs via Direct Collocation and Nonlinear Programming

We propose a novel approach for training Physics-enhanced Neural ODEs (PeN-ODEs) by expressing the training process as a dynamic optimization problem. The full model, including neural components, is discretized using a high-order implicit Runge-Kutta method with flipped Legendre-Gauss-Radau points, resulting in a large-scale nonlinear program (NLP) efficiently solved by state-of-the-art NLP solvers such as Ipopt. This formulation enables simultaneous optimization of network parameters and state trajectories, addressing key limitations of ODE solver-based training in terms of stability, runtime, and accuracy. Extending on a recent direct collocation-based method for Neural ODEs, we generalize to PeN-ODEs, incorporate physical constraints, and present a custom, parallelized, open-source implementation. Benchmarks on a Quarter Vehicle Model and a Van-der-Pol oscillator demonstrate superior accuracy, speed, generalization with smaller networks compared to other training techniques. We also outline a planned integration into OpenModelica to enable accessible training of Neural DAEs.

cs.LG

Multi-rate Runge-Kutta methods: stability analysis and applications

We present an approach for the efficient implementation of self-adjusting multi-rate Runge-Kutta methods and we introduce a novel stability analysis, that covers the multi-rate extensions of all standard Runge-Kutta methods and allows to assess the impact of different interpolation methods for the latent variables and of the use of an arbitrary number of sub-steps for the active variables. The stability analysis applies successfully to the model problem typically used in the literature for multi-rate methods. Furthermore,} we also propose a physically motivated model problem that can be used to assess stability to problems with purely imaginary eigenvalues and in situations closer to those arising in applications. Finally, we present an efficient implementation of multi-rate Runge-Kutta methods in the framework of the OpenModelica open-source modelling and simulation software. Results of several numerical experiments, performed with this implementation of the proposed methods, demonstrate the efficiency gains deriving from the use of the proposed multi-rate approach for physical modelling problems with multiple time scales.

math.NA