SearcharxivSearch

arXiv subjects

Martin Lanser

Publications and source records attributed to Martin Lanser.

At least 19 recordsLinked to original sources

Mixture of experts surrogate model for the homogenization of open-porous materials

For open-porous materials, incorporating their microstructural properties into mechanical simulations poses a significant challenge for accurately capturing elastic deformation. To deal with this difficulty, multiscale methods are a common tool to couple characteristics of the microstructure of the considered material with the macroscopic material behavior. However, when desiring a high accuracy, these multiscale computations can be computationally very expensive due to the large number of microscopic problems which need to be solved in each compute step. Here, surrogate models that learn the mechanical response of the underlying constitutive model can significantly reduce the computational cost of multiscale approaches. In previous work by some of the authors, beam frame models have been used to model the microstructure of open-porous materials which have been combined with neural network-based surrogate models to approximate the material behavior of a given RVE (repesentative volume element). In this work, we extend our previous study by training a more complex neural network model to predict the mechanical behavior of several RVEs, differing in their maximum pore size and pore-size distribution. Concretely, we focus on mixture of expert (MoE) models and compare different MoE architectures as well as their performance across different RVEs. This novel approach reduces the computational cost of simulating multiple RVEs as the MoE model does not require additional training when new RVEs are considered.

math.NA

Learning Adaptive Coarse Spaces Using Transferable Neural Network Models for Linear and Nonlinear Overlapping Domain Decomposition Methods

Domain decomposition methods have been established as efficient and parallel scalable iterative solvers and preconditioners for the solution of large-scale systems arising from the discretization of partial differential equations. In particular, overlapping Schwarz methods have been successfully applied to a wide range of linear and nonlinear problems. However, for problems with highly heterogeneous coefficients, standard domain decomposition methods typically suffer from deteriorating convergence rates. Robustness with respect to the coefficient contrast can be achieved by enriching the coarse space with adaptively selected constraints obtained from local generalized eigenvalue problems. The construction of these adaptive coarse spaces, however, can account for a significant part of the overall computing time. In the present work, machine learning techniques are employed to reduce this part of the computing time in the context of the adaptive Generalized Dryja-Smith-Widlund (AGDSW) coarse space. A two-stage approach is proposed in which regression neural networks are used to predict the adaptive coarse basis functions, while a classification neural network is employed to predict the number of basis functions required to ensure robustness. As a consequence, adaptive coarse spaces can be set up in the online phase without solving any eigenvalue problem. Particular attention is paid to problem-specific aspects, including sign-invariant loss functions and post-processing strategies to significantly improve the predicted constraints. The proposed approach is first investigated for scalar diffusion problems with high coefficient contrasts and is subsequently transferred, without retraining, to problems of linear elasticity and to nonlinear $p$-Laplace problems, also within a nonlinear Schwarz framework.

math.NA

Two-level nonlinear Schwarz methods - a parallel implementation with application to nonlinear elasticity and incompressible flow problems

Nonlinear Schwarz methods are a type of nonlinear domain decomposition method used as an alternative to Newton's method for solving discretized nonlinear partial differential equations. In this article, the first parallel implementation of a two-level nonlinear Schwarz method leveraging the GDSW-type coarse spaces from the Fast and Robust Overlapping Schwarz (FROSch) framework in Trilinos is presented. This framework supports both additive and hybrid two-level nonlinear Schwarz methods and makes use of modifications to the coarse spaces constructed by FROSch to further enhance the robustness and convergence speed of the methods. Efficiency and excellent parallel performance of the software framework are demonstrated by applying it to two challenging nonlinear problems: the two-dimensional lid-driven cavity problem at high Reynolds numbers, and a Neo-Hookean beam deformation problem. The results show that two-level nonlinear Schwarz methods scale exceptionally well up to 9\,000 subdomains and are more robust than standard Newton-Krylov-Schwarz solvers for the considered Navier-Stokes problems with high Reynolds numbers or, respectively, for the nonlinear elasticity problems and large deformations. The new parallel implementation provides a foundation for future research in scalable nonlinear domain decomposition methods and demonstrates the practical viability of nonlinear Schwarz techniques for large-scale simulations.

math.NA

Towards a parallel Schwarz solver framework for virtual elements using GDSW coarse spaces

The Virtual Element Method (VEM) is used to perform the discretization of the Poisson problem on polygonal and polyhedral meshes. This results in a symmetric positive definite linear system, which is solved iteratively using overlapping Schwarz domain decomposition preconditioners, where to ensure robustness and parallel scalability a second level has to be employed. The construction and numerical study of two-level overlapping Schwarz preconditioners with variants of the GDSW (Generalized Dryja-Smith-Widlund) coarse space are presented here. Our PETSc-based parallel implementation of GDSW and variants, combined with the Vem++ library, represent the first parallel application of these GDSW preconditioners to VEM. Numerical experiments in 2D and 3D demonstrate scalability of our preconditioners up to 1 000 parallel cores for VEM discretizations of degrees k=1,2.

math.NA

A Flow-rate-conserving CNN-based Domain Decomposition Method for Blood Flow Simulations

This work aims to predict blood flow with non-Newtonian viscosity in stenosed arteries using convolutional neural network (CNN) surrogate models. An alternating Schwarz domain decomposition method is proposed which uses CNN-based subdomain solvers. A universal subdomain solver (USDS) is trained on a single, fixed geometry and then applied for each subdomain solve in the Schwarz method. Results for two-dimensional stenotic arteries of varying shape and length for different inflow conditions are presented and statistically evaluated. One key finding, when using a limited amount of training data, is that incorporating a physics-aware constraint, as, in our case, flow rate conservation, into the USDS improves the prediction accuracy and convergence behavior of the Schwarz method compared to a purely data-driven USDS. As the USDS is a data-driven, inexact subdomain solver, admissible parameter ranges for the geometry and inflow configurations must be defined and tested.

math.NA

Large-scale Thermo-Mechanical Simulation of Laser Beam Welding Using High-Performance Computing: A Qualitative Reproduction of Experimental Results

Laser beam welding is a non-contact joining technique that has gained significant importance in the course of the increasing degree of automation in industrial manufacturing. This process has established itself as a suitable joining tool for metallic materials due to its non-contact processing, short cycle times, and small heat-affected zones. One potential problem, however, is the formation of solidification cracks, which particularly affects alloys with a pronounced melting range. Since solidification cracking is influenced by both temperature and strain rate, precise measurement technologies are of crucial importance. For this purpose, as an experimental setup, a Controlled Tensile Weldability (CTW) test combined with a local deformation measurement technique is used. The aim of the present work is the development of computational methods and software tools to numerically simulate the CTW. The numerical results are compared with those obtained from the experimental CTW. In this study, an austenitic stainless steel sheet is selected. A thermo-elastoplastic material behavior with temperature-dependent material parameters is assumed. The time-dependent problem is first discretized in time and then the resulting nonlinear problem is linearized with Newton's method. For the discretization in space, finite elements are used. In order to obtain a sufficiently accurate solution, a large number of finite elements has to be used. In each Newton step, this yields a large linear system of equations that has to be solved. Therefore, a highly parallel scalable solver framework, based on the software library PETSc, was used to solve this computationally challenging problem on a high-performance computing architecture. Finally, the experimental results and the numerical simulations are compared, showing to be qualitatively in good agreement.

math.NA

Highly Scalable Two-level Monolithic Overlapping Schwarz Preconditioners for Thermo-elastoplastic Laser Beam Welding Problems

A thermo-elastoplastic finite element approach is used to perform the simulation of a laser beam welding (LBW) process. This results in a nonlinear, nonsymmetric saddle point multiphysics system, for which the nonlinearity is handled via the Newton method. The iterative solution of the arising linear system is accelerated by using robust and highly scalable, overlapping Schwarz domain decomposition preconditioners. It is well-known that a one-level method of this type is not scalable and therefore a second level has to be added. Therefore, the construction and numerical analysis of monolithic, two-level overlapping Schwarz preconditioners with different variants of the GDSW (Generalized Dryja-Smith-Widlund) coarse space are presented here. A new and parallel efficient implementation of several variants of GDSW, that is, GDSW, RGDSW, and GDSW*, in PETSc, is introduced, which is usable for multiphysics problems, as, for example, the thermo-mechanical LBW problem considered here. Different combinations of the GDSW variants for the different fields (temperature and displacements) are compared and parallel scalability for realistic problems is shown.

math.NA

Towards Automated Algebraic Multigrid Preconditioner Design Using Genetic Programming for Large-Scale Laser Beam Welding Simulations

Multigrid methods are asymptotically optimal algorithms ideal for large-scale simulations. But, they require making numerous algorithmic choices that significantly influence their efficiency. Unlike recent approaches that learn optimal multigrid components using machine learning techniques, we adopt a complementary strategy here, employing evolutionary algorithms to construct efficient multigrid cycles from available individual components. This technology is applied to finite element simulations of the laser beam welding process. The thermo-elastic behavior is described by a coupled system of time-dependent thermo-elasticity equations, leading to nonlinear and ill-conditioned systems. The nonlinearity is addressed using Newton's method, and iterative solvers are accelerated with an algebraic multigrid (AMG) preconditioner using hypre BoomerAMG interfaced via PETSc. This is applied as a monolithic solver for the coupled equations. To further enhance solver efficiency, flexible AMG cycles are introduced, extending traditional cycle types with level-specific smoothing sequences and non-recursive cycling patterns. These are automatically generated using genetic programming, guided by a context-free grammar containing AMG rules. Numerical experiments demonstrate the potential of these approaches to improve solver performance in large-scale laser beam welding simulations.

cs.CE

Nonlinear Two-Level Schwarz Methods: A Parallel Implementation in FROSch

Owing to the ability of nonlinear domain decomposition methods to improve the nonlinear convergence behavior of Newton's method, they have experienced a rise in popularity recently in the context of problems for which Newton's method converges slowly or not at all. This article introduces a novel parallel implementation of a two-level nonlinear Schwarz solver based on the FROSch (Fast and Robust Overlapping Schwarz) solver framework, part of Sandia's Trilinos library. First, an introduction to the key concepts underlying two-level nonlinear Schwarz methods is given, including a brief overview of the coarse space used to build the second level. Next, the parallel implementation is discussed, followed by preliminary parallel results for a scalar nonlinear diffusion problem and a 2D nonlinear plane-stress Neo-Hooke elasticity problem with large deformations.

math.NA

Domain-decomposed image classification algorithms using linear discriminant analysis and convolutional neural networks

In many modern computer application problems, the classification of image data plays an important role. Among many different supervised machine learning models, convolutional neural networks (CNNs) and linear discriminant analysis (LDA) as well as sophisticated variants thereof are popular techniques. In this work, two different domain decomposed CNN models are experimentally compared for different image classification problems. Both models are loosely inspired by domain decomposition methods and in addition, combined with a transfer learning strategy. The resulting models show improved classification accuracies compared to the corresponding, composed global CNN model without transfer learning and besides, also help to speed up the training process. Moreover, a novel decomposed LDA strategy is proposed which also relies on a localization approach and which is combined with a small neural network model. In comparison with a global LDA applied to the entire input data, the presented decomposed LDA approach shows increased classification accuracies for the considered test problems.

cs.CV

Adaptive and frugal BDDC coarse spaces for virtual element discretizations of a Stokes problem with heterogeneous viscosity

The virtual element method (VEM) is a family of numerical methods to discretize partial differential equations on general polygonal or polyhedral computational grids. However, the resulting linear systems are often ill-conditioned and robust preconditioning techniques are necessary for an iterative solution. Here, a balancing domain decomposition by constraints (BDDC) preconditioner is considered. Techniques to enrich the coarse space of BDDC applied to a Stokes problem with heterogeneous viscosity are proposed. In this framework a comparison between two adaptive techniques and a computationally cheaper heuristic approach is carried out. Numerical results computed on a physically realistic model show that the latter approach in combination with the deluxe scaling is a promising alternative.

math.NA

Nonlinear Monolithic Two-Level Schwarz Methods for the Navier-Stokes Equations

Nonlinear domain decomposition methods became popular in recent years since they can improve the nonlinear convergence behavior of Newton's method significantly for many complex problems. In this article, a nonlinear two-level Schwarz approach is considered and, for the first time, equipped with monolithic GDSW (Generalized Dryja-Smith-Widlund) coarse basis functions for the Navier-Stokes equations. Results for lid-driven cavity problems with high Reynolds numbers are presented and compared with classical global Newton's method equipped with a linear Schwarz preconditioner. Different options, for example, local pressure corrections on the subdomain and recycling of coarse basis functions are discussed in the nonlinear Schwarz approach for the first time.

math.NA

Model Parallel Training and Transfer Learning for Convolutional Neural Networks by Domain Decomposition

Deep convolutional neural networks (CNNs) have been shown to be very successful in a wide range of image processing applications. However, due to their increasing number of model parameters and an increasing availability of large amounts of training data, parallelization strategies to efficiently train complex CNNs are necessary. In previous work by the authors, a novel model parallel CNN architecture was proposed which is loosely inspired by domain decomposition. In particular, the novel network architecture is based on a decomposition of the input data into smaller subimages. For each of these subimages, local CNNs with a proportionally smaller number of parameters are trained in parallel and the resulting local classifications are then aggregated in a second step by a dense feedforward neural network (DNN). In the present work, we compare the resulting CNN-DNN architecture to less costly alternatives to combine the local classifications into a final, global decision. Additionally, we investigate the performance of the CNN-DNN trained as one coherent model as well as using a transfer learning strategy, where the parameters of the pre-trained local CNNs are used as initial values for a subsequently trained global coherent CNN-DNN model.

cs.CV

Monolithic overlapping Schwarz preconditioners for nonlinear finite element simulations of laser beam welding processes

Highly resolved finite element simulations of a laser beam welding process are considered. The thermomechanical behavior of this process is modeled with a set of thermoelasticity equations resulting in a nonlinear, nonsymmetric saddle point system. Newton's method is used to solve the nonlinearity and suitable domain decomposition preconditioners are applied to accelerate the convergence of the iterative method used to solve all linearized systems. Since a onelevel Schwarz preconditioner is in general not scalable, a second level has to be added. Therefore, the construction and numerical analysis of a monolithic, twolevel overlapping Schwarz approach with the GDSW (Generalized Dryja-Smith-Widlund) coarse space and an economic variant thereof are presented here.

math.NA

A Continuous Benchmarking Infrastructure for High-Performance Computing Applications

For scientific software, especially those used for large-scale simulations, achieving good performance and efficiently using the available hardware resources is essential. It is important to regularly perform benchmarks to ensure the efficient use of hardware and software when systems are changing and the software evolves. However, this can become quickly very tedious when many options for parameters, solvers, and hardware architectures are available. We present a continuous benchmarking strategy that automates benchmarking new code changes on high-performance computing clusters. This makes it possible to track how each code change affects the performance and how it evolves.

cs.PF

Computational homogenization for aerogel-like polydisperse open-porous materials using neural network--based surrogate models on the microscale

The morphology of nanostructured materials exhibiting a polydisperse porous space, such as aerogels, is very open porous and fine grained. Therefore, a simulation of the deformation of a large aerogel structure resolving the nanostructure would be extremely expensive. Thus, multi-scale or homogenization approaches have to be considered. Here, a computational scale bridging approach based on the FE$^2$ method is suggested, where the macroscopic scale is discretized using finite elements while the microstructure of the open-porous material is resolved as a network of Euler-Bernoulli beams. Here, the beam frame based RVEs (representative volume elements) have pores whose size distribution follows the measured values for a specific material. This is a well-known approach to model aerogel structures. For the computational homogenization, an approach to average the first Piola-Kirchhoff stresses in a beam frame by neglecting rotational moments is suggested. To further overcome the computationally most expensive part in the homogenization method, that is, solving the RVEs and averaging their stress fields, a surrogate model is introduced based on neural networks. The networks input is the localized deformation gradient on the macroscopic scale and its output is the averaged stress for the specific material. It is trained on data generated by the beam frame based approach. The effiency and robustness of both homogenization approaches is shown numerically, the approximation properties of the surrogate model is verified for different macroscopic problems and discretizations. Different (Quasi-)Newton solvers are considered on the macroscopic scale and compared with respect to their convergence properties.

math.NA

Machine learning and domain decomposition methods -- a survey

Hybrid algorithms, which combine black-box machine learning methods with experience from traditional numerical methods and domain expertise from diverse application areas, are progressively gaining importance in scientific machine learning and various industrial domains, especially in computational science and engineering. In the present survey, several promising avenues of research will be examined which focus on the combination of machine learning (ML) and domain decomposition methods (DDMs). The aim of this survey is to provide an overview of existing work within this field and to structure it into domain decomposition for machine learning and machine learning-enhanced domain decomposition, including: domain decomposition for classical machine learning, domain decomposition to accelerate the training of physics-aware neural networks, machine learning to enhance the convergence properties or computational efficiency of DDMs, and machine learning as a discretization method in a DDM for the solution of PDEs. In each of these fields, we summarize existing work and key advances within a common framework and, finally, disuss ongoing challenges and opportunities for future research.

math.NA

Learning Adaptive Constraints in Nonlinear FETI-DP Methods

While linear FETI-DP (Finite Element Tearing and Interconnecting - Dual Primal) is an efficient iterative domain decomposition solver for discretized linear PDEs (partial differential equations), nonlinear FETI-DP is its consequent extension to the nonlinear case. In both methods, the parallel efficiency of the method results from a decomposition of the computational domain into nonoverlapping subdomains and a resulting localization of the computational work. For a fast linear convergence of the linear FETI-DP method, a global coarse problem has to be considered. Adaptive coarse spaces are provably robust variants for many complicated micro-heterogeneous problems, as, for example, stationary diffusion problems with large jumps in the diffusion coefficient. Unfortunately, the set-up and exact computation of adaptive coarse spaces is known to be computationally expensive. Therefore, recently, surrogate models based on neural networks have been trained to directly predict the adaptive coarse constraints. Here, these learned constraints are implemented in nonlinear FETI-DP and it is shown numerically that they are able to improve the nonlinear as well as linear convergence speed of nonlinear FETI-DP.

math.NA