Searcharxiv⌕ Search

arXiv subjects

Marcin Łoś

Publications and source records attributed to Marcin Łoś.

11 recordsLinked to original sources

Collocation-based Robust Physics Informed Neural Networks for time-dependent simulations of pollution propagation under thermal inversion conditions on Spitsbergen

In this paper, we propose a Physics-Informed Neural Network framework for time-dependent simulations of pollution propagation originating from moving emission sources. We formulate a robust variational framework for the time-dependent advection-diffusion problem and establish the boundedness and inf-sup stability of the corresponding discrete weak formulation. Based on this mathematical foundation, we construct a robust loss function that is directly related to the true approximation error, defined as the difference between the neural network approximation and the (unknown) exact solution. Additionally, a collocation-based strategy is introduced to speed up neural network training. We also extend our model to the non-linear Burgers-type equations. As a case study, we investigate pollution propagation caused by snowmobile traffic in Longyearbyen, Spitsbergen, supported by detailed in-field measurements collected using dedicated sensors. The proposed framework is applied to analyze the effects of thermal inversion on pollutant accumulation. Our results demonstrate that thermal inversion traps dense and humid air masses near the ground, significantly enhancing particulate matter (PM) concentration and worsening local air quality. We compare our method to linear computational cost explicit dynamics solver using isogeometric analysis. We show that our method can solve non-linear non-stationary problem four times slower than IGA solver can solve the linear problem. It makes it particularly interesting to investigate the non-linear extensions with similar computational cost as the linear formulation.

cs.LG↗

CO$_2$ sequestration hybrid solver using isogeometric alternating-directions and collocation-based robust variational physics informed neural networks (IGA-ADS-CRVPINN)

This paper presents the hybrid solver for a $CO_2$ sequestration problem. The solver uses the IGA-ADS (IsoGeometric Analysis Alternating Directions solver) to compute the saturation scalar field update using the explicit method, and CRVPINN (Collocation-based Robust Variational Physics Informed Neural Networks solver) to compute the pressure scalar field. The study focuses on simulating the physical behavior of $CO_2$ in porous structures, excluding chemical reactions. The mathematical model is based on Darcy's Law. The CRVPINN is pretrained on the initial pressure configuration, and the time step pressure updates require only 100 iterations of the Adam method per time step. We compare our hybrid IGA-ADS solver, coupled with the CRVPINN method, with a baseline of the IGA-ADS solver coupled with the MUMPS direct solver. Our hybrid solver is over 3 times faster on a single computational node from the ARES cluster of ACK CYFRONET. Future work includes extensive testing, inverse problem solving, and potential application to $H_2$ storage problems.

math.NA↗

Wildfires Quasi-Implicit Alternative-Direction Simulations using Isogeometric Finite Element Method

We develop a wildfire simulation model that evolves the temperature scalar field using an energy balance equation accounting for heat generation, transport, and loss. For these equations, we develop quasi-implicit time integration schemes using direction splitting of the differential operators. We use the Peaceman-Rachford and Strang splitting methods, including the Crank-Nicolson method. Based on these discretizations, we derive variational formulations and explore the Kronecker product structure of the matrices. In the wildfire model, there are some non-linear terms that we treat explicitly. We perform a detailed analysis of how treating these terms affects the stability of the time integration scheme. Namely, we show that a quasi-implicit time integration scheme achieves 10 times higher simulation accuracy. We present two wildfire simulations. The first is a simulation of the 2024 wildfire disaster in the Valparaíso region of Chile. The second one is a simulation of the 2019 wildfire disaster in Las Palmas de Gran Canaria, Spain. We discuss the numerical results and compare them against satellite images and measurement records. We also present a numerical experiment for comparison with the state-of-the-art wildfire simulation model FARSITE. Our sequential code has a linear computational cost of ${\cal O}(N)$. We also present the parallel scalability of the WILDFIRE-IGA-ADS code to illustrate the possibility of running the code on a local workstation.

cs.CE↗

Python library supporting Discrete Variational Formulations and training solutions with Collocation-based Robust Variational Physics Informed Neural Networks (DVF-CRVPINN)

We explore the possibility of solving Partial Differential Equations (PDEs) using discrete weak formulations. We propose a programming environment for defining a discrete computational domain, introducing discrete functions defined over a set of points, constructing discrete inner products, and introducing discrete weak formulations employing Kronecker delta test functions. Building on this setup, we propose a discrete neural network representation, training the solution function defined over a discrete set of points and employing discrete finite difference derivatives in the automatic differentiation procedures. As a challenging computational model example, we focus on Stokes equations in two-dimensions, defined over a discrete set of points. We train the solution using the discrete weak residual and the Adamax algorithm with discrete automatic differentiation of the discrete gradients. Despite introducing the python environment, we also provide a rigorous mathematical formulation based on discrete weak formulations, proving the well-posedness and robustness of the loss function. The solution of the discrete weak formulations is based on neural network training employing a robust loss function that is related to the true error. In this way, we have a robust control of the numerical error during the training of the neural networks. Besides the Stokes formulation, we also explain the functionality of the proposed library using the Laplace problem formulation.

cs.LG↗

Stabilization of isogeometric finite element method with optimal test functions computed from $L_2$ norm residual minimization

We compare several stabilization methods in the context of isogeometric analysis and B-spline basis functions, using an advection-dominated advection\revision{-}diffusion as a model problem. We derive (1) the least-squares finite element method formulation using the framework of Petrov-Galerkin method with optimal test functions in the $L_2$ norm, which guarantee automatic preservation of the \emph{inf-sup} condition of the continuous formulation. We also combine it with the standard Galerkin method to recover (2) the Galerkin/least-squares formulation, and derive coercivity constant bounds valid for B-spline basis functions. The resulting stabilization method are compared with the least-squares and (3) the Streamline-Upwind Petrov-Galerkin (SUPG)method using again the Eriksson-Johnson model problem. The results indicate that least-squares (equivalent to Petrov-Galerkin with $L_2$-optimal test functions) outperforms the other stabilization methods for small Péclet numbers, while strongly advection-dominated problems are better handled with SUPG or Galerkin/least-squares.

math.NA↗

Collocation-based Robust Variational Physics-Informed Neural Networks (CRVPINN)

Physics-Informed Neural Networks (PINNs) have been successfully applied to solve Partial Differential Equations (PDEs). Their loss function is founded on a strong residual minimization scheme. Variational Physics-Informed Neural Networks (VPINNs) are their natural extension to weak variational settings. In this context, the recent work of Robust Variational Physics-Informed Neural Networks (RVPINNs) highlights the importance of conveniently translating the norms of the underlying continuum-level spaces to the discrete level. Otherwise, VPINNs might become unrobust, implying that residual minimization might be highly uncorrelated with a desired minimization of the error in the energy norm. However, applying this robustness to VPINNs typically entails dealing with the inverse of a Gram matrix, usually producing slow convergence speeds during training. In this work, we accelerate the implementation of RVPINN, establishing a LU factorization of sparse Gram matrix in a kind of point-collocation scheme with the same spirit as original PINNs. We call out method the Collocation-based Robust Variational Physics Informed Neural Networks (CRVPINN). We test our efficient CRVPINN algorithm on Laplace, advection-diffusion, and Stokes problems in two spatial dimensions.

cs.LG↗

Simulating the aftermath of Northern European Enclosure Dam (NEED) break and flooding of European coast

The Northern European Enclosure Dam (NEED) is a hypothetical project to prevent flooding in European countries following the rising ocean level due to melting arctic glaciers. This project involves the construction of two large dams between Scotland and Norway, as well as England and France. The anticipated cost of this project is 250 to 500 billion euros. In this paper, we present the simulation of the aftermath of flooding on the European coastline caused by a catastrophic break of this hypothetical dam. From our simulation results, we can observe that there is a traveling wave after the accident, with a velocity of around 10 kilometers per hour, raising the sea level permanently inside the dammed region. This observation implies a need to construct additional dams or barriers protecting the northern coastline of the Netherlands and the interior of the Baltic Sea. Our simulations have been obtained using the following building blocks. First, a graph transformation model was applied to generate an adaptive mesh approximating the topography of the Earth. We employ the composition graph grammar model for breaking triangular elements in the mesh without the generation of hanging nodes. Second, the wave equation is formulated in a spherical latitude-longitude system of coordinates and solved by a high-order time integration scheme using the generalized $α$ method.

cs.CE↗

Physics Informed Neural Network Code for 2D Transient Problems (PINN-2DT) Compatible with Google Colab

We present an open-source Physics Informed Neural Network environment for simulations of transient phenomena on two-dimensional rectangular domains, with the following features: (1) it is compatible with Google Colab which allows automatic execution on cloud environment; (2) it supports two dimensional time-dependent PDEs; (3) it provides simple interface for definition of the residual loss, boundary condition and initial loss, together with their weights; (4) it support Neumann and Dirichlet boundary conditions; (5) it allows for customizing the number of layers and neurons per layer, as well as for arbitrary activation function; (6) the learning rate and number of epochs are available as parameters; (7) it automatically differentiates PINN with respect to spatial and temporal variables; (8) it provides routines for plotting the convergence (with running average), initial conditions learnt, 2D and 3D snapshots from the simulation and movies (9) it includes a library of problems: (a) non-stationary heat transfer; (b) wave equation modeling a tsunami; (c) atmospheric simulations including thermal inversion; (d) tumor growth simulations.

cs.CE↗

Solver algorithm for stabilized space-time formulation of advection-dominated diffusion problem

This article shows how to develop an efficient solver for a stabilized numerical space-time formulation of the advection-dominated diffusion transient equation. At the discrete space-time level, we approximate the solution by using higher-order continuous B-spline basis functions in its spatial and temporal dimensions. This problem is very difficult to solve numerically using the standard Galerkin finite element method due to artificial oscillations present when the advection term dominates the diffusion term. However, a first-order constraint least-square formulation allows us to obtain numerical solutions avoiding oscillations. The advantages of space-time formulations are the use of high-order methods and the feasibility of developing space-time mesh adaptive techniques on well-defined discrete problems. We develop a solver for a least-square formulation to obtain a stabilized and symmetric problem on finite element meshes. The computational cost of our solver is bounded by the cost of the inversion of the space-time mass and stiffness (with one value fixed at a point) matrices and the cost of the GMRES solver applied for the symmetric and positive definite problem. We illustrate our findings on an advection-dominated diffusion space-time model problem and present two numerical examples: one with isogeometric analysis discretizations and the second one with an adaptive space-time finite element method.

math.NA↗

Isogeometric Residual Minimization Method (iGRM) with Direction Splitting Preconditoner for Stationary Advection-Diffusion Problems

In this paper, we introduce the isoGeometric Residual Minimization (iGRM) method. The method solves stationary advection-dominated diffusion problems. We stabilize the method via residual minimization. We discretize the problem using B-spline basis functions. We then seek to minimize the isogeometric residual over a spline space built on a tensor product mesh. We construct the solution over a smooth subspace of the residual. We can specify the solution subspace by reducing the polynomial order, by increasing the continuity, or by a combination of these. The Gramm matrix for the residual minimization method is approximated by a weighted H1 norm, which we can express as Kronecker products, due to the tensor-product structure of the approximations. We use the Gramm matrix as a preconditional which can be applied in a computational cost proportional to the number of degrees of freedom in 2D and 3D. Building on these approximations, we construct an iterative algorithm. We test the residual minimization method on several numerical examples, and we compare it to the Discontinuous Petrov-Galerkin (DPG) and the Streamline Upwind Petrov-Galerkin (SUPG) stabilization methods. The iGRM method delivers similar quality solutions as the DPG method, it uses smaller grids, it does not require breaking of the spaces, but it is limited to tensor-product meshes. The computational cost of the iGRM is higher than for SUPG, but it does not require the determination of problem specific parameters.

math.NA↗

Approximation of the objective insensitivity regions using Hierarchic Memetic Strategy coupled with Covariance Matrix Adaptation Evolutionary Strategy

One of the most challenging types of ill-posedness in global optimization is the presence of insensitivity regions in design parameter space, so the identification of their shape will be crucial, if ill-posedness is irrecoverable. Such problems may be solved using global stochastic search followed by post-processing of a local sample and a local objective approximation. We propose a new approach of this type composed of Hierarchic Memetic Strategy (HMS) powered by the Covariance Matrix Adaptation Evolutionary Strategy (CMA-ES) well-known as an effective, self-adaptable stochastic optimization algorithm and we leverage the distribution density knowledge it accumulates to better identify and separate insensitivity regions. The results of benchmarks prove that the improved HMS-CMA-ES strategy is effective in both the total computational cost and the accuracy of insensitivity region approximation. The reference data for the tests was obtained by means of a well-known effective strategy of multimodal stochastic optimization called the Niching Evolutionary Algorithm 2 (NEA2), that also uses CMA-ES as a component.

cs.NE↗