SearcharxivSearch

arXiv subjects

David J. Silvester

Publications and source records attributed to David J. Silvester.

13 recordsLinked to original sources

DAS-PINNs for high-dimensional partial differential equations: extending deep adaptive sampling to spacetime domains

Time-dependent high-dimensional partial differential equations (PDEs) with spatially localised and dynamically evolving solutions pose a fundamental challenge for physics-informed neural networks (PINNs), as uniform collocation sampling becomes increasingly ineffective in high-dimensional spatiotemporal domains. In this work, a deep adaptive sampling framework for PINNs is extended to the time-dependent setting by treating space and time as a unified domain without any explicit time marching. A normalising flow neural network model effectively learns the distribution induced by the PDE residual and generates new collocation points concentrated in regions where the solution is most difficult to learn. Unlike conventional adaptive strategies that require explicit time stepping or moving meshes, high-residual regions are automatically identified and tracked across both space and time, driven purely by the PDE residual distribution. The effectiveness of the proposed strategy is assessed on a range of benchmark problems, from sharp and moving features in two spatial dimensions to localised structures in up to eight spatial dimensions.

math.NA

Adaptive Sampling for Hydrodynamic Stability

An adaptive sampling approach for efficient detection of bifurcation boundaries in parametrized fluid flow problems is presented herein. The study extends the machine-learning approach of Silvester~(J. Comput. Phys., 553 (2026), 114743), where a classifier network was trained on preselected simulation data to identify bifurcated and nonbifurcated flow regimes. In contrast, the proposed methodology introduces adaptivity through a flow-based deep generative model that automatically refines the sampling of the parameter space. The strategy has two components: a classifier network maps the flow parameters to a bifurcation probability, and a probability density estimation technique (KRnet) for the generation of new samples at each adaptive step. The classifier output provides a probabilistic measure of flow stability, and the Shannon entropy of these predictions is employed as an uncertainty indicator. KRnet is trained to approximate a probability density function that concentrates sampling in regions of high entropy, thereby directing computational effort towards the evolving bifurcation boundary. This coupling between classification and generative modeling establishes a feedback-driven adaptive learning process analogous to error-indicator based refinement in contemporary partial differential equation solution strategies. Starting from a uniform parameter distribution, the new approach achieves accurate bifurcation boundary identification with significantly fewer Navier--Stokes simulations, providing a scalable foundation for high-dimensional stability analysis.

physics.flu-dyn

Machine learning for hydrodynamic stability

A machine-learning strategy for investigating the stability of fluid flow problems is proposed herein. The goal is to provide a simple yet robust methodology to find a nonlinear mapping from the parametric space to an indicator representing the probability of observing a bifurcated solution. The computational procedure is demonstrably robust and does not require parameter tuning. The essential feature of the strategy is that the computational solution of the Navier-Stokes equations is a reliable proxy for laboratory experiments investigating sensitivity to flow parameters. The applicability of our probabilistic bifurcation detection strategy is demonstrated by an investigation of two classical examples of flow instability associated with thermal convection. The codes used to generate and process the labelled data are available on GitHub.

physics.flu-dyn

Fast solution of incompressible flow problems with two-level pressure approximation

This paper develops efficient preconditioned iterative solvers for incompressible flow problems discretised by an enriched Taylor-Hood mixed approximation, in which the usual pressure space is augmented by a piecewise constant pressure to ensure local mass conservation. This enrichment process causes over-specification of the pressure when the pressure space is defined by the union of standard Taylor-Hood basis functions and piecewise constant pressure basis functions, which complicates the design and implementation of efficient solvers for the resulting linear systems. We first describe the impact of this choice of pressure space specification on the matrices involved. Next, we show how to recover effective solvers for Stokes problems, with preconditioners based on the singular pressure mass matrix, and for Oseen systems arising from linearised Navier-Stokes equations, by using a two-stage pressure convection-diffusion strategy. The codes used to generate the numerical results are available online.

math.NA

Efficient Adaptive Stochastic Collocation Strategies for Advection-Diffusion Problems with Uncertain Inputs

Physical models with uncertain inputs are commonly represented as parametric partial differential equations (PDEs). That is, PDEs with inputs that are expressed as functions of parameters with an associated probability distribution. Developing efficient and accurate solution strategies that account for errors on the space, time and parameter domains simultaneously is highly challenging. Indeed, it is well known that standard polynomial-based approximations on the parameter domain can incur errors that grow in time. In this work, we focus on advection-diffusion problems with parameter-dependent wind fields. A novel adaptive solution strategy is proposed that allows users to combine stochastic collocation on the parameter domain with off-the-shelf adaptive timestepping algorithms with local error control. This is a non-intrusive strategy that builds a polynomial-based surrogate that is adapted sequentially in time. The algorithm is driven by a so-called hierarchical estimator for the parametric error and balances this against an estimate for the global timestepping error which is derived from a scaling argument.

math.NA

IFISS3D: A computational laboratory for investigating finite element approximation in three dimensions

IFISS is an established MATLAB finite element software package for studying strategies for solving partial differential equations (PDEs). IFISS3D is a new add-on toolbox that extends IFISS capabilities for elliptic PDEs from two to three space dimensions. The open-source MATLAB framework provides a computational laboratory for experimentation and exploration of finite element approximation and error estimation, as well as iterative solvers. The package is designed to be useful as a teaching tool for instructors and students who want to learn about state-of-the-art finite element methodology. It will also be useful for researchers as a source of reproducible test matrices of arbitrarily large dimension.

math.NA

Error estimation and adaptivity for stochastic collocation finite elements Part II: multilevel approximation

A multilevel adaptive refinement strategy for solving linear elliptic partial differential equations with random data is recalled in this work. The strategy extends the a posteriori error estimation framework introduced by Guignard and Nobile in 2018 (SIAM J. Numer. Anal, 56, 3121--3143) to cover problems with a nonaffine parametric coefficient dependence. A suboptimal, but nonetheless reliable and convenient implementation of the strategy involves approximation of the decoupled PDE problems with a common finite element approximation space. Computational results obtained using such a single-level strategy are presented in part I of this work (Bespalov, Silvester and Xu, arXiv:2109.07320). Results obtained using a potentially more efficient multilevel approximation strategy, where meshes are individually tailored, are discussed herein. The codes used to generate the numerical results are available online.

math.NA

A locally mass conserving quadratic velocity, linear pressure element

By supplementing the pressure space for the Taylor-Hood element a triangular element that satisfies continuity over each element is produced. Making a novel extension of the patch argument to prove stability, this element is shown to be globally stable and give optimal rates of convergence on a wide range of triangular grids. This theoretical result is extended in the discussion given in the appendix, showing how optimal convergence rates can be obtained on all grids. Two examples are presented, one illustrating the convergence rates and the other illustrating difficulties with the Taylor-Hood element which are overcome by the element presented here.

math.NA

Robust a posteriori error estimation for stochastic Galerkin formulations of parameter-dependent linear elasticity equations

The focus of this work is a posteriori error estimation for stochastic Galerkin approximations of parameter-dependent linear elasticity equations. The starting point is a three-field PDE model in which the Young's modulus is an affine function of a countable set of parameters. We analyse the weak formulation, its stability with respect to a weighted norm and discuss approximation using stochastic Galerkin mixed finite element methods (SG-MFEMs). We introduce a novel a posteriori error estimation scheme and establish upper and lower bounds for the SG-MFEM error. The constants in the bounds are independent of the Poisson ratio as well as the SG-MFEM discretisation parameters. In addition, we discuss proxies for the error reduction associated with certain enrichments of the SG-MFEM spaces and we use these to develop an adaptive algorithm that terminates when the estimated error falls below a user-prescribed tolerance. We prove that both the a posteriori error estimate and the error reduction proxies are reliable and efficient in the incompressible limit case. Numerical results are presented to validate the theory. All experiments were performed using open source (IFISS) software that is available online.

math.NA

Robust preconditioning for stochastic Galerkin formulations of parameter-dependent nearly incompressible linear elasticity equations

We consider the nearly incompressible linear elasticity problem with an uncertain spatially varying Young's modulus. The uncertainty is modelled with a finite set of parameters with prescribed probability distribution. We introduce a novel three-field mixed variational formulation of the PDE model and discuss its approximation by stochastic Galerkin mixed finite element techniques. First, we establish the well posedness of the proposed variational formulation and the associated finite-dimensional approximation. Second, we focus on the efficient solution of the associated large and indefinite linear system of equations. A new preconditioner is introduced for use with the minimal residual method (MINRES). Eigenvalue bounds for the preconditioned system are established and shown to be independent of the discretisation parameters and the Poisson ratio. The S-IFISS software used for computation is available online.

math.NA

Robust a posteriori error estimators for mixed approximation of nearly incompressible elasticity

This paper is concerned with the analysis and implementation of robust finite element approximation methods for mixed formulations of linear elasticity problems where the elastic solid is almost incompressible. Several novel a posteriori error estimators for the energy norm of the finite element error are proposed and analysed. We establish upper and lower bounds for the energy error in terms of the proposed error estimators and prove that the constants in the bounds are independent of the Lamé coefficients: thus the proposed estimators are robust in the incompressible limit. Numerical results are presented that validate the theoretical estimates. The software used to generate these results is available online.

math.NA

Robust error estimation for lowest-order approximation of nearly incompressible elasticity

We consider so-called Herrmann and Hydrostatic mixed formulations of classical linear elasticity and analyse the error associated with locally stabilised $P_1-P_0$ finite element approximation. First, we prove a stability estimate for the discrete problem and establish an a priori estimate for the associated energy error. Second, we consider a residual-based a posteriori error estimator as well as a local Poisson problem estimator. We establish bounds for the energy error that are independent of the Lamé coefficients and prove that the estimators are robust in the incompressible limit. A key issue to be addressed is the requirement for pressure stabilisation. Numerical results are presented that validate the theory. The software used is available online.

math.NA

Collocation Methods for Exploring Perturbations in Linear Stability Analysis

Eigenvalue analysis is a well-established tool for stability analysis of dynamical systems. However, there are situations where eigenvalues miss some important features of physical models. For example, in models of incompressible fluid dynamics, there are examples where linear stability analysis predicts stability but transient simulations exhibit significant growth of infinitesimal perturbations. This behavior can be predicted by pseudo-spectral analysis. In this study, we show that an approach similar to pseudo-spectral analysis can be performed inexpensively using stochastic collocation methods and the results can be used to provide quantitative information about instability. In addition, we demonstrate that the results of the perturbation analysis provide insight into the behavior of unsteady flow simulations.

math.NA