Searcharxiv⌕ Search

arXiv subjects

Håkon Hoel

Publications and source records attributed to Håkon Hoel.

17 recordsLinked to original sources

A Priori Adaptive Numerical Methods for Estimating Blow-up Times of Autonomous ODEs

We present effective a priori adaptive numerical methods for estimating the blow-up time for solutions of autonomous ODEs. The novelty of our approach is to base our adaptive steps on the sensitivity of an auxiliary hitting time. We provide results on the theoretical error rates, and show that there is a benefit in terms of computational effort in choosing our adaptive algorithm over alternative approaches. Numerical experiments support our theoretical results and show how the methods perform in practice.

math.NA↗

The multi-index Monte Carlo method for semilinear stochastic partial differential equations

Stochastic partial differential equations (SPDEs) are often difficult to solve numerically due to their low regularity and high dimensionality. These challenges limit the practical use of computer-aided studies and pose significant barriers to statistical analysis of SPDEs. In this work, we introduce a highly efficient multi-index Monte Carlo method (MIMC) designed to approximate statistics of mild solutions to semilinear parabolic SPDEs. Key to our approach is the proof of a multiplicative convergence property for coupled solutions generated by an exponential integrator numerical solver, which we incorporate with MIMC. We further describe theoretically how the asymptotic computational cost of MIMC can be bounded in terms of the input accuracy tolerance, as the tolerance goes to zero. Notably, our methodology illustrates that for an SPDE with low regularity, MIMC offers substantial performance improvements over other viable methods. Numerical experiments comparing the performance of MIMC with the multilevel Monte Carlo method on relevant test problems validate our theoretical findings. These results also demonstrate that MIMC significantly outperforms state-of-the-art multilevel Monte Carlo, thereby underscoring its potential as a robust and tractable tool for solving semilinear parabolic SPDEs.

math.NA↗

Weak convergence analysis in the particle limit of the McKean--Vlasov equations using stochastic flows of particle systems

We present a proof showing that the weak error of a system of $n$ interacting stochastic particles approximating the solution of the McKean-Vlasov equation is $\mathcal O(n^{-1})$. Our proof is based on the Kolmogorov backward equation for the particle system and bounds on the derivatives of its solution, which we derive more generally using the variations of the stochastic particle system. The convergence rate is verified by numerical experiments, which also indicate that the assumptions made here and in the literature can be relaxed.

math.PR↗

A Fast and Accurate Numerical Method for the Left Tail of Sums of Independent Random Variables

We present a flexible, deterministic numerical method for computing left-tail rare events of sums of non-negative, independent random variables. The method is based on iterative numerical integration of linear convolutions by means of Newtons-Cotes rules. The periodicity properties of convoluted densities combined with the Trapezoidal rule are exploited to produce a robust and efficient method, and the method is flexible in the sense that it can be applied to all kinds of non-negative continuous RVs. We present an error analysis and study the benefits of utilizing Newton-Cotes rules versus the fast Fourier transform (FFT) for numerical integration, showing that although there can be efficiency-benefits to using FFT, Newton-Cotes rules tend to preserve the relative error better, and indeed do so at an acceptable computational cost. Numerical studies on problems with both known and unknown rare-event probabilities showcase the method's performance and support our theoretical findings.

stat.CO↗

Higher-order adaptive methods for exit times of Itô diffusions

We construct a higher-order adaptive method for strong approximations of exit times of Itô stochastic differential equations (SDE). The method employs a strong Itô--Taylor scheme for simulating SDE paths, and adaptively decreases the step-size in the numerical integration as the solution approaches the boundary of the domain. These techniques turn out to complement each other nicely: adaptive time-stepping improves the accuracy of the exit time by reducing the magnitude of the overshoot of the numerical solution when it exits the domain, and higher-order schemes improve the approximation of the state of the diffusion process. We present two versions of the higher-order adaptive method. The first one uses the Milstein scheme as numerical integrator and two step-sizes for adaptive time-stepping: $h$ when far away from the boundary and $h^2$ when close to the boundary. The second method is an extension of the first one using the strong Itô--Taylor scheme of order 1.5 as numerical integrator and three step-sizes for adaptive time-stepping. For any $ξ>0$, we prove that the strong error is bounded by $\mathcal{O}(h^{1-ξ})$ and $\mathcal{O}(h^{3/2-ξ})$ for the first and second method, respectively, and the expected computational cost for both methods is $\mathcal{O}(h^{-1} \log(h^{-1}))$. Theoretical results are supported by numerical examples, and we discuss the potential for extensions that improve the strong convergence rate even further.

math.NA↗

Improved Efficiency of Multilevel Monte Carlo for Stochastic PDE through Strong Pairwise Coupling

Multilevel Monte Carlo (MLMC) has become an important methodology in applied mathematics for reducing the computational cost of weak approximations. For many problems, it is well-known that strong pairwise coupling of numerical solutions in the multilevel hierarchy is needed to obtain efficiency gains. In this work, we show that strong pairwise coupling indeed is also important when (MLMC) is applied to stochastic partial differential equations (SPDE) of reaction-diffusion type, as it can improve the rate of convergence and thus improve tractability. For the (MLMC) method with strong pairwise coupling that was developed and studied numerically on filtering problems in [{\it Chernov et al., Numer. Math., 147 (2021), 71-125}], we prove that the rate of computational efficiency is higher than for existing methods. We also provide numerical comparisons with alternative coupling ideas on linear and nonlinear SPDE to illustrate the importance of this feature.

math.NA↗

Multi-index ensemble Kalman filtering

In this work we combine ideas from multi-index Monte Carlo and ensemble Kalman filtering (EnKF) to produce a highly efficient filtering method called multi-index EnKF (MIEnKF). MIEnKF is based on independent samples of four-coupled EnKF estimators on a multi-index hierarchy of resolution levels, and it may be viewed as an extension of the multilevel EnKF (MLEnKF) method developed by the same authors in 2020. Multi-index here refers to a two-index method, consisting of a hierarchy of EnKF estimators that are coupled in two degrees of freedom: time discretization and ensemble size. Under certain assumptions, when strong coupling between solutions on neighboring numerical resolutions is attainable, the MIEnKF method is proven to be more tractable than EnKF and MLEnKF. Said efficiency gains are also verified numerically in a series of test problems.

math.NA↗

Multilevel Ensemble Kalman Filtering based on a sample average of independent EnKF estimators

We introduce a new multilevel ensemble Kalman filter method (MLEnKF) which consists of a hierarchy of independent samples of ensemble Kalman filters (EnKF). This new MLEnKF method is fundamentally different from the preexisting method introduced by Hoel, Law and Tempone in 2016, and it is suitable for extensions towards multi-index Monte Carlo based filtering methods. Robust theoretical analysis and supporting numerical examples show that under appropriate regularity assumptions, the MLEnKF method has better complexity than plain vanilla EnKF in the large-ensemble and fine-resolution limits, for weak approximations of quantities of interest. The method is developed for discrete-time filtering problems with finite-dimensional state space and linear observations polluted by additive Gaussian noise.

math.NA↗

Multilevel ensemble Kalman filtering for spatio-temporal processes

We design and analyse the performance of a multilevel ensemble Kalman filter method (MLEnKF) for filtering settings where the underlying state-space model is an infinite-dimensional spatio-temporal process. We consider underlying models that needs to be simulated by numerical methods, with discretization in both space and time. The multilevel Monte Carlo (MLMC) sampling strategy, achieving variance reduction through pairwise coupling of ensemble particles on neighboring resolutions, is used in the sample-moment step of MLEnKF to produce an efficient hierarchical filtering method for spatio-temporal models. Under sufficient regularity, MLEnKF is proven to be more efficient for weak approximations than EnKF, asymptotically in the large-ensemble and fine-numerical-resolution limit. Numerical examples support our theoretical findings.

math.NA↗

Classical Langevin dynamics derived from quantum mechanics

The classical work by Zwanzig [J. Stat. Phys. 9 (1973) 215-220] derived Langevin dynamics from a Hamiltonian system of a heavy particle coupled to a heat bath. This work extends Zwanzig's model to a quantum system and formulates a more general coupling between a particle system and a heat bath. The main result proves that ab initio Langevin molecular dynamics, with a certain rank one friction matrix determined by the coupling, approximates for any temperature canonical quantum observables, based on the system coordinates, more accurately than any Hamiltonian system in these coordinates, for large mass ratio between the system and the heat bath nuclei.

math-ph↗

Central limit theorems for multilevel Monte Carlo methods

In this work, we show that uniform integrability is not a necessary condition for central limit theorems (CLT) to hold for normalized multilevel Monte Carlo (MLMC) estimators and we provide near optimal weaker conditions under which the CLT is achieved. In particular, if the variance decay rate dominates the computational cost rate (i.e., $β> γ$), we prove that the CLT applies to the standard (variance minimizing) MLMC estimator. For other settings where the CLT may not apply to the standard MLMC estimator, we propose an alternative estimator, called the mass-shifted MLMC estimator, to which the CLT always applies. This comes at a small efficiency loss: the computational cost of achieving mean square approximation error $\mathcal{O}(ε^2)$ is at worst a factor $\mathcal{O}(\log(1/ε))$ higher with the mass-shifted estimator than with the standard one.

math.PR↗

Numerical methods for conservation laws with rough flux

Finite volume methods are proposed for computing approximate pathwise entropy/kinetic solutions to conservation laws with a rough path dependent flux function. For a convex flux, it is demonstrated that rough path oscillations may lead to "cancellations" in the solution. Making use of this property, we show that for $α$-H{ö}lder continuous rough paths the convergence rate of the numerical methods can improve from $\mathcal{O}(\text{COST}^{-γ})$, for some $γ\in \left[α/(12-8α), α/(10-6α)\right]$, with $α\in (0, 1)$, to $\mathcal{O}(\text{COST}^{-\min(1/4,α/2)})$. Numerical examples support the theoretical results.

math.NA↗

Path-dependent convex conservation laws

For scalar conservation laws driven by a rough path $z(t)$, in the sense of Lions, Perthame and Souganidis in arXiv:1309.1931, we show that it is possible to replace $z(t)$ by a piecewise linear path, and still obtain the same solution at a given time, under the assumption of a convex flux function in one spatial dimension. This result is connected to the spatial regularity of solutions. We show that solutions are spatially Lipschitz continuous for a given set of times, depending on the path and the initial data. Fine properties of the map $z \mapsto u(τ)$, for a fixed time $τ$, are studied. We provide a detailed description of the properties of the rough path $z(t)$ that influences the solution. This description is extracted by a "factorization" of the solution operator (at time $τ$). In a companion paper, we make use of the observations herein to construct computationally efficient numerical methods.

math.AP↗

Computable error estimates for finite element approximations of elliptic partial differential equations with rough stochastic data

We derive computable error estimates for finite element approximations of linear elliptic partial differential equations (PDE) with rough stochastic coefficients. In this setting, the exact solutions contain high frequency content that standard a posteriori error estimates fail to capture. We propose goal-oriented estimates, based on local error indicators, for the pathwise Galerkin and expected quadrature errors committed in standard, continuous, piecewise linear finite element approximations. Derived using easily validated assumptions, these novel estimates can be computed at a relatively low cost and have applications to subsurface flow problems in geophysics where the conductivities are assumed to have lognormal distributions with low regularity. Our theory is supported by numerical experiments on test problems in one and two dimensions.

math.NA↗

Multilevel ensemble Kalman filtering

This work embeds a multilevel Monte Carlo sampling strategy into the Monte Carlo step of the ensemble Kalman filter (EnKF) in the setting of finite dimensional signal evolution and noisy discrete-time observations. The signal dynamics is assumed to be governed by a stochastic differential equation (SDE), and a hierarchy of time grids is introduced for multilevel numerical integration of that SDE. The resulting multilevel EnKF is proved to asymptotically outperform EnKF in terms of computational cost versus approximation accuracy. The theoretical results are illustrated numerically.

math.NA↗

Construction of a Mean Square Error Adaptive Euler--Maruyama Method with Applications in Multilevel Monte Carlo

A formal mean square error expansion (MSE) is derived for Euler--Maruyama numerical solutions of stochastic differential equations (SDE). The error expansion is used to construct a pathwise a posteriori adaptive time stepping Euler--Maruyama method for numerical solutions of SDE, and the resulting method is incorporated into a multilevel Monte Carlo (MLMC) method for weak approximations of SDE. This gives an efficient MSE adaptive MLMC method for handling a number of low-regularity approximation problems. In low-regularity numerical example problems, the developed adaptive MLMC method is shown to outperform the uniform time stepping MLMC method by orders of magnitude, producing output whose error with high probability is bounded by TOL>0 at the near-optimal MLMC cost rate O(TOL^{-2}log(TOL)^4).

math.NA↗

How accurate is molecular dynamics?

Born-Oppenheimer dynamics is shown to provide an accurate approximation of time-independent Schrödinger observables for a molecular system with an electron spectral gap, in the limit of large ratio of nuclei and electron masses, without assuming that the nuclei are localized to vanishing domains. The derivation, based on a Hamiltonian system interpretation of the Schrödinger equation and stability of the corresponding Hamilton-Jacobi equation, bypasses the usual separation of nuclei and electron wave functions, includes caustic states and gives a different perspective on the Born-Oppenheimer approximation, Schrödinger Hamiltonian systems and numerical simulation in molecular dynamics modeling at constant energy microcanonical ensembles.

math-ph↗