SearcharxivSearch

arXiv subjects

Kamran Arora

Publications and source records attributed to Kamran Arora.

2 recordsLinked to original sources

A discontinuous Galerkin approximation of the Dean--Kawasaki equation

We introduce and analyse an arbitrary order spatial discontinuous Galerkin (dG) method for the Dean--Kawasaki equation, a highly singular SPDE modelling density fluctuations of $N$ diffusing particles in the regime of large particle number $N \gg 1$. Our starting point is a general procedure for discretising multiplicative, divergence-form noise on finite element spaces whilst preserving its cross-variation structure at the discrete level; the construction is explicit, elementwise, applies to continuous and discontinuous spaces alike, and extends to general mobilities. Using it, we prove weak error estimates of order $O(h^p)$ between fluctuations of the semi-discrete scheme and those of the underlying particle system, together with a correction that is exponentially small in the scaling regime $Nh^d \gg 1$ and arises because the scheme does not preserve positivity. The resulting method is locally and globally conservative and applies on unstructured simplicial meshes. Quantitative numerical experiments support the analysis, and further experiments illustrate the method beyond the scope of the theory: indicator function observables, external and interaction potentials, convection-dominated regimes and reflecting boundary conditions.

math.NA

Reversible Deep Equilibrium Models

Deep Equilibrium Models (DEQs) are an interesting class of implicit model where the model output is implicitly defined as the fixed point of a learned function. These models have been shown to outperform explicit (fixed-depth) models in large-scale tasks by trading many deep layers for a single layer that is iterated many times. However, gradient calculation through DEQs is approximate. This often leads to unstable training dynamics and requires regularisation or many function evaluations to fix. Here, we introduce Reversible Deep Equilibrium Models (RevDEQs) that allow for exact gradient calculation, no regularisation and far fewer function evaluations than DEQs. We show that RevDEQs significantly improve performance on language modelling and image classification tasks against comparable implicit and explicit models.

cs.LG