SearcharxivSearch

arXiv subjects

Gabriel Stoltz

Publications and source records attributed to Gabriel Stoltz.

At least 19 recordsLinked to original sources

The narrow escape problem in arbitrary dimension

The narrow escape problem is a prototypical example for studying entropic metastability, motivated by the analysis of biological and chemical systems. The problem concerns the determination of the exit time and position of a Brownian particle trapped in a domain with a reflecting boundary pierced by narrow holes. Our goal is to investigate this problem in a general domain in any dimension (greater than or equal to two), using the quasi-stationary distribution approach to metastability. In particular, we derive the asymptotic expansion of the mean exit time and the law of the exit position in the limit where the hole sizes tend to zero. Our analytical predictions are illustrated by numerical simulations, using dedicated Monte Carlo techniques.

math.AP

Approximating committor functions: Objective functions and training data sampling

Many molecular dynamics simulations aim at studying transitions between two states (from reactants to products). In this context, the committor function (which gives for a given molecular configuration the probability to reach the product state before the reactant state) is a pivotal quantity, in particular because it is the optimal importance function for rare event simulation methods such as importance sampling or splitting techniques. These methods are used to sample the reactive path ensemble, and estimate for example the transition rate. However, learning such a function is generally a challenging task due to the high dimensionality of the configuration space. In this work, after reviewing the existing methodologies to construct approximate committor functions, a new loss function based on the application of It\={o}'s formula is proposed to learn the committor function with a minimization procedure on the parameters of a neural network. After comparing this novel approach to existing procedures on the M\"uller--Brown potential, we introduce a coupling strategy with the Adaptive Multilevel Splitting method to better approximate the committor function using a better sampling of the reactive trajectories. This methodology in which the committor function is iteratively learned only requires initially the knowledge of the reactant and product states.

physics.chem-ph

On the diffusive-mean field limit of a kinetic weakly interacting particle system

We study the joint diffusive-mean field limit for a system of weakly interacting kinetic Langevin dynamics, extending the results of Delgadino, Gvalani and Pavliotis (Arch. Ration. Mech. Anal., 2021) to the hypoelliptic/hypocoercive case. We show that, in the absence of phase transitions, the two limits commute, and we calculate the covariance matrix of the limiting Brownian motion using the Green-Kubo/Kipnis-Varadhan formula. However, at low temperatures, and in the presence of phase transitions, the two limits may not commute. We demonstrate our findings by providing a detailed analysis of the diffusive-mean field limit for the $O(2)$ model in a magnetic field. Our analysis is based on the systematic use of recently developed hypocoercivity techniques, together with an appropriate linearization of the mean field McKean-Vlasov-Fokker-Planck partial differential equation.

math.AP

Mathematical analysis and numerical methods for the computation of transport coefficients in molecular dynamics

We review various numerical approaches to compute transport coefficients in molecular dynamics. These approaches can be broadly classified into three groups: (i) nonequilibrium methods based on applying an external driving field to the system, measuring the average response in the system, and evaluating the related linear response coefficient; (ii) approaches reformulating the transport coefficient of interest through a time correlation function for the equilibrium dynamics (the most popular instances being Green--Kubo and Einstein formulas); (iii) transient techniques, where the transport coefficient can be computed by monitoring the return to the steady state of a dynamics perturbed off its stationary distribution. For all three classes of methods, we provide elements of numerical analysis, allowing to estimate or at least quantify the level of numerical errors in the estimator of the transport coefficient; and also briefly present recent attempts to more efficiently compute transport coefficients with variance reduction approaches such as control variates, importance sampling and coupling methods. The computation of transport coefficients remains nonetheless challenging and will continue requiring research efforts in the foreseeable future.

math.NA

Adaptive Momentum and Nonlinear Damping for Neural Network Training

Momentum Stochastic Gradient Descent (mSGD) relies on a fixed momentum coefficient shared across all parameters, failing to account for the heterogeneous structure of modern loss landscapes. In this work, we adopt a continuous-time formulation to introduce individual, adaptive momentum coefficients regulated by the kinetic energy of each model parameter. This mechanism automatically adjusts to evolving training dynamics to maintain stability without sacrificing convergence speed. We demonstrate that this adaptive friction is inextricably linked to cubic damping, a suppression mechanism from structural dynamics. We additionally introduce two optimization schemes by augmenting the continuous dynamics of mSGD and Adam with a cubic damping term. Empirically, our methods demonstrate robustness and match or outperform Adam on training ViT, BERT, and GPT2 tasks where mSGD typically struggles. We further provide theoretical results establishing the exponential convergence of the proposed schemes.

cs.LG

Generative modeling of conditional probability distributions on the level-sets of collective variables

Given a probability distribution $\mu$ in $\mathbb{R}^d$ represented by data, we study in this paper the generative modeling of the corresponding conditional probability distributions on the level-sets of a collective variable $\xi:\mathbb{R}^d \rightarrow \mathbb{R}^k$, where $1 \le k<d$. We propose a general and efficient learning approach that can learn generative models on different level-sets of $\xi$ simultaneously. To improve the learning quality on level-sets in low-probability regions, we also propose a data enrichment strategy by utilizing data from enhanced sampling techniques. We demonstrate the effectiveness of our proposed learning approach through concrete numerical examples. The proposed approach is potentially useful for the generative modeling of molecular systems in biophysics.

stat.ML

Efficient Monte Carlo sampling of metastable systems using non-local collective variable updates

Monte Carlo simulations are widely used to simulate complex molecular systems, but standard approaches suffer from metastability. Lately, the use of non-local proposal updates in a collective-variable (CV) space has been proposed in several works. Here, we generalize these approaches and explicitly spell out an algorithm for non-linear CVs and underdamped Langevin dynamics. We prove reversibility of the resulting scheme and demonstrate its performance on several numerical examples, observing a substantial performance increase compared to methods based on overdamped Langevin dynamics as considered previously. Advances in generative machine-learning-based proposal samplers now enable efficient sampling in CV spaces of intermediate dimensionality (tens to hundreds of variables), and our results extend their applicability toward more realistic molecular systems.

cond-mat.stat-mech

Shape optimization of metastable states

The definition of metastable states is an ubiquitous task in the design and analysis of molecular simulations, and is a crucial input in a variety of acceleration methods for the sampling of long configurational trajectories. Although standard definitions based on local energy minimization procedures can sometimes be used, these definitions are typically suboptimal, or entirely inadequate when entropic effects are significant, or when the lowest energy barriers are quickly overcome by thermal fluctuations. In this work, we propose an approach to the definition of metastable states, based on the shape-optimization of a local separation of timescale metric directly linked to the efficiency of a family of accelerated molecular dynamics algorithms. To realize this approach, we derive analytic expressions for shape-variations of Dirichlet eigenvalues for a class of operators associated with reversible elliptic diffusions, and use them to construct a local ascent algorithm, explicitly treating the case of multiple eigenvalues. We propose two methods to make our method tractable in high-dimensional systems: one based on dynamical coarse-graining, the other on recently obtained low-temperature shape-sensitive spectral asymptotics. We validate our method on a benchmark biomolecular system, showcasing a significant improvement over conventional definitions of metastable states.

physics.comp-ph

Periodically forced pinned anharmonic atom chains

Recent works proved a hydrodynamic limit for periodically forced atom chains with harmonic interaction and pinning, together with momentum flip. When energy is the only conserved quantity, one would expect similar results in the anharmonic case, as conjectured for the temperature profile and energy flux in arXiv:2212.00093. However, outside the harmonic case, explicit computations are generally no longer possible, thus making a rigorous proof of this hydrodynamic limit difficult. Consequently, we numerically investigate the plausibility of this limit for the particular case of a chain with $\beta$-FPUT interactions and harmonic pinning. We present our simulation results suggesting that the conjectured PDE for the limiting temperature profile and Green--Kubo type formula for the limiting energy current conjectured in arXiv:2212.00093 are correct. We then use this Green--Kubo type formula to investigate the relationship between the energy current and period of the forcing. This relationship is investigated in the case of significant rate of momentum flip, small rate of momentum flip and no momentum flip. We compare the relationship observed in the anharmonic case to that of the harmonic case for which explicit formulae are available.

cond-mat.stat-mech

Dynamical reweighting for estimation of fluctuation formulas

We propose a variance reduction method for calculating transport coefficients in molecular dynamics using an importance sampling method via Girsanov's theorem applied to Green--Kubo's formula. We optimize the magnitude of the perturbation applied to the reference dynamics by means of a scalar parameter~$\alpha$ and propose an asymptotic analysis to fully characterize the long-time behavior in order to evaluate the possible variance reduction. Theoretical results corroborated by numerical results show that this method allows for some reduction in variance, although rather modest in most situations.

math.NA

Quantitative low-temperature spectral asymptotics for reversible diffusions in temperature-dependent domains

We derive novel low-temperature asymptotics for the spectrum of the infinitesimal generator of the overdamped Langevin dynamics. The novelty is that this operator is endowed with homogeneous Dirichlet conditions at the boundary of a domain which depends on the temperature. From the point of view of stochastic processes, this gives information on the long-time behavior of the diffusion conditioned on non-absorption at the boundary, in the so-called quasistationary regime. Our results provide precise estimates of the spectral gap and principal eigenvalue, extending the Eyring-Kramers formula. The phenomenology is richer than in the case of a fixed boundary and gives new insight into the sensitivity of the spectrum with respect to the shape of the domain near critical points of the energy function. Our work is motivated by--and is relevant to--the problem of finding optimal hyperparameters for accelerated molecular dynamics algorithms.

math.AP

Machine learning assisted canonical sampling (MLACS)

The acceleration of material property calculations while maintaining ab initio accuracy (1 meV/atom) is one of the major challenges in computational physics. In this paper, we introduce a Python package enhancing the computation of (finite temperature) material properties at the ab initio level using machine learning interatomic potentials (MLIP). The Machine-Learning Assisted Canonical Sampling (MLACS) method, grounded in a self-consistent variational approach, iteratively trains a MLIP using an active learning strategy in order to significantly reduce the computational cost of ab initio simulations. MLACS offers a modular and user-friendly interface that seamlessly integrates Density Functional Theory (DFT) codes, MLIP potentials, and molecular dynamics packages, enabling a wide range of applications, while maintaining a near-DFT accuracy. These include sampling the canonical ensemble of a system, performing free energy calculations, transition path sampling, and geometry optimization, all by utilizing surrogate MLIP potentials, in place of ab initio calculations. This paper provides a comprehensive overview of the theoretical foundations and implementation of the MLACS method. We also demonstrate its accuracy and efficiency through various examples, showcasing the capabilities of the MLACS package.

cond-mat.mtrl-sci

Improving sampling by modifying the effective diffusion

Markov chain Monte Carlo samplers based on discretizations of (overdamped) Langevin dynamics are commonly used in the Bayesian inference and computational statistical physics literature to estimate high-dimensional integrals. One can introduce a non-constant diffusion matrix to precondition these dynamics, and recent works have optimized it in order to improve the rate of convergence to stationarity by overcoming entropic and energy barriers. However, the introduced methodologies to compute these optimal diffusions are generally not suited to high-dimensional settings, as they rely on costly optimization procedures. In this work, we propose to optimize over a class of diffusion matrices, based on one-dimensional collective variables (CVs), to help the dynamics explore the latent space defined by the CV. The form of the diffusion matrix is chosen in order to obtain an efficient effective diffusion in the latent space. We describe how this class of diffusion matrices can be constructed and learned during the simulation. We provide implementations of the Metropolis--Adjusted Langevin Algorithm and Riemann Manifold (Generalized) Hamiltonian Monte Carlo algorithms, and discuss numerical optimizations in the case when the CV depends only on a few degrees of freedom of the system. We illustrate the efficiency gains by computing mean transition durations between two metastable states of a dimer in a solvent.

math.NA

Transient subtraction: A control variate method for computing transport coefficients

In molecular dynamics, transport coefficients measure the sensitivity of the invariant probability measure of the stochastic dynamics at hand with respect to some perturbation. They are typically computed using either the linear response of nonequilibrium dynamics, or the Green--Kubo formula. The estimators for both approaches have large variances, which motivates the study of variance reduction techniques for computing transport coefficients. We present an alternative approach, called the \emph{transient subtraction technique} (inspired by early work by Ciccotti and Jaccucci in 1975), which amounts to simulating a transient dynamics started off equilibrium and relaxing towards the equilibrium state, from which we subtract a sensibly coupled equilibrium trajectory, resulting in an estimator with smaller variance. We present the mathematical formulation of the transient subtraction technique, give error estimates on the bias and variance of the associated estimator, and demonstrate the relevance of the method through numerical illustrations for various systems.

math.NA

Neural network approaches for variance reduction in fluctuation formulas

We propose a method utilizing physics-informed neural networks (PINNs) to solve Poisson equations that serve as control variates in the computation of transport coefficients via fluctuation formulas, such as the Green--Kubo and generalized Einstein-like formulas. By leveraging approximate solutions to the Poisson equation constructed through neural networks, our approach significantly reduces the variance of the estimator at hand. We provide an extensive numerical analysis of the estimators and detail a methodology for training neural networks to solve these Poisson equations. The approximate solutions are then incorporated into Monte Carlo simulations as effective control variates, demonstrating the suitability of the method for moderately high-dimensional problems where fully deterministic solutions are computationally infeasible.

math.NA

Sticky coupling as a control variate for sensitivity analysis

We present and analyze a control variate strategy based on couplings to reduce the variance of finite difference estimators of sensitivity coefficients, called transport coefficients in the physics literature. We study the bias and variance of a sticky-coupling and a synchronous-coupling based estimator as the finite difference parameter $\eta$ goes to zero. For diffusions with elliptic additive noise, we show that when the drift is contractive outside a compact the bias of a sticky-coupling based estimator is bounded as $\eta \to 0$ and its variance behaves like $\eta^{-1}$, compared to the standard estimator whose bias and variance behave like $\eta^{-1}$ and $\eta^{-2}$, respectively. Under the stronger assumption that the drift is contractive everywhere, we additionally show that the bias and variance of the synchronous-coupling based estimator are both bounded as $\eta \to 0$. Our hypotheses include overdamped Langevin dynamics with many physically relevant non-convex potentials. We illustrate our theoretical results with numerical examples, including overdamped Langevin dynamics with a highly non-convex Lennard-Jones potential to demonstrate both failure of synchronous coupling and the effectiveness of sticky coupling in the not globally contractive setting.

math.PR

Explicit convergence rates of underdamped Langevin dynamics under weighted and weak Poincar\'e--Lions inequalities

We study the long-time behavior of the underdamped Langevin dynamics, in the case of so-called \emph{weak confinement}. Indeed, any $\mathrm{L}^\infty$ distribution (in position and velocity) relaxes to equilibrium over time, and we quantify the convergence rate. In our situation, the spatial equilibrium distribution does not satisfy a Poincar\'e inequality. Instead, we assume a weighted Poincar\'e inequality, which allows for fat-tail or sub-exponential potential energies. We provide constructive and fully explicit estimates in $\mathrm{L}^2$-norm for $\mathrm{L}^\infty$ initial data. A key-ingredient is a new space-time weighted Poincar\'e--Lions inequality, entailing, in turn, a weak Poincar\'e--Lions inequality.

math.PR

Sampling metastable systems using collective variables and Jarzynski-Crooks paths

We consider the problem of sampling a high dimensional multimodal target probability measure. We assume that a good proposal kernel to move only a subset of the degrees of freedoms (also known as collective variables) is known a priori. This proposal kernel can for example be built using normalizing flows. We show how to extend the move from the collective variable space to the full space and how to implement an accept-reject step in order to get a reversible chain with respect to a target probability measure. The accept-reject step does not require to know the marginal of the original measure in the collective variable (namely to know the free energy). The obtained algorithm admits several variants, some of them being very close to methods which have been proposed previously in the literature. We show how the obtained acceptance ratio can be expressed in terms of the work which appears in the Jarzynski-Crooks equality, at least for some variants. Numerical illustrations demonstrate the efficiency of the approach on various simple test cases, and allow us to compare the variants of the algorithm.

cond-mat.stat-mech