SearcharxivSearch

arXiv subjects

Mark A. Peletier

Publications and source records attributed to Mark A. Peletier.

At least 19 recordsLinked to original sources

Why does entropy drive evolution equations?

`Entropy' appears as driving force in many different evolution equations, both deterministic and stochastic, and in these equations this `entropy' also takes different forms. We show how all these examples can be understood as different instances of a common principle: Entropy drives evolutions because it characterizes the invariant measure of an underlying stochastic process. This interpretation explains the appearance of entropy, the different forms that entropy takes in these equations, and how entropy `drives' these evolution equations. We illustrate this common structure with examples from stochastic processes, gradient flows, and GENERIC systems.

math.DS

Nonlinear diffusion limit of non-local interactions on a sphere

We study an aggregation PDE with competing attractive and repulsive forces on a sphere of arbitrary dimension. In particular, we consider the limit of strongly localized repulsion with a constant attraction term. We prove convergence of solutions of such a system to solutions of the aggregation-diffusion equation with a porous-medium-type diffusion term. The proof combines variational techniques with elements of harmonic analysis on a sphere. In particular, we characterize the square root of the convolution operator in terms of the spherical harmonics, which allows us to overcome difficulties arising due to the convolution on a sphere being non-commutative. The study is motivated by the toy model of transformers introduced by Geshkovski et al. (2025); and we discuss the applicability of the results to this model.

math.AP

A geometric formulation of GENERIC stochastic differential equations

We propose a coordinate-invariant geometric formulation of the GENERIC stochastic differential equation, unifying reversible Hamiltonian and irreversible dissipative dynamics within a differential-geometric framework. Our construction builds on the classical GENERIC or metriplectic formalism, extending it to manifolds by introducing a degenerate Poisson structure, a degenerate co-metric, and a volume form satisfying a unimodularity condition. The resulting equation preserves a particular Boltzmann-type measure, ensures almost-sure conservation of energy, and reduces to the deterministic GENERIC/metriplectic formulation in the zero-noise limit. This geometrization separates system-specific quantities from the ambient space, clarifies the roles of the underlying structures, and provides a foundation for analytic and numerical methods, as well as future extensions to quantum and coarse-grained systems.

math.DS

Deriving a GENERIC system from a Hamiltonian system

We reconsider the fundamental problem of coarse-graining infinite-dimensional Hamiltonian dynamics to obtain a macroscopic system which includes dissipative mechanisms. In particular, we study the thermodynamical implications concerning Hamiltonians, energy, and entropy and the induced geometric structures such as Poisson and Onsager brackets (symplectic and dissipative brackets). We start from a general finite-dimensional Hamiltonian system that is coupled linearly to an infinite-dimensional heat bath with linear dynamics. The latter is assumed to admit a compression to a finite-dimensional dissipative semigroup (i.e., the heat bath is a dilation of the semigroup) describing the dissipative evolution of new macroscopic variables. Already in the finite-energy case (zero-temperature heat bath) we obtain the so-called GENERIC structure (General Equations for Non-Equilibrium Reversible Irreversibe Coupling), with conserved energy, nondecreasing entropy, a new Poisson structure, and an Onsager operator describing the dissipation. However, their origin is not obvious at this stage. After extending the system in a natural way to the case of positive temperature, giving a heat bath with infinite energy, the compression property leads to an exact multivariate Ornstein-Uhlenbeck process that drives the rest of the system. Thus, we are able to identify a conserved energy, an entropy, and an Onsager operator (involving the Green-Kubo formalism) which indeed provide a GENERIC structure for the macroscopic system.

math-ph

Global existence and mean-field limit for a stochastic interacting particle system of signed Coulomb charges

We study a system of stochastic differential equations with singular drift which describes the dynamics of signed particles in two dimensions interacting by the Coulomb potential. In contrast to the well-studied cases of identical particles that either all repel each other or all attract each other, this system contains both `positive' and `negative' particles. Equal signs repel and opposite signs attract each other; apart from the sign, the potential is the same. We derive results on well-posedness of the system, on the type of collisions that can occur, and on the mean-field limit as the number of particles tends to infinity. Our results demonstrate that the signed system shares features of both the fully repulsive and the fully attractive cases. Our proof method is inspired by the work of Fournier and Jourdain (The Annals of Applied Probability, 27, pp. 2807-2861, 2017) on the fully attractive case; we construct an approximate system of equations, establish uniform estimates, and use tightness to pass to limits.

math.PR

Neural Langevin Dynamics: towards interpretable Neural Stochastic Differential Equations

Neural Stochastic Differential Equations (NSDE) have been trained as both Variational Autoencoders, and as GANs. However, the resulting Stochastic Differential Equations can be hard to interpret or analyse due to the generic nature of the drift and diffusion fields. By restricting our NSDE to be of the form of Langevin dynamics, and training it as a VAE, we obtain NSDEs that lend themselves to more elaborate analysis and to a wider range of visualisation techniques than a generic NSDE. More specifically, we obtain an energy landscape, the minima of which are in one-to-one correspondence with latent states underlying the used data. This not only allows us to detect states underlying the data dynamics in an unsupervised manner, but also to infer the distribution of time spent in each state according to the learned SDE. More in general, restricting an NSDE to Langevin dynamics enables the use of a large set of tools from computational molecular dynamics for the analysis of the obtained results.

cs.LG

Cosh gradient systems and tilting

We review a class of gradient systems with dissipation potentials of hyperbolic-cosine type. We show how such dissipation potentials emerge in large deviations of jump processes, multi-scale limits of diffusion processes, and more. We show how the exponential nature of the cosh derives from the exponential scaling of large deviations and arises implicitly in cell problems in multi-scale limits. We discuss in-depth the role of "tilting" of gradient systems. Certain classes of gradient systems are "tilt-independent", which means that changing the driving functional does not lead to changes of the dissipation potential. Such tilt-independence separates the driving functional from the dissipation potential, guarantees a clear modelling interpretation, and gives rise to strong notions of gradient-system convergence. We show that although in general many gradient systems are tilt-independent, certain cosh-type systems are not. We also show that this is inevitable, by studying in detail the classical example of the Kramers high-activation-energy limit, in which a diffusion converges to a jump process and the Wasserstein gradient system converges to a cosh-type system. We show and explain how the tilt-independence of the pre-limit system is lost in the limit system. This same lack of independence can be recognized in classical theories of chemical reaction rates in the chemical-engineering literature. We illustrate a similar lack of tilt-independence in a discrete setting. For a class of "two-terminal" fast subnetworks, we give a complete characterization of the dependence on the tilting, which strongly resembles the classical theory of equivalent electrical networks.

math.AP

Discrete-to-continuum convergence of charged particles in 1D with annihilation

We consider a system of charged particles moving on the real line driven by electrostatic interactions. Since we consider charges of both signs, collisions might occur in finite time. Upon collision, some of the colliding particles are effectively removed from the system (annihilation). The two applications we have in mind are vortices and dislocations in metals. In this paper we reach two goals. First, we develop a rigorous solution concept for the interacting particle system with annihilation. The main innovation here is to provide a careful management of the annihilation of groups of more than two particles, and we show that the definition is consistent by proving existence, uniqueness, and continuous dependence on initial data. The proof relies on a detailed analysis of ODE trajectories close to collision, and a reparametrization of vectors in terms of the moments of their elements. Secondly, we pass to the many-particle limit (discrete-to-continuum), and recover the expected limiting equation for the particle density. Due to the singular interactions and the annihilation rule, standard proof techniques of discrete-to-continuum limits do not apply. In particular, the framework of measures seems unfit. Instead, we use the one-dimensional feature that both the particle system and the limiting PDE can be characterized in terms of Hamilton--Jacobi equations. While our proof follows a standard limit procedure for such equations, the novelty with respect to existing results lies in allowing for stronger singularities in the particle system by exploiting the freedom of choice in the definition of viscosity solutions.

math.AP

Gamma-convergence of a gradient-flow structure to a non-gradient-flow structure

We study the asymptotic behaviour of a gradient system in a regime in which the driving energy becomes singular. For this system gradient-system convergence concepts are ineffective. We characterize the limiting behaviour in a different way, by proving $Γ$-convergence of the so-called energy-dissipation functional, which combines the gradient-system components of energy and dissipation in a single functional. The $Γ$-limit of these functionals again characterizes a variational evolution, but this limit functional is not the energy-dissipation functional of any gradient system. The system in question describes the diffusion of a particle in a one-dimensional double-well energy landscape, in the limit of small noise. The wells have different depth, and in the small-noise limit the process converges to a Markov process on a two-state system, in which jumps only happen from the higher to the lower well. This transmutation of a gradient system into a variational evolution of non-gradient type is a model for how many one-directional chemical reactions emerge as limit of reversible ones. The $Γ$-convergence proved in this paper both identifies the `fate' of the gradient system for these reactions and the variational structure of the limiting irreversible reactions.

math.AP

Large-deviation principles of switching Markov processes via Hamilton-Jacobi equations

We prove pathwise large-deviation principles of switching Markov processes by exploiting the connection to associated Hamilton-Jacobi equations, following Jin Feng's and Thomas Kurtz's method. In the limit that we consider, we show how the large-deviation problem in path-space reduces to a spectral problem of finding principal eigenvalues. The large-deviation rate functions are given in action-integral form. As an application, we demonstrate how macroscopic transport properties of stochastic models of molecular motors can be deduced from an associated principal-eigenvalue problem. The precise characterization of the macroscopic velocity in terms of principal eigenvalues implies that breaking of detailed balance is necessary for obtaining transport. In this way, we extend and unify existing results about molecular motors and place them in the framework of stochastic processes and large-deviation theory.

math.PR

EDP-convergence for nonlinear fast-slow reaction systems with detailed balance

We consider nonlinear reaction systems satisfying mass-action kinetics with slow and fast reactions. It is known that the fast-reaction-rate limit can be described by an ODE with Lagrange multipliers and a set of nonlinear constraints that ask the fast reactions to be in equilibrium. Our aim is to study the limiting gradient structure which is available if the reaction system satisfies the detailed-balance condition. The gradient structure on the set of concentration vectors is given in terms of the relative Boltzmann entropy and a cosh-type dissipation potential. We show that a limiting or effective gradient structure can be rigorously derived via EDP convergence, i.e. convergence in the sense of the Energy-Dissipation Principle for gradient flows. In general, the effective entropy will no longer be of Boltzmann type and the reactions will no longer satisfy mass-action kinetics.

math.AP

Universal Approximation in Dropout Neural Networks

We prove two universal approximation theorems for a range of dropout neural networks. These are feed-forward neural networks in which each edge is given a random $\{0,1\}$-valued filter, that have two modes of operation: in the first each edge output is multiplied by its random filter, resulting in a random output, while in the second each edge output is multiplied by the expectation of its filter, leading to a deterministic output. It is common to use the random mode during training and the deterministic mode during testing and prediction. Both theorems are of the following form: Given a function to approximate and a threshold $\varepsilon>0$, there exists a dropout network that is $\varepsilon$-close in probability and in $L^q$. The first theorem applies to dropout networks in the random mode. It assumes little on the activation function, applies to a wide class of networks, and can even be applied to approximation schemes other than neural networks. The core is an algebraic property that shows that deterministic networks can be exactly matched in expectation by random networks. The second theorem makes stronger assumptions and gives a stronger result. Given a function to approximate, it provides existence of a network that approximates in both modes simultaneously. Proof components are a recursive replacement of edges by independent copies, and a special first-layer replacement that couples the resulting larger network to the input. The functions to be approximated are assumed to be elements of general normed spaces, and the approximations are measured in the corresponding norms. The networks are constructed explicitly. Because of the different methods of proof, the two results give independent insight into the approximation properties of random dropout networks. With this, we establish that dropout neural networks broadly satisfy a universal-approximation property.

cs.LG

Fast reaction limits via $Γ$-convergence of the Flux Rate Functional

We study the convergence of a sequence of evolution equations for measures supported on the nodes of a graph. The evolution equations themselves can be interpreted as the forward Kolmogorov equations of Markov jump processes, or equivalently as the equations for the concentrations in a network of linear reactions. The jump rates or reaction rates are divided in two classes; `slow' rates are constant, and `fast' rates are scaled as~$1/ε$, and we prove the convergence in the fast-reaction limit $ε\to0$. We establish a $Γ$-convergence result for the rate functional in terms of both the concentration at each node and the flux over each edge (the level-2.5 rate function). The limiting system is again described by a functional, and characterizes both fast and slow fluxes in the system. This method of proof has three advantages. First, no condition of detailed balance is required. Secondly, the formulation in terms of concentration and flux leads to a short and simple proof of the $Γ$-convergence; the price to pay is a more involved compactness proof. Finally, the method of proof deals with approximate solutions, for which the functional is not zero but small, without any changes.

math.CA

Exploring families of energy-dissipation landscapes via tilting -- three types of EDP convergence

We introduce two new concepts of convergence of gradient systems $(\mathbf Q, \mathcal E_\varepsilon,\mathcal R_\varepsilon)$ to a limiting gradient system $(\mathbf Q, \mathcal E_0,\mathcal R_0)$. These new concepts are called `EDP convergence with tilting' and `contact--EDP convergence with tilting'. Both are based on the Energy-Dissipation-Principle (EDP) formulation of solutions of gradient systems, and can be seen as refinements of the Gamma-convergence for gradient flows first introduced by Sandier and Serfaty. The two new concepts are constructed in order to avoid the `unnatural' limiting gradient structures that sometimes arise as limits in EDP-convergence. EDP-convergence with tilting is a strengthening of EDP-convergence by requiring EDP-convergence for a full family of `tilted' copies of $(\mathbf Q, \mathcal E_\varepsilon,\mathcal R_\varepsilon)$. It avoids unnatural limiting gradient structures, but many interesting systems are non-convergent according to this concept. Contact--EDP convergence with tilting is a relaxation of EDP convergence with tilting, and still avoids unnatural limits but applies to a broader class of sequences $(\mathbf Q, \mathcal E_\varepsilon,\mathcal R_\varepsilon)$. In this paper we define these concepts, study their properties, and connect them with classical EDP convergence. We illustrate the different concepts on a number of test problems.

math.FA

Atomistic origins of continuum dislocation dynamics

This paper focuses on the connections between four stochastic and deterministic models for the motion of straight screw dislocations. Starting from a description of screw dislocation motion as interacting random walks on a lattice, we prove explicit estimates of the distance between solutions of this model, an SDE system for the dislocation positions, and two deterministic mean-field models describing the dislocation density. The proof of these estimates uses a collection of various techniques in analysis and probability theory, including a novel approach to establish propagation-of-chaos on a spatially discrete model. The estimates are non-asymptotic and explicit in terms of four parameters: the lattice spacing, the number of dislocations, the dislocation core size, and the temperature. This work is a first step in exploring this parameter space with the ultimate aim to connect and quantify the relationships between the many different dislocation models present in the literature.

math.AP

Jump processes as Generalized Gradient Flows

We have created a functional framework for a class of non-metric gradient systems. The state space is a space of nonnegative measures, and the class of systems includes the Forward Kolmogorov equations for the laws of Markov jump processes on Polish spaces. This framework comprises a definition of a notion of solutions, a method to prove existence, and an archetype uniqueness result. We do this by using only the structure that is provided directly by the dissipation functional, which need not be homogeneous, and we do not appeal to any metric structure.

math.AP

A framework of nonequilibrium statistical mechanics. I. Role and type of fluctuations

Understanding the fluctuations by which phenomenological evolution equations with thermodynamic structure can be enhanced is the key to a general framework of nonequilibrium statistical mechanics. These fluctuations provide an idealized representation of microscopic details. We consider fluctuation-enhanced equations associated with Markov processes and elaborate the general recipes for evaluating dynamic material properties, which characterize force-flux constitutive laws, by statistical mechanics. Markov processes with continuous trajectories are conveniently characterized by stochastic differential equations and lead to Green-Kubo-type formulas for dynamic material properties. Markov processes with discontinuous jumps include transitions over energy barriers with the rates calculated by Kramers. We describe a unified approach to Markovian fluctuations and demonstrate how the appropriate type of fluctuations (continuous versus discontinuous) is reflected in the mathematical structure of the phenomenological equations.

cond-mat.stat-mech

A framework of nonequilibrium statistical mechanics. II. Coarse-graining

For a given thermodynamic system, and a given choice of coarse-grained state variables, the knowledge of a force-flux constitutive law is the basis for any nonequilibrium modeling. In the first paper of this series we established how, by a generalization of the classical fluctuation-dissipation theorem (FDT), the structure of a constitutive law is directly related to the distribution of the fluctuations of the state variables. When these fluctuations can be expressed in terms of diffusion processes, one may use Green-Kubo-type coarse-graining schemes to find the constitutive laws. In this paper we propose a coarse-graining method that is valid when the fluctuations are described by means of general Markov processes, which include diffusions as a special case. We prove the success of the method by numerically computing the constitutive law for a simple chemical reaction $A \rightleftarrows B$. Furthermore, we show that one cannot find a consistent constitutive law by any Green-Kubo-like scheme.

cond-mat.stat-mech