Searcharxiv⌕ Search

arXiv subjects

Antonin Chodron de Courcel

Publications and source records attributed to Antonin Chodron de Courcel.

7 recordsLinked to original sources

Mean--Fluctuation Dynamics at the Edge of Stability

We study the dynamics of gradient descent in the Edge of Stability regime, where the learning rate is large enough to induce persistent oscillations in the trajectory, which has been linked to better generalization performance. We introduce the mean--fluctuation dynamics, a tractable continuous-time model coupling the window-averaged trajectory to its fluctuation covariance. Among our contributions, we rigorously derive this model from gradient descent in a sharp-valley framework, characterize its stationary states and their linear stability, and establish precise connections with other effective dynamics. Numerical experiments illustrate these predictions and their finite-time limitations. We also study our model in the overparametrized regime of wide two-layer networks at a fixed learning rate, where we rigorously derive a kinetic equation describing weights and their fluctuations as a Wasserstein-2 gradient flow, for which we prove well-posedness, a mean-field limit, and conditional convergence results.

math.OC↗

Wasserstein gradient flows for Coulomb discrepancies

We study the long-time behavior of the Wasserstein gradient flow of the squared Maximum Mean Discrepancy (MMD) between a probability measure $ρ$ and a target measure $μ$, where the underlying kernel is given by a Coulomb potential. For $L^\infty$ target densities $μ$, we establish the existence of global weak solutions starting from arbitrary Borel probability measures and prove that the density $ρ_t$ belongs to $L^\infty$ for any $t>0$. We also show that the Hölder norm can grow exponentially in time. On the flat torus ${\mathbb{T}}^\mathsf{d}$, we prove a global metric PL inequality for every finite-Coulomb-energy source and nearly uniform target. For general bounded, uniformly positive targets, we prove exponential decay of the squared MMD without requiring a lower bound on the initial data, using a defective PL inequality. We also prove that the usual PL inequality may fail when the target vanishes only at one point and that, when $\mathsf{d}\ge2$, no PL constant can hold uniformly over all targets satisfying a prescribed lower bound. On ${\mathbb{R}}^\mathsf{d}$, for $\mathsf{d}\ge2$, under radial symmetry, source-support inclusion, and target-positivity assumptions, we establish a PL inequality and exponential convergence. On the unrestricted whole-space class, neither a multiplicative squared-MMD decay modulus uniform over the initial datum nor a global PL inequality can hold. Finally, in every dimension and in both spatial settings, we prove that every Lagrangian critical point coincides with the target when $(ρ-μ)^+$ is absolutely continuous. In dimension two, the energy supplies uniform tightness. This implies that if our constructed solutions have finite energy at some positive time, then they converge to the target narrowly and strongly in negative-order Sobolev spaces.

math.AP↗

Well-posedness of multidimensional nonlocal conservation laws with nonlinear mobility and bounded force

We establish local-in-time existence and uniqueness results for nonlocal conservation laws with a nonlinear mobility, in several space dimensions, under weak assumptions on the kernel, which is assumed to be bounded and of finite total variation. Contrary to the linear mobility case, solutions may develop shocks in finite time, even when the kernel is smooth. We construct entropy solutions via a vanishing viscosity method, and provide a rate of convergence for this approximation scheme.

math.AP↗

On clogged and fast diffusions in porous media with fractional pressure

We study the existence and infinite-speed propagation of solutions to models arising in porous media, when the mobility is highly degenerate (inverse power law). The approach is based on maximum principles for the fractional Laplacian, and allows to derive lower bounds on solutions in a straightforward manner. Finally, in the case of clogged porous media, where the mobility vanishes at points of unbounded density, solutions that become instantaneously bounded are constructed.

math.AP↗

On a repulsion model with Coulomb interaction and nonlinear mobility

We study a scalar conservation law on the torus in which the flux $\mathbf{j}$ is composed of a Coulomb interaction and a nonlinear mobility: $\mathbf{j} = -u^m\nabla\mathsf{g}\ast u$. We prove existence of entropy solutions and a weak-strong uniqueness principle. We also prove several properties shared among entropy solutions, in particular a lower barrier in the fast diffusion regime $m\lt 1$. In the porous media regime $m\ge 1$, we study the decreasing rearrangement of solutions, which allows to prove an instantaneous growth of the support and a waiting time phenomenon. We also show exponential convergence of the solutions towards the spatial average in several topologies.

math.AP↗

The attractive log gas: stability, uniqueness, and propagation of chaos

We consider overdamped Langevin dynamics for the attractive log gas on the torus $\mathbb{T}^\mathsf{d}$, for $\mathsf{d}\geq 1$. In dimension $\mathsf{d}=2$, this model coincides with a periodic version of the parabolic-elliptic Patlak-Keller-Segel model of chemotaxis. The attractive log gas (for our choice of units) is well-known to have a critical inverse temperature $β_{\mathrm{c}}={2\mathsf{d}}$ corresponding to when the free energy is bounded from below. Moreover, it is well-known that the uniform distribution is always a stationary state regardless of the temperature. We identify another temperature threshold $β_{\mathrm{s}}$ sharply corresponding to the nonlinear stability of the uniform distribution. We show that for $β>β_{\mathrm{s}}$, the uniform distribution does not minimize the free energy and moreover is nonlinearly unstable, while for $β<β_{\mathrm{s}}$, it is stable. We also show that there exists $β_{\mathrm{u}}$ for which uniqueness of equilibria holds for $β<β_{\mathrm{u}}$. We establish a uniform-in-time rate for entropic propagation of chaos for a range of $β<β_{\mathrm{s}}$. To our knowledge, this is the first such result for singular attractive interactions and affirmatively answers a question of Bresch et al. arXiv:2011.08022. The proof of the convergence is through the modulated free energy method, relying on a modulated logarithmic Hardy-Littlewood-Sobolev (mLHLS) inequality. Unlike Bresch et al., we show that such an inequality holds without truncation of the potential -- the avoidance of the truncation being essential to a uniform-in-time result -- for sufficiently small $β$ and provide a counterexample to the mLHLS inequality when $β>β_{\mathrm{s}}$. As a byproduct, we show that it is impossible to have a uniform-in-time rate of propagation of chaos if $β>β_{\mathrm{s}}$.

math.AP↗

Sharp uniform-in-time mean-field convergence for singular periodic Riesz flows

We consider conservative and gradient flows for $N$-particle Riesz energies with mean-field scaling on the torus $\mathbb{T}^d$, for $d\geq 1$, and with thermal noise of McKean-Vlasov type. We prove global well-posedness and relaxation to equilibrium rates for the limiting PDE. Combining these relaxation rates with the modulated free energy of Bresch et al. and recent sharp functional inequalities of the last two named authors for variations of Riesz modulated energies along a transport, we prove uniform-in-time mean-field convergence in the gradient case with a rate which is sharp for the modulated energy pseudo-distance. For gradient dynamics, this completes in the periodic case the range $d-2\leq s<d$ not addressed by previous work of the second two authors. We also combine our relaxation estimates with the relative entropy approach of Jabin and Wang for so-called $\dot{W}^{-1,\infty}$ kernels, giving a proof of uniform-in-time propagation of chaos alternative to Guillin et al.

math.AP↗