SearcharxivSearch

arXiv subjects

Simon Eberle

Publications and source records attributed to Simon Eberle.

14 recordsLinked to original sources

ACF Almost Monotonicity at Infinity with Applications to Perturbed Global Solutions

We study the large-scale behavior of the coincidence set of perturbations of global solutions to the classical obstacle problem in $\mathbb{R}^n\setminus B_1$, with blow-down invariant in the $e_n$ direction. In dimensions $n\geq 3$, we prove that, locally around regular points sufficiently far out, the cross-sections of $\{u=0\}$ perpendicular to $e_n$ are $C^2$ perturbations of ellipsoids. The main ingredient is a new large-scale almost monotonicity formula for the Alt--Caffarelli--Friedman functional. In contrast with the classical small-scale perturbative theory, our argument exploits the stability of the obstacle problem together with the fact that local perturbations vanish under blow-down. The method provides a model mechanism for controlling errors at infinity in stable free boundary problems.

math.AP

Complete classification of global solutions to the obstacle problem

The characterization of global solutions to the obstacle problems in $\mathbb{R}^N$, or equivalently of null quadrature domains, has been studied over more than 90 years. In this paper we give a conclusive answer to this problem by proving the following long-standing conjecture: The coincidence set of a global solution to the obstacle problem is either a half-space, an ellipsoid, a paraboloid, or a cylinder with an ellipsoid or a paraboloid as base.

math.AP

Normalized gradient flow optimization in the training of ReLU artificial neural networks

The training of artificial neural networks (ANNs) is nowadays a highly relevant algorithmic procedure with many applications in science and industry. Roughly speaking, ANNs can be regarded as iterated compositions between affine linear functions and certain fixed nonlinear functions, which are usually multidimensional versions of a one-dimensional so-called activation function. The most popular choice of such a one-dimensional activation function is the rectified linear unit (ReLU) activation function which maps a real number to its positive part $ \mathbb{R} \ni x \mapsto \max\{ x, 0 \} \in \mathbb{R} $. In this article we propose and analyze a modified variant of the standard training procedure of such ReLU ANNs in the sense that we propose to restrict the negative gradient flow dynamics to a large submanifold of the ANN parameter space, which is a strict $ C^{ \infty } $-submanifold of the entire ANN parameter space that seems to enjoy better regularity properties than the entire ANN parameter space but which is also sufficiently large and sufficiently high dimensional so that it can represent all ANN realization functions that can be represented through the entire ANN parameter space. In the special situation of shallow ANNs with just one-dimensional ANN layers we also prove for every Lipschitz continuous target function that every gradient flow trajectory on this large submanifold of the ANN parameter space is globally bounded. For the standard gradient flow on the entire ANN parameter space with Lipschitz continuous target functions it remains an open problem of research to prove or disprove the global boundedness of gradient flow trajectories even in the situation of shallow ANNs with just one-dimensional ANN layers.

math.OC

The structure of the regular part of the free boundary close to singularities in the obstacle problem

We prove the -- to the best knowledge of the authors -- first result on the fine asymptotic behavior of the regular part of the free boundary of the obstacle problem close to singularities. The result is motivated by our recent partial answer to a long standing conjecture and the first partial classification of global solutions of the obstacle problem with unbounded coincidence sets in higher dimensions.

math.AP

Existence, uniqueness, and convergence rates for gradient flows in the training of artificial neural networks with ReLU activation

The training of artificial neural networks (ANNs) with rectified linear unit (ReLU) activation via gradient descent (GD) type optimization schemes is nowadays a common industrially relevant procedure. Till this day in the scientific literature there is in general no mathematical convergence analysis which explains the numerical success of GD type optimization schemes in the training of ANNs with ReLU activation. GD type optimization schemes can be regarded as temporal discretization methods for the gradient flow (GF) differential equations associated to the considered optimization problem and, in view of this, it seems to be a natural direction of research to first aim to develop a mathematical convergence theory for time-continuous GF differential equations and, thereafter, to aim to extend such a time-continuous convergence theory to implementable time-discrete GD type optimization methods. In this article we establish two basic results for GF differential equations in the training of fully-connected feedforward ANNs with one hidden layer and ReLU activation. In the first main result of this article we establish in the training of such ANNs under the assumption that the probability distribution of the input data of the considered supervised learning problem is absolutely continuous with a bounded density function that every GF differential equation admits for every initial value a solution which is also unique among a suitable class of solutions. In the second main result of this article we prove in the training of such ANNs under the assumption that the target function and the density function of the probability distribution of the input data are piecewise polynomial that every non-divergent GF trajectory converges with an appropriate rate of convergence to a critical point and that the risk of the non-divergent GF trajectory converges with rate 1 to the risk of the critical point.

cs.LG

Characterizing compact coincidence sets in the thin obstacle problem and the obstacle problem for the fractional Laplacian

In this paper we give a full classification of global solutions of the obstacle problem for the fractional Laplacian (including the thin obstacle problem) with compact coincidence set and at most polynomial growth in dimension $N \geq 3$. We do this in terms of a bijection onto a set of polynomials describing the asymptotics of the solution. Furthermore we prove that coincidence sets of global solutions that are compact are also convex if the solution has at most quadratic growth.

math.AP

Characterizing compact coincidence sets in the obstacle problem -- a short proof

Motivated by the almost completely open problem of characterizing unbounded coincidence sets of global solutions of the classical obstacle problem in higher dimensions, we give in this note a concise and easy-to-extend proof of the known fact that if the coincidence set $\{u=0 \}$ of a global solution $u$ is bounded with nonempty interior then it is an ellipsoid.

math.AP

On global solutions of the obstacle problem

Assuming a lower bound on the dimension, we prove a long standing conjecture concerning the classification of global solutions of the obstacle problem with unbounded coincidence sets.

math.AP

Front blocking in the presence of gradient drift

In this paper we derive quantitative conditions under which a compactly supported drift term blocks the propagation of a traveling wave in a straight cylinder in dimension $n \geq 3$ under the condition that the drift has a potential.

math.AP

A heteroclinic orbit connecting traveling waves pertaining to different nonlinearities

In this paper we consider a semilinear parabolic equation in an infinite cylinder. The spatially varying nonlinearity is such that it connects two (spatially independent) bistable nonlinearities in a compact set in space. We prove that, given such a setting, a traveling wave obeying the equation with the one bistable nonlinearity and starting at the respective side of the cylinder, will converge to a traveling wave solution prescribed by the nonlinearity on the other side.

math.AP

Gradient flow formulation and longtime behaviour of a constrained Fokker-Planck equation

We consider a Fokker-Planck equation which is coupled to an externally given time-dependent constraint on its first moment. This constraint introduces a Lagrange-multiplier which renders the equation nonlocal and nonlinear. In this paper we exploit an interpretation of this equation as a Wasserstein gradient flow of a free energy ${\mathcal{F}}$ on a time-constrained manifold. First, we prove existence of solutions by passing to the limit in an explicit Euler scheme obtained by minimizing $h {\mathcal{F}}(\varrho)+W_2^2(\varrho^0,\varrho)$ among all $\varrho$ satisfying the constraint for some $\varrho^0$ and time-step $h>0$. Second, we provide quantitative estimates for the rate of convergence to equilibrium when the constraint converges to a constant. The proof is based on the investigation of a suitable relative entropy with respect to minimizers of the free energy chosen according to the constraint. The rate of convergence can be explicitly expressed in terms of constants in suitable logarithmic Sobolev inequalities.

math.AP