SearcharxivSearch

arXiv subjects

Julien Reygner

Publications and source records attributed to Julien Reygner.

At least 19 recordsLinked to original sources

A tree-based Polynomial Chaos expansion for surrogate modeling and sensitivity analysis of complex numerical models

This paper introduces Tree-based Polynomial Chaos Expansion (Tree-PCE), a novel surrogate modeling technique designed to efficiently approximate complex numerical models exhibiting nonlinearities and discontinuities. Tree-PCE combines the expressive power of Polynomial Chaos Expansion (PCE) with an adaptive partitioning strategy inspired by regression trees. By recursively dividing the input space into hyperrectangular subdomains and fitting localized PCEs, Tree-PCE constructs a piecewise polynomial surrogate that improves both accuracy and computational efficiency. The method is particularly well-suited for global sensitivity analysis, enabling direct computation of Sobol' indices from local expansion coefficients and introducing a new class of sensitivity indices derived from the tree structure itself. Numerical experiments on synthetic and real-world models, including a 2D morphodynamic case, demonstrate that Tree-PCE offers a favorable balance between accuracy and complexity, especially in the presence of discontinuities. While its performance depends on the compromise between the number of subdomains and the degree of local polynomials, this trade-off can be explored using automated hyperparameter optimization frameworks. This opens promising perspectives for systematically identifying optimal configurations and enhancing the robustness of surrogate modeling in complex systems.

stat.ME

Gibbs principle with infinitely many constraints: optimality conditions and stability

We extend the Gibbs conditioning principle to an abstract setting combining infinitely many linear equality constraints and non-linear inequality constraints, which need not be convex. A conditional large large deviation principle (LDP) is proved in a Wassersteintype topology, and optimality conditions are written in this abstract setting. This setting encompasses versions of the Schr{\"o}dinger bridge problem with marginal non-linear inequality constraints at every time. In the case of convex constraints, stability results for perturbations both in the constraints and the reference measure are proved. We then specify our results when the reference measure is the path-law of a continuous diffusion process, whose law is constrained at each time. We obtain a complete description of the constrained process through an atypical mean-field PDE system involving a Lagrange multiplier.

math.FA

Quasi-stationary distribution for kinetic SDEs with low regularity coefficients

We consider kinetic SDEs with low regularity coefficients in the setting recently introduced in [6]. For the solutions to such equations, we first prove a Harnack inequality. Using the abstract approach of [5], this inequality then allows us to prove, under a Lyapunov condition, the existence and uniqueness (in a suitable class of measures) of a quasi-stationary distribution in cylindrical domains of the phase space. We finally exhibit two settings in which the Lyapunov condition holds: general kinetic SDEs in domains which are bounded in position, and Langevin processes with a non-conservative force and a suitable growth condition on the force.

math.PR

Condensation in Fleming--Viot particle systems with fast selection mechanism

We study the Fleming--Viot particle system in a discrete state space, in the regime of a fast selection mechanism, namely with killing rates which grow to infinity. This asymptotics creates a time scale separation which results in the formation of a condensate of all particles, which then evolves according to a continuous-time Markov chain with jump rates depending in a nontrivial way on both the underlying mutation dynamics and the relative speed of growth to infinity of the killing rate between neighbouring sites. We prove the convergence of the particle system and completely describe the dynamics of the condensate in the case where the number of particles is kept fixed, and partially in the case when the number of particles goes to infinity together with (but slower than) the minimal killing rate.

math.PR

Local convergence rates for Wasserstein gradient flows and McKean-Vlasov equations with multiple stationary solutions

Non-linear versions of log-Sobolev inequalities, that link a free energy to its dissipation along the corresponding Wasserstein gradient flow (i.e. corresponds to Polyak-Lojasiewicz inequalities in this context), are known to provide global exponential long-time convergence to the free energy minimizers, and have been shown to hold in various contexts. However they cannot hold when the free energy admits critical points which are not global minimizers, which is for instance the case of the granular media equation in a double-well potential with quadratic attractive interaction at low temperature. This work addresses such cases, extending the general arguments when a log-Sobolev inequality only holds locally and, as an example, establishing such local inequalities for the granular media equation with quadratic interaction either in the one-dimensional symmetric double-well case or in higher dimension in the low temperature regime. The method provides quantitative convergence rates for initial conditions in a Wasserstein ball around the stationary solutions. The same analysis is carried out for the kinetic counterpart of the gradient flow, i.e. the corresponding Vlasov-Fokker-Planck equation. The local exponential convergence to stationary solutions for the mean-field equations, both elliptic and kinetic, is shown to induce for the corresponding particle systems a fast (i.e. uniform in the number or particles) decay of the particle system free energy toward the level of the non-linear limit.

math.AP

Survival probability of structures under fatigue: a data-based approach

This article addresses the probabilistic nature of fatigue life in structures subjected to cyclic loading with variable amplitude. Drawing on the formalisation of Miner's cumulative damage rule that we introduced in the recent article [Cartiaux, Ehrlacher, Legoll, Libal and Reygner, Prob. Eng. Mech. 2023], we apply our methodology to estimate the survival probability of an industrial structure using experimental data. The study considers both the randomness in the initial state of the structure and in the amplitude of loading cycles. The results indicate that the variability of loading cycles can be captured through the concept of deterministic equivalent damage, providing a computationally efficient method for assessing the fatigue life of the structure. Furthermore, the article highlights that the usual combination of Miner's rule and of the weakest link principle systematically overestimates the structure's fatigue life. On the case study that we consider, this overestimation reaches a multiplicative factor of more than two. We then describe how the probabilistic framework that we have introduced offers a remedy to this overestimation.

cs.CE

Asymptotically unbiased approximation of the QSD of diffusion processes with a decreasing time step Euler scheme

We build and study a recursive algorithm based on the occupation measure of an Euler scheme with decreasing step for the numerical approximation of the quasistationary distribution (QSD) of an elliptic diffusion in a bounded domain. We prove the almost sure convergence of the procedure for a family of redistributions and show that we can also recover the approximation of the rate of survival and the convergence in distribution of the algorithm. This last point follows from some new bounds on the weak error related to diffusion dynamics with renewal.

math.PR

Estimation of statistics of transitions and Hill relation for Langevin dynamics

In molecular dynamics, statistics of transitions, such as the mean transition time, are macroscopic observables which provide important dynamical information on the underlying microscopic stochastic process. A direct estimation using simulations of microscopic trajectories over long time scales is typically computationally intractable in metastable situations. To overcome this issue, several numerical methods rely on a potential-theoretic identity, sometimes attributed to Hill in the computational statistical physics litterature, which expresses statistics of transitions in terms of the invariant measure of the sequence of configurations by which the underlying process enters metastable sets. The use of this identity then allows to replace the long time simulation problem with a rare event sampling problem, for which efficient algorithms are available. In this article, we rigorously analyse such a method for molecular systems modelled by the Langevin dynamics. Our main contributions are twofold. First, we prove the Hill relation in the fairly general context of positive Harris recurrent chains, and show that this formula applies to the Langevin dynamics. Second, we provide an explicit expression of the invariant measure involved in the Hill relation, and describe an elementary exact simulation procedure. Overall, this yields a simple and complete numerical method to estimate statistics of transitions.

math.PR

Probabilistic formulation of Miner's rule and application to structural fatigue

The standard stress-based approach to fatigue is based on the use of S-N curves. They are obtained by applying cyclic loading of constant amplitude $S$ to identical and standardised specimens until they fail. The S-N curves actually depend on a reference probability $p$: for a given cycle amplitude $S$, they provide the number of cycles at which a proportion $p$ of specimens have failed. Based on the S-N curves, Miner's rule is next used to predict the number of cycles to failure of a specimen subjected to cyclic loading with variable amplitude. In this article, we present a probabilistic formulation of Miner's rule, which is based on the introduction of the notion of health of a specimen. We show the consistency of that new formulation with the standard approaches, thereby providing a precise probabilistic interpretation of these. Explicit formulas are derived in the case of the Weibull--Basquin model. We next turn to the case of a complete mechanical structure: taking into account size effects, and using the weakest link principle, we establish formulas for the survival probability of the structure. We illustrate our results by numerical simulations on a I-steel beam, for which we compute survival probabilities and density of failure point. We also show how to efficiently approximate these quantities using the Laplace method.

cs.CE

Path integral derivation and numerical computation of large deviation prefactors for non-equilibrium dynamics through matrix Riccati equations

For many non-equilibrium dynamics driven by small noise, in physics, chemistry, biology, or economy, rare events do matter. Large deviation theory then explains that the leading order term of the main statistical quantities have an exponential behavior. The exponential rate is often obtained as the infimum of an action, which is minimized along an instanton. In this paper, we consider the computation of the next order sub-exponential prefactors, which are crucial for a large number of applications. Following a path integral approach, we derive the dynamics of the Gaussian fluctuations around the instanton and compute from it the sub-exponential prefactors. As might be expected, the formalism leads to the computation of functional determinants and matrix Riccati equations. By contrast with the cases of equilibrium dynamics with detailed balance or generalized detailed balance, we stress the specific non locality of the solutions of the Riccati equation: the prefactors depend on fluctuations all along the instanton and not just at its starting and ending points. We explain how to numerically compute the prefactors. The case of statistically stationary quantities requires considerations of non trivial initial conditions for the matrix Riccati equation.

cond-mat.stat-mech

Label noise (stochastic) gradient descent implicitly solves the Lasso for quadratic parametrisation

Understanding the implicit bias of training algorithms is of crucial importance in order to explain the success of overparametrised neural networks. In this paper, we study the role of the label noise in the training dynamics of a quadratically parametrised model through its continuous time version. We explicitly characterise the solution chosen by the stochastic flow and prove that it implicitly solves a Lasso program. To fully complete our analysis, we provide nonasymptotic convergence guarantees for the dynamics as well as conditions for support recovery. We also give experimental results which support our theoretical claims. Our findings highlight the fact that structured noise can induce better generalisation and help explain the greater performances of stochastic dynamics as observed in practice.

stat.ML

Reweighting samples under covariate shift using a Wasserstein distance criterion

Considering two random variables with different laws to which we only have access through finite size iid samples, we address how to reweight the first sample so that its empirical distribution converges towards the true law of the second sample as the size of both samples goes to infinity. We study an optimal reweighting that minimizes the Wasserstein distance between the empirical measures of the two samples, and leads to an expression of the weights in terms of Nearest Neighbors. The consistency and some asymptotic convergence rates in terms of expected Wasserstein distance are derived, and do not need the assumption of absolute continuity of one random variable with respect to the other. These results have some application in Uncertainty Quantification for decoupled estimation and in the bound of the generalization error for the Nearest Neighbor Regression under covariate shift.

math.ST

A probabilistic study of the kinetic Fokker-Planck equation in cylindrical domains

We consider classical solutions to the kinetic Fokker-Planck equation on a bounded domain $\mathcal O \subset~\mathbb{R}^d$ in position, and we obtain a probabilistic representation of the solutions using the Langevin diffusion process with absorbing boundary conditions on the boundary of the phase-space cylindrical domain $D = \mathcal O \times \mathbb{R}^d$. Furthermore, a Harnack inequality, as well as a maximum principle, is provided on $D$ for solutions to this kinetic Fokker-Planck equation, together with the existence of a smooth transition density for the associated absorbed Langevin process. This transition density is shown to satisfy an explicit Gaussian upper-bound. Finally, the continuity and positivity of this transition density at the boundary of $D$ is also studied. All these results are in particular crucial to study the behavior of the Langevin diffusion process when it is trapped in a metastable state defined in terms of positions.

math.PR

Quasi-stationary distribution for the Langevin process in cylindrical domains, part I: existence, uniqueness and long-time convergence

Consider the Langevin process, described by a vector (position,momentum) in $\mathbb{R}^{d}\times\mathbb{R}^d$. Let $\mathcal O$ be a $\mathcal{C}^2$ open bounded and connected set of $\mathbb{R}^d$. We prove the compactness of the semigroup of the Langevin process absorbed at the boundary of the domain $D:=\mathcal{O}\times\mathbb{R}^d$. We then obtain the existence of a unique quasi-stationary distribution (QSD) for the Langevin process on $D$. We also provide a spectral interpretation of this QSD and obtain an exponential convergence of the Langevin process conditioned on non-absorption towards the QSD.

math.PR

Finite-Volume approximation of the invariant measure of a viscous stochastic scalar conservation law

We study the numerical approximation of the invariant measure of a viscous scalar conservation law, one-dimensional and periodic in the space variable, and stochastically forced with a white-in-time but spatially correlated noise. The flux function is assumed to be locally Lipschitz continuous and to have at most polynomial growth. The numerical scheme we employ discretises the SPDE according to a finite-volume method in space, and a split-step backward Euler method in time. As a first result, we prove the well-posedness as well as the existence and uniqueness of an invariant measure for both the semi-discrete and the split-step scheme. Our main result is then the convergence of the invariant measures of the discrete approximations, as the space and time steps go to zero, towards the invariant measure of the SPDE, with respect to the second-order Wasserstein distance. We investigate rates of convergence theoretically, in the case where the flux function is globally Lipschitz continuous with a small Lipschitz constant, and numerically for the Burgers equation.

math.AP

Viscous scalar conservation law with stochastic forcing: strong solution and invariant measure

We are interested in viscous scalar conservation laws with a white-in-time but spatially correlated stochastic forcing. The equation is assumed to be one-dimensional and periodic in the space variable, and its flux function to be locally Lipschitz continuous and have at most polynomial growth. Neither the flux nor the noise need to be non-degenerate. In a first part, we show the existence and uniqueness of a global solution in a strong sense. In a second part, we establish the existence and uniqueness of an invariant measure for this strong solution.

math.AP

Equilibrium large deviations for mean-field systems with translation invariance

We consider particle systems with mean-field interactions whose distribution is invariant by translations. Under the assumption that the system seen from its centre of mass be reversible with respect to a Gibbs measure, we establish large deviation principles for its empirical measure at equilibrium. Our study covers the cases of McKean-Vlasov particle systems without external potential, and systems of rank-based interacting diffusions. Depending on the strength of the interaction, the large deviation principles are stated in the space of centered probability measures endowed with the Wasserstein topology of appropriate order, or in the orbit space of the action of translations on probability measures. An application to the study of atypical capital distribution is detailed.

math.PR

Central Limit Theorem for stationary Fleming--Viot particle systems in finite spaces

We consider the Fleming--Viot particle system associated with a continuous-time Markov chain in a finite space. Assuming irreducibility, it is known that the particle system possesses a unique stationary distribution, under which its empirical measure converges to the quasistationary distribution of the Markov chain. We complement this Law of Large Numbers with a Central Limit Theorem. Our proof essentially relies on elementary computations on the infinitesimal generator of the Fleming--Viot particle system, and involves the so-called $π$-return process in the expression of the asymptotic variance. Our work can be seen as an infinite-time version, in the setting of finite space Markov chains, of results by Del Moral and Miclo [ESAIM: Probab. Statist., 2003] and C{é}rou, Delyon, Guyader and Rousset [arXiv:1611.00515, arXiv:1709.06771].

math.PR