SearcharxivSearch

arXiv subjects

Barbara Pacchiarotti

Publications and source records attributed to Barbara Pacchiarotti.

16 recordsLinked to original sources

Functional Large Deviations for Wide Deep Neural Networks with Gaussian Initialization and Lipschitz Activations

We establish a functional large deviation principle for fully connected multi-layer perceptrons with i.i.d. Gaussian weights (LeCun initialization) and general Lipschitz activation functions, including therefore the popular case of ReLU. The large deviation principle holds for the entire network output process on any compact input set. The proof combines exponential tightness for recursively defined processes, finite-dimensional large deviations, and the Dawson-G\"artner theorem, extending existing results beyond finite input sets and less general activations.

math.PR

Large deviation principles and functional limit theorems in the deep limit of wide random neural networks

This paper studies large deviation principles and weak convergence, both at the level of finite-dimensional distributions and in functional form, for a class of continuous, isotropic, centered Gaussian random fields defined on the unit sphere. The covariance functions of these fields evolve recursively through a nonlinear map induced by an activation function, reflecting the statistical dynamics of infinitely wide random neural networks as depth increases. We consider two types of centered fields, obtained by subtracting either the value at the North Pole or the spherical average. According to the behavior of the derivative at $t=1$ of the associated covariance function, we identify three regimes: low disorder, sparse, and high disorder. In the low-disorder regime, we establish functional large deviation principles and weak convergence results. In the sparse regime, we obtain large deviation principles and weak convergence for finite-dimensional distributions, while both properties fail at the functional level sense due to the emergence of discontinuities in the covariance recursion.

math.PR

Some vector-valued examples of noncentral moderate deviation results

The term noncentral moderate deviations is used in the literature to mean a class of large deviation principles that, in some sense, fills the gap between the convergence in probability to a constant (governed by a reference large deviation principle) and a weak convergence to a non-Gaussian (and non-degenerating) distribution. Several examples can be found in the literature, mainly for real-valued random variables (see, e.g.,~\cite{GiulianoMacci} and the references cited therein). In this paper we present some examples with vector-valued random variables.

math.PR

Large and moderate deviations for Gaussian neural networks

We prove large and moderate deviations for the output of Gaussian fully connected neural networks. The main achievements concern deep neural networks (i.e., when the model has more than one hidden layer) and hold for bounded and continuous pre-activation functions. However, for deep neural networks fed by a single input, we have results even if the pre-activation is ReLU. When the network is shallow (i.e., there is exactly one hidden layer) the large and moderate principles hold for quite general pre-activation functions.

math.PR

Asymptotic results for compound sums in separable Banach spaces

We prove large and moderate deviation results for sequences of compound sums, where the summands are i.i.d. random variables taking values in a separable Banach space. We establish that the results hold by proving that we are dealing with exponentially tight sequences. We present two moderate deviation results: in the first one the summands are centered, in the second one the compound sums are centered.

math.PR

Large Deviations of continuous Gaussian processes: from small noise to small time

We investigate the Large Deviation behavior in small time of continuous Gaussian processes. We introduce a general procedure allowing to derive Large Deviation Principles in small time starting from the well understood context of Large Deviation Principles with a small parameter, going beyond the self-similar case. Several motivating examples are also treated.

math.PR

Asymptotic results for sums and extremes

The term moderate deviations is often used in the literature to mean a class of large deviation principles that, in some sense, fills the gap between a convergence in probability of some random variables to a constant and a weak convergence to a centered Gaussian distribution (when such random variables are properly centered and rescaled). We talk about noncentral moderate deviations when the weak convergence is towards a non-Gaussian distribution. In this paper, we prove a noncentral moderate deviation result for the bivariate sequence of sums and maxima of i.i.d. random variables bounded from above. We also prove a result where the random variables are not bounded from above, and the maxima are suitably normalized. Finally, we prove a moderate deviation result for sums of partial minima of i.i.d. exponential random variables.

math.PR

Asymptotics for multifactor Volterra type stochastic volatility models

We study multidimensional stochastic volatility models in which the volatility process is a positive continuous function of a continuous multidimensional Volterra process that can be not self-similar. The main results obtained in this paper are a generalization of the results due, in the one-dimensional case, to Cellupica and Pacchiarotti [M. Cellupica and B. Pacchiarotti (2021) Pathwise Asymptotics for Volterra Type Stochastic Volatility Models. Journal of Theoretical Probability, 34(2):682--727]. We state some (pathwise and finite-dimensional) large deviation principles for the scaled log-price and as a consequence some (pathwise and finite-dimensional) short-time large deviation principles.

math.PR

Short-time asymptotics for non self-similar stochastic volatility models

We provide a short-time large deviation principle (LDP) for stochastic volatility models, where the volatility is expressed as a function of a Volterra process. This LDP does not require strict self-similarity assumptions on the Volterra process. For this reason, we are able to apply such an LDP to two notable examples of non self-similar rough volatility models: models where the volatility is given as a function of a log-modulated fractional Brownian motion [Bayer et al., Log-modulated rough stochastic volatility models. SIAM J. Financ. Math, 2021, 12(3), 1257-1284], and models where it is given as a function of a fractional Ornstein-Uhlenbeck (fOU) process [Gatheral et al., Volatility is rough. Quant. Finance, 2018, 18(6), 933-949]. In both cases we derive consequences for short-maturity European option prices, implied volatility surfaces and implied volatility skew. In the fOU case we also discuss moderate deviations pricing and simulation results.

q-fin.MF

Asymptotic results for certain first-passage times and areas of renewal processes

We consider the process $\{x-N(t):t\geq 0\}$, where $x\in\mathbb{R}_+$ and $\{N(t):t\geq 0\}$ is a renewal process with light-tailed distributed holding times. We are interested in the joint distribution of $(τ(x),A(x))$ where $τ(x)$ is the first-passage time of $\{x-N(t):t\geq 0\}$ to reach zero or a negative value, and $A(x):=\int_0^{τ(x)}(x-N(t))dt$ is the corresponding first-passage (positive) area swept out by the process $\{x-N(t):t\geq 0\}$. We remark that we can define the sequence $\{(τ(n),A(n)):n\geq 1\}$ by referring to the concept of integrated random walk. Our aim is to prove asymptotic results as $x\to\infty$ in the fashion of large (and moderate) deviations.

math.PR

Asymptotic results for families of power series distributions

In this paper we consider suitable families of power series distributed random variables, and we study their asymptotic behavior in the fashion of large (and moderate) deviations. We also present two examples of fractional counting processes, where the normalizations of the involved power series distributions can be expressed in terms of the Prabhakar function. The first example allows to consider the counting process in \cite{PoganyTomovski}, the second one is inspired by a model studied in \cite{GarraOrsingherPolito}.

math.PR

Asymptotic results for linear combinations of spacings generated by i.i.d. exponential random variables

We prove large (and moderate) deviations for a class of linear combinations of spacings generated by i.i.d. exponentially distributed random variables. We allow a wide class of coefficients which can be expressed in terms of continuous functions defined on [0, 1] which satisfy some suitable conditions. In this way we generalize some recent results by Giuliano et al. (2015) which concern the empirical cumulative entropies defined in Di Crescenzo and Longobardi (2009a).

math.PR

Large deviations for a class of tempered subordinators and their inverse processes

We consider a class of tempered subordinators, namely a class of subordinators with one-dimensional marginal tempered distributions which belong to a family studied in [3]. The main contribution in this paper is a non-central moderate deviations result. More precisely we mean a class of large deviation principles that fill the gap between the (trivial) weak convergence of some non-Gaussian identically distributed random variables to their common law, and the convergence of some other related random variables to a constant. Some other minor results concern large deviations for the inverse of the tempered subordinators considered in this paper; actually, in some results, these inverse processes appear as random time-changes of other independent processes.

math.PR

Pathwise asymptotics for Volterra processes conditioned to a noisy version of the Brownian motion

In this paper we investigate a problem of large deviations for continuous Volterra processes under the influence of model disturbances. More precisely, we study the behavior, in the near future after $T$, of a Volterra process driven by a Brownian motion in a case where the Brownian motion is not directly observable, but only a noisy version is observed or some linear functionals of the noisy version are observed. Some examples are discussed in both cases.

math.PR

Large deviations for i.i.d. replications of the total progeny of a Galton--Watson process

The Galton--Watson process is the simplest example of a branching process. The relationship between the offspring distribution, and, when the extinction occurs almost surely, the distribution of the total progeny is well known. In this paper, we illustrate the relationship between these two distributions when we consider the large deviation rate function (provided by Cramér's theorem) for empirical means of i.i.d. random variables. We also consider the case with a random initial population. In the final part, we present large deviation results for sequences of estimators of the offspring mean based on i.i.d. replications of total progeny.

math.PR