SearcharxivSearch

arXiv subjects

Sebastian Mentemeier

Publications and source records attributed to Sebastian Mentemeier.

At least 19 recordsLinked to original sources

Hidden regular variation for stochastic recursions with diagonal matrices

We consider random vectors $X$ that satisfy the equation in law $X=AX+B$, where $A$ is a given random diagonal matrix and $B$ a given random vector, both independent of $X$. It is well known by the works of Kesten and Goldie that the marginals of $X$ may exhibit heavy tails, with possibly different tail indices. In recent works (Damek 2025, Mentemeier and Wintenberger 2022) it was observed that asymptotic independence may occur despite strong dependencies in the entries of $A$: The probability that both marginals are simultaneously large decays faster than the marginal probability of an extreme event; the tail measure is concentrated on the axis. In this work, we analyse the hidden regular variation properties of $X$, that is, we find the proper scaling for which one observes simultaneous extremes.

math.PR

Spinal decomposition, martingale convergence and the Seneta-Heyde scaling for matrix branching random walks

We consider a matrix branching random walk on the semi-group of nonnegative matrices, where we are able to derive, under general assumptions, an analogue of Biggins' martingale convergence theorem for the additive martingale $W_n$, a spinal decomposition theorem, convergence of the derivative martingale $D_n$, and finally, the Seneta-Heyde scaling stating that in the boundary case $c \sqrt{n} W_n \to D_\infty$ a.s., where $D_\infty$ is the limit of the derivative martingale and $c$ is a positive constant. As an important tool that is of interest in its own right, we provide explicit duality results for the renewal measure of centered Markov random walks, relating the renewal measure of the process, killed when the random walk component becomes negative, to the renewal measure of the ascending ladder process.

math.PR

A probabilistic study of the set of stationary solutions to spatial kinetic-type equations

In this paper we study multivariate kinetic-type equations in a general setup, which includes in particular the spatially homogeneous Boltzmann equation with Maxwellian molecules, both with elastic and inelastic collisions. Using a representation of the collision operator derived in Bassetti, Ladelli, Matthes (2015) and Dolera, Regazzini (2014), we prove the existence and uniqueness of time-dependent solutions with the help of continuous-time branching random walks, under assumptions as weak as possible. Our main objective is a characterisation of the set of stationary solutions, e.g. equilibrium solutions for inelastic kinetic-type equations, which we describe as mixtures of multidimensional stable laws.

math.PR

Limit theorems for stochastic exponentials of matrix-valued L\'evy processes

We study the long-time behaviour of matrix-valued stochastic exponentials of L\'evy processes, i.e. of multiplicative L\'evy processes in the general linear group. In particular, we prove laws of large numbers as well as central limit theorems for the logarithmised norm, logarithmised entries and the logarithmised determinant of the stochastic exponential. Where possible, also Berry-Esseen bounds are stated.

math.PR

Analysing heavy-tail properties of Stochastic Gradient Descent by means of Stochastic Recurrence Equations

In recent works on the theory of machine learning, it has been observed that heavy tail properties of Stochastic Gradient Descent (SGD) can be studied in the probabilistic framework of stochastic recursions. In particular, Gürbüzbalaban et al. (arXiv:2006.04740) considered a setup corresponding to linear regression for which iterations of SGD can be modelled by a multivariate affine stochastic recursion $X_k=A_k X_{k-1}+B_k$, for independent and identically distributed pairs $(A_k, B_k)$, where $A_k$ is a random symmetric matrix and $B_k$ is a random vector. In this work, we will answer several open questions of the quoted paper and extend their results by applying the theory of irreducible-proximal (i-p) matrices.

stat.ML

Limit theorems for first passage times of multivariate perpetuity sequences

We study the first passage time $\tau_u = \inf \{ n \geq 1: |V_n| > u \}$ for the multivariate perpetuity sequence $V_n = Q_1 + M_1 Q_2 + \cdots + (M_1 \ldots M_{n-1}) Q_n$, where $(M_n, Q_n)$ is a sequence of independent and identically distributed random variables with $M_1$ a $d \times d$ ($d \geq 1$) random matrix with nonnegative entries, and $Q_1$ a nonnegative random vector in $\mathbb R^d$. Here $|\cdot|$ denotes the vector norm. The exact asymptotic for the probability $\mathbb P (\tau_u < \infty)$ as $u \to \infty$ has been found by Kesten (Acta Math. 1973). In this paper we prove a conditioned weak law of large numbers for $\tau_u$: conditioned on the event $\{ \tau_u < \infty \}$, $\frac{\tau_u}{\log u}$ converges in probability to a certain constant $\rho > 0$ as $u \to \infty$. A conditioned central limit theorem for $\tau_u$ is also obtained. We further establish precise large deviation asymptotics for the lower probability $\mathbb P (\tau_u \leq (\beta - l) \log u)$ as $u \to \infty$, where $\beta \in (0, \rho)$ and $l \geq 0$ is a vanishing perturbation satisfying $l \to 0$ as $u \to \infty$. Our results extend those of Buraczewski et al. (Ann. Probab. 2016) from the univariate case ($d=1$) to the multivariate case ($d>1$). As consequences, we deduce exact asymptotics for the pointwise probability $\mathbb P (\tau_u = [(\beta - l) \log u] )$ and the local probability $\mathbb P (\tau_u - (\beta - l) \log u \in (a, a + m ] )$, where $a<0$ and $m \in \mathbb Z_+$. We also establish analogous results for the first passage time $\tau_u^y = \inf \{ n \geq 1: \langle y, V_n \rangle > u \}$, where $y$ is a nonnegative vector in $\mathbb R^d$ with $|y| = 1$.

math.PR

The extremal position of a branching random walk on the general linear group

Consider a branching random walk $(G_u)_{u\in \mathbb T}$ on the general linear group $\textrm{GL}(V)$ of a finite dimensional space $V$, where $\mathbb T$ is the associated genealogical tree with nodes $u$. For any starting point $v \in V \setminus\{0\}$ with $\|v\|=1$ and $x = \mathbb R v \in \mathbb P(V)$, let $M^x_n=\max_{|u| = n} \log \| G_u v \|$ denote the maximal position of the walk $\log \| G_u v \|$ in the generation $n$. We first show that under suitable conditions, $\lim_{n \to \infty} \frac{M_n^x }{n} = \gamma$ almost surely, where $\gamma \in \mathbb R$ is a constant. Then, in the case when $\gamma = 0$, under appropriate {\textit boundary conditions}, we refine the last statement by determining the rate of convergence at which $M_n^x$ converges to $-\infty$. We prove in particular that $\lim_{n \to \infty} \frac{M_n^x}{\log n} = -\frac{3}{2\alpha}$ in probability, where $\alpha >0$ is a constant determined by the boundary conditions. Analogous properties are established for the minimal position. As a consequence we derive the asymptotic speed of the maximal and minimal positions for the coefficients, the operator norm and the spectral radius of $G_u$.

math.PR

Asymptotic Independence ex machina -- Extreme Value Theory for the Diagonal BEKK-ARCH(1) Model

We consider multivariate stationary processes $(\boldsymbol{X}_t)$ satisfying a stochastic recurrence equation of the form $$ \boldsymbol{X}_t= \mathbb{ M}_t \boldsymbol{X}_{t-1} + \boldsymbol{Q}_t,$$ where $(\boldsymbol{Q}_t)$ are iid random vectors and $$ \mathbb{M}_t=\mathrm{Diag}(b_1+c_1 M_t, \dots, b_d+c_d M_t) $$ are iid diagonal matrices and $(M_t)$ are iid random variables. We obtain a full characterization of the multivariate regular variation properties of $(\boldsymbol{X}_t)$, proving that coordinates $X_{t,i}$ and $X_{t,j}$ are asymptotically independent even though all coordinates rely on the same random input $(M_t)$. We describe extremal properties of $(\boldsymbol{X}_t)$ in the framework of vector scaling regular variation. Our results are applied to some multivariate autoregressive conditional heteroskedasticity (BEKK-ARCH and CCC-GARCH) processes.

math.PR

Absolute Continuity of Complex Martingales and of Solutions to Complex Smoothing Equations

Let $X$ be a $\mathbb{C}$-valued random variable with the property that $$X \ \text{ has the same law as }\ \sum_{j\ge1} T_j X_j$$ where $X_j$ are i.i.d.\ copies of $X$, which are independent of the (given) $\mathbb{C}$-valued random variables $ (T_j)_{j\ge1}$. We provide a simple criterion for the absolute continuity of the law of $X$ that requires, besides the known conditions for the existence of $X$, only finiteness of the first and second moment of $N$ - the number of nonzero weights $T_j$. Our criterion applies in particular to Biggins' martingale with complex parameter.

math.PR

Large excursions and conditioned laws for recursive sequences generated by random matrices

We determine the large exceedance probabilities and large exceedance paths for the matrix recursive sequence $V_n = M_n V_{n-1} + Q_n, \: n=1,2,\ldots,$ where $\{M_n\}$ is an i.i.d. sequence of $d \times d$ random matrices and $\{ Q_n\}$ is an i.i.d. sequence of random vectors, both with nonnegative entries. Early work on this problem dates to Kesten's (1973) seminal paper, motivated by an application to multi-type branching processes. Other applications arise in financial time series modeling (connected to the study of the GARCH($p,q$) processes) and in physics, and this recursive sequence has also been the focus of extensive work in the recent probability literature. In this work, we characterize the distribution of the first passage time $T_u^A := \inf \{n: V_n \in u A \}$, where $A$ is a subset of the nonnegative quadrant in ${\mathbb R}^d$, showing that $T_u^A/u^α$ converges to an exponential law. In the process, we also revisit and refine Kesten's classical estimate, showing that if $V$ has the stationary distribution of $\{ V_n \}$, then ${\mathbb P} \left( V \in uA \right) \sim C_A u^{-α}$ as $u \to \infty$, providing, most importantly, a new characterization of the constant $C_A$. Finally, we describe the large exceedance paths via two conditioned limit laws. In the first, we show that conditioned on a large exceedance, the process $\{ V_n\}$ follows an exponentially-shifted Markov random walk, which we identify, thereby generalizing results for classical random walk to matrix recursive sequences. In the second, we characterize the empirical distribution of $\{ \log |V_n| - \log |V_{n-1}| \}$ prior to a large exceedance, showing that this distribution converges to the stationary law of the exponentially-shifted Markov random walk.

math.PR

Precise Tail Asymptotics for Attracting Fixed Points of Multivariate Smoothing Transformations

Given $d \ge 1$, let $(A_i)_{i\ge 1}$ be a sequence of random $d\times d$ real matrices and $Q$ be a random vector in $\mathbb{R}^d$. We consider fixed points of multivariate smoothing transforms, i.e. random variables $X\in \mathbb{R}^d$ satisfying $X$ has the same law as $\sum_{i \ge 1} A_i X_i + Q$, where $(X_i)_{i \ge 1}$ are i.i.d. copies of $X$ and independent of $(Q, (A_i)_{i \ge 1})$. The existence of fixed points that can attract point masses can be shown by means of contraction arguments. Let $X$ be such a fixed point. Assuming that the action of the matrices is expanding as well with positive probability, it was shown in a number of papers that there is $β>0$ with $\lim_{t \to \infty} t^β\mathbb{P}( >t ) = K\cdot f(u)$, where $u$ denotes an arbitrary element of the unit sphere and $f$ a positive function and $K \ge 0$. However in many cases it was not established that $K$ is indeed positive. In this paper, under quite general assumptions, we prove that $\liminf_{t\to\infty} t^β \mathbb{P} ( > t)> 0,$ completing, in particular, the results of arXiv:1111.1756 and arXiv:1206.1709.

math.PR

Solutions to complex smoothing equations

We consider smoothing equations of the form $$X ~\stackrel{\mathrm{law}}{=}~ \sum_{j \geq 1} T_j X_j + C$$ where $(C,T_1,T_2,\ldots)$ is a given sequence of random variables and $X_1,X_2,\ldots$ are independent copies of $X$ and independent of the sequence $(C,T_1,T_2,\ldots)$. The focus is on complex smoothing equations, i.e., the case where the random variables $X, C,T_1,T_2,\ldots$ are complex-valued, but also more general multivariate smoothing equations are considered, in which the $T_j$ are similarity matrices. Under mild assumptions on $(C,T_1,T_2,\ldots)$, we describe the laws of all random variables $X$ solving the above smoothing equation. These are the distributions of randomly shifted and stopped Lévy processes satisfying a certain invariance property called $(U,α)$-stability, which is related to operator (semi)stability. The results are applied to various examples from applied probability and statistical physics.

math.PR

Precise Large Deviation Results for Products of Random Matrices

The theorem of Furstenberg and Kesten provides a strong law of large numbers for the norm of a product of random matrices. This can be extended under various assumptions, covering nonnegative as well as invertible matrices, to a law of large numbers for the norm of a vector on which the matrices act. We prove corresponding precise large deviation results, generalizing the Bahadur-Rao theorem to this situation. Therefore, we obtain a third-order Edgeworth expansion for the cumulative distribution function of the vector norm. This result in turn relies on an application of the Nagaev-Guivarch method. Our result is then used to study matrix recursions, arising e.g. in financial time series, and to provide precise large deviation estimates there.

math.PR

The Fixed Points of the Multivariate Smoothing Transform

Let $N,d > 1$ be fixed integers, let $(T_1, ..., T_N)$ be random d-by-d matrices with nonnegative entries and $Q$ a random d-vector with nonnegative entries. This induces a mapping (the multivariate smoothing transform) on probability laws on the nonnegative cone by $S η:= \mathrm{Law\ of}\ (T_1 X_1 + ... + T_N X_N + Q)$, where the $X_i$ are iid with law $η$ and independent of $(T_1, ..., T_N, Q)$. Under conditions similar to those for the well-studied case d=1, a complete characterization of all fixed points of $S$ is obtained.

math.PR

Fixed Points of the Multivariate Smoothing Transform: The Critical Case

Given a sequence $(T_1, T_2, ...)$ of random $d \times d$ matrices with nonnegative entries, suppose there is a random vector $X$ with nonnegative entries, such that $ \sum_{i \ge 1} T_i X_i $ has the same law as $X$, where $(X_1, X_2, ...)$ are i.i.d. copies of $X$, independent of $(T_1, T_2, ...)$. Then (the law of) $X$ is called a fixed point of the multivariate smoothing transform. Similar to the well-studied one-dimensional case $d=1$, a function $m$ is introduced, such that the existence of $α\in (0,1]$ with $m(α)=1$ and $m'(α) \le 0$ guarantees the existence of nontrivial fixed points. We prove the uniqueness of fixed points in the critical case $m'(α)=0$ and describe their tail behavior. This complements recent results for the non-critical multivariate case. Moreover, we introduce the multivariate analogue of the derivative martingale and prove its convergence to a non-trivial limit.

math.PR

On Kesten's Multivariate Choquet-Deny Lemma

Let $d >1$ and $(A_n)_{n \ge 1}$ be a sequence of independent identically distributed random matrices with nonnegative entries and no zero column. This induces a Markov chain $M_n = A_n M_{n-1}$ on the cone of d-vectors with nonnegative entries. We study harmonic functions of this Markov chain. Considering a polar decomposition $M_n = X_n \exp(S_n)$, where $X_n$ is a vector of unit length, and $S_n$ a real valued random variable, it is in particular shown that all "compound" harmonic functions $L(x,s)=f(x)g(s)$ are constant. The idea of the proof is originally due to Kesten [Renewal theory for functionals of a Markov chain with general state space, Ann. Prob. 2 (1974), 355 - 386], but is considerably shortened here. A similar result for invertible matrices is given as well.

math.PR

On multidimensional Mandelbrot's cascades

Let $Z$ be a random variable with values in a proper closed convex cone $C\subset \mathbb{R}^d$, $A$ a random endomorphism of $C$ and $N$ a random integer. We assume that $Z$, $A$, $N$ are independent. Given $N$ independent copies $(A_i,Z_i)$ of $(A,Z)$ we define a new random variable $\hat Z = \sum_{i=1}^N A_i Z_i$. Let $T$ be the corresponding transformation on the set of probability measures on $C$ i.e. $T$ maps the law of $Z$ to the law of $\hat Z$. If the matrix $\mathbb{E}[N] \mathbb{E} [A]$ has dominant eigenvalue 1, we study existence and properties of fixed points of $T$ having finite nonzero expectation. Existing one dimensional results concerning $T$ are extended to higher dimensions. In particular we give conditions under which such fixed points of $T$ have multidimensional regular variation in the sense of extreme value theory and we determine the index of regular variation.

math.PR

Heavy tailed solutions of multivariate smoothing transforms

Let $N > 1$ be a fixed integer and $(C_1,..., C_N,Q)$ a random element of $GL(d, \R)^N x \R^d$. We consider solutions of multivariate smoothing transforms, i.e. random variables $R$ satisfying $$R \eqdist \sum_{i=1}^N C_i R_i +Q $$ where $\eqdist$ denotes equality in distribution, and $R, R_1,..., R_N$ are independent identically distributed $\R^d$-valued random variables, and independent of $(C_1,..., C_N, Q)$. We briefly review conditions for the existence of solutions, and then study their asymptotic behaviour. We show that under natural conditions, these solutions exhibit heavy tails. Our results also cover the case of complex valued weights $(C_1,..., C_N)$.

math.PR