Searcharxiv⌕ Search

arXiv subjects

Marc Potters

Publications and source records attributed to Marc Potters.

At least 19 recordsLinked to original sources

R-transforms for non-Hermitian matrices: a spherical integral approach

In this paper, we establish a connection between the formalism of $\mathcal{R}$-transforms for non-Hermitian random matrices and the framework of spherical integrals, using the replica method. This connection was previously proved in the Hermitian setting and in the case of bi-invariant random matrices. We show that the $\mathcal{R}$-transforms used in the non-Hermitian context in fact originate from a single scalar function of two variables. This provides a new and transparent way to compute $\mathcal{R}$-transforms, which until now had been known only in restricted cases such as bi-invariant, Hermitian, or elliptic ensembles.

cond-mat.dis-nn↗

Spectral boundaries of deterministic matrices deformed by rotationally invariant random non-Hermitian ensembles

One of the great miracles of random matrix theory is that, in the $N \to \infty$ limit, many otherwise intractable matrix problems with horrendously complicated finite-$N$ expressions admit remarkably simple and elegant asymptotic solutions. In this paper, we illustrate this phenomenon in the context of spectral boundaries (or spectral edges) for deformed random matrices. Specifically, we consider matrices of the form $\mathbf{A} + \mathbf{B}$, where $\mathbf{A}$ is a deterministic $N\times N$ matrix (not necessarily Hermitian) and $\mathbf{B}$ is a rotationally invariant random matrix. In the large-$N$ limit, we show that the complex eigenvalue distribution of $\mathbf{A} + \mathbf{B}$ satisfies remarkably simple boundary equations that depend on the $\mathcal{R}_1$ and $\mathcal{R}_2$ transforms of $\mathbf{B}$. We illustrate our results on several explicit random matrix ensembles and support them with numerical simulations.

cond-mat.dis-nn↗

Finite-rank multiplicative perturbations of rotationally invariant non-Hermitian random matrices

We study finite-rank multiplicative deformations of rotationally invariant non-Hermitian random matrices. More precisely, we consider models of the form $\mathbf{A}(\mathbf{I}+\mathbf{T})$, where $\mathbf{A}$ is a large rotationally invariant non-Hermitian random matrix, $\mathbf{T}$ is a finite-rank normal perturbation, and $\mathbf{I}$ denotes the identity matrix. We characterize the emergence of outlier eigenvalues, their fluctuations, and the associated eigenvector overlaps. Our results provide a multiplicative non-Hermitian counterpart to the classical Baik--Ben Arous--Péché framework.

cond-mat.dis-nn↗

Phase transitions in non-Hermitian spherical integrals

We study the large-$N$ asymptotics of a constrained spherical integral for non-Hermitian random matrices, in which the norms and mutual scalar product of two vectors are fixed. In the delocalized regime, the asymptotics are governed by the non-Hermitian transforms $\mathcal R_1$ and $\mathcal R_2$. At saddle-point level, the constrained integral exhibits a transition to a localized regime controlled by the largest singular value of a shifted matrix and by the overlap of its associated left and right singular vectors. Motivated by the Hermitian spherical-integral mechanism and by the Coulomb-gas picture, we formulate conjectures for one-eigenvalue large deviations and boundary fluctuations. Throughout, our analysis is carried out in the spirit of mathematical physics.

math-ph↗

Spectral properties of deterministic matrices multiplied by rotationally invariant random non-Hermitian ensembles

In this paper, we study spectral properties of multiplicative deformations of non-Hermitian random matrices. We consider matrices of the form $\mathbf{A}\mathbf{B}$, where $\mathbf{A}$ is a deterministic $N\times N$ matrix (not necessarily Hermitian) and $\mathbf{B}$ is a rotationally invariant random matrix. We show that, as $N\to\infty$, the boundary of the complex eigenvalue distribution of $\mathbf{A}\mathbf{B}$ is governed by simple equations involving the $\mathcal{R}_1$ and $\mathcal{R}_2$ transforms of $\mathbf{B}$.

cond-mat.dis-nn↗

The eigenvalues and eigenvectors of finite-rank normal perturbations of large rotationally invariant non-Hermitian matrices

We study finite-rank normal deformations of rotationally invariant non-Hermitian random matrices. Extending the classical Baik-Ben Arous-Péché (BBP) framework, we characterize the emergence and fluctuations of outlier eigenvalues in models of the form $\mathbf{A} + \mathbf{T}$, where $\mathbf{A}$ is a large rotationally invariant non-Hermitian random matrix and $\mathbf{T}$ is a finite-rank normal perturbation. We also describe the corresponding eigenvector behavior. Our results provide a unified framework encompassing both Hermitian and non-Hermitian settings, thereby generalizing several known cases.

cond-mat.dis-nn↗

Optimal Data Splitting for Holdout Cross-Validation in Large Covariance Matrix Estimation

Cross-validation is a statistical tool that can be used to improve large covariance matrix estimation. Although its efficiency is observed in practical applications and a convergence result towards the error of the non linear shrinkage is available in the high-dimensional regime, formal proofs that take into account the finite sample size effects are currently lacking. To carry on analytical analysis, we focus on the holdout method, a single iteration of cross-validation, rather than the traditional $k$-fold approach. We derive a closed-form expression for the expected estimation error when the population matrix follows a white inverse Wishart distribution, and we observe the optimal train-test split scales as the square root of the matrix dimension. For general population matrices, we connected the error to the variance of eigenvalues distribution, but approximations are necessary. In this framework and in the high-dimensional asymptotic regime, both the holdout and $k$-fold cross-validation methods converge to the optimal estimator when the train-test ratio scales with the square root of the matrix dimension which is coherent with the existing theory.

math.ST↗

Distribution of the Diagonal Entries of the Resolvent of a Complex Ginibre Matrix

The study of eigenvalue distributions in random matrix theory is often conducted by analyzing the resolvent matrix $ \mathbf{G}_{\mathbf{M}}^N(z) = (z \mathbf{1} - \mathbf{M})^{-1} $. The normalized trace of the resolvent, known as the Stieltjes transform $ \mathfrak{g}_{\mathbf{M}}^N(z) $, converges to a limit $ \mathfrak{g}_{\mathbf{M}}(z) $ as the matrix dimension $ N $ grows, which provides the eigenvalue density $ ρ_{\mathbf{M}} $ in the large-$ N $ limit. In the Hermitian case, the distribution of $ \mathfrak{g}_{\mathbf{M}}^N(z) $, now regarded as a random variable, is explicitly known when $ z $ lies within the limiting spectrum, and it coincides with the distribution of any diagonal entry of $ \mathbf{G}_{\mathbf{M}}^N(z) $. In this paper, we investigate what becomes of these results when $ \mathbf{M} $ is non-Hermitian. Our main result is the exact computation of the diagonal elements of $ \mathbf{G}_{\mathbf{M}}^N(z) $ when $ \mathbf{M} $ is a Ginibre matrix of size $ N $, as well as the high-dimensional limit for different regimes of $ z $, revealing a tail behavior connected to the statistics of the left and right eigenvectors. Interestingly, the limit distribution is stable under inversion, a property previously observed in the symmetric case. We then propose two general conjectures regarding the distribution of the diagonal elements of the resolvent and its normalized trace in the non-Hermitian case, both of which reveal a symmetry under inversion.

math-ph↗

Spectral Initialization for High-Dimensional Phase Retrieval with Biased Spatial Directions

We explore a spectral initialization method that plays a central role in contemporary research on signal estimation in nonconvex scenarios. In a noiseless phase retrieval framework, we precisely analyze the method's performance in the high-dimensional limit when sensing vectors follow a multivariate Gaussian distribution for two rotationally invariant models of the covariance matrix C. In the first model C is a projector on a lower dimensional space while in the second it is a Wishart matrix. Our analytical results extend the well-established case when C is the identity matrix. Our examination shows that the introduction of biased spatial directions leads to a substantial improvement in the spectral method's effectiveness, particularly when the number of measurements is less than the signal's dimension. This extension also consistently reveals a phase transition phenomenon dependent on the ratio between sample size and signal dimension. Surprisingly, both of these models share the same threshold value.

cond-mat.dis-nn↗

Excess Out-of-Sample Risk and Fleeting Modes

Using Random Matrix Theory, we propose a universal and versatile tool to reveal the existence of "fleeting modes", i.e. portfolios that carry statistically significant excess risk, signalling ex-post a change in the correlation structure in the underlying asset space. Our proposed test is furthermore independent of the "true" (but unknown) underlying correlation structure. We show empirically that such fleeting modes exist both in futures markets and in equity markets. We proposed a metric to quantify the alignment between known factors and fleeting modes and identify momentum as a source of excess risk in the equity space.

q-fin.PM↗

Right large deviation principle for the top eigenvalue of the sum or product of invariant random matrices

In this note we study the right large deviation of the top eigenvalue (or singular value) of the sum or product of two random matrices $\mathbf{A}$ and $\mathbf{B}$ as their dimensions goes to infinity. The matrices $\mathbf{A}$ and $\mathbf{B}$ are each assumed to be taken from an invariant (or bi-invariant) ensemble with a confining potential with a possible \emph{wall} beyond which no eigenvalues/singular values are allowed. The introduction of this wall puts different models in a very generic framework. In particular, the case where the wall is exactly at the right edge of the limiting spectral density is equivalent, from the point of view of large deviations, to considering a fixed diagonal matrices, as studied previously in Ref. \cite{GuionnetMaida20}. We show that that the tilting method introduced in Ref. \cite{GuionnetMaida20} can be extended to our general setting and is equivalent to the study of a spherical spin glass model specific to the operation - sum of symmetric matrices / product of symmetric matrices / sum of rectangular matrices - we are considering.

math-ph↗

Optimal cleaning for singular values of cross-covariance matrices

We give a new algorithm for the estimation of the cross-covariance matrix $\mathbb{E} XY'$ of two large dimensional signals $X\in\mathbb{R}^n$, $Y\in \mathbb{R}^p$ in the context where the number $T$ of observations of the pair $(X,Y)$ is large but $n/T$ and $p/T$ are not supposed to be small. In the asymptotic regime where $n,p,T$ are large, with high probability, this algorithm is optimal for the Frobenius norm among rotationally invariant estimators, i.e. estimators derived from the empirical estimator by cleaning the singular values, while letting singular vectors unchanged.

math.ST↗

Asymptotic behavior of the multiplicative counterpart of the Harish-Chandra integral and the $S$-transform

In this note, we study the asymptotic of spherical integrals, which are analytical extension in index of the normalized Schur polynomials for $β=2$ , and of Jack symmetric polynomials otherwise. Such integrals are the multiplicative counterparts of the Harish-Chandra-Itzykson-Zuber (HCIZ) integrals, whose asymptotic are given by the so-called $R$-transform when one of the matrix is of rank one. We argue by a saddle-point analysis that a similar result holds for all $β>0$ in the multiplicative case, where the asymptotic is governed by the logarithm of the $S$-transform. As a consequence of this result one can calculate the asymptotic behavior of complete homogeneous symmetric polynomials.

math-ph↗

Rank one HCIZ at high temperature: interpolating between classical and free convolutions

We study the rank one Harish-Chandra-Itzykson-Zuber integral in the limit where $\frac{N β}{2} \to c $, called the high temperature regime and show that it can be used to construct a promising one-parameter interpolation, with parameter $c$ between the classical and the free convolution. This $c$-convolution has a simple interpretation in terms of another associated family of distribution indexed by $c$, called the Markov-Krein transform: the $c$-convolution of two distributions corresponds to the classical convolution of their Markov-Krein transforms. We derive first cumulants-moments relations, a central limit theorem, a Poisson limit theorem and shows several numerical examples of $c$-convoluted distributions.

cond-mat.stat-mech↗

On a Generalisation of the Marcenko-Pastur Problem

We study the spectrum of generalized Wishart matrices, defined as $\mathbf{F}=( X Y^\top + Y X^\top)/2T$, where $X$ and $Y$ are $N \times T$ matrices with zero mean, unit variance IID entries and such that $\mathbb{E}[X_{it} Y_{jt}]=c δ_{i,j}$. The limit $c=1$ corresponds to the Marcenko-Pastur problem. For a general $c$, we show that the Stietjes transform of $\mathbf{F}$ is the solution of a cubic equation. In the limit $c=0$, $T \gg N$ the density of eigenvalues converges to the Wigner semi-circle.

cond-mat.dis-nn↗

On the overlaps between eigenvectors of correlated random matrices

We obtain general, exact formulas for the overlaps between the eigenvectors of large correlated random matrices, with additive or multiplicative noise. These results have potential applications in many different contexts, from quantum thermalisation to high dimensional statistics. We find that the overlaps only depend on measurable quantities, and do not require the knowledge of the underlying "true" (noiseless) matrices. We apply our results to the case of empirical correlation matrices, that allow us to estimate reliably the width of the spectrum of the true correlation matrix, even when the latter is very close to the identity. We illustrate our results on the example of stock returns correlations, that clearly reveal a non trivial structure for the bulk eigenvalues. We also apply our results to the problem of matrix denoising in high dimension.

cond-mat.stat-mech↗

Agnostic Risk Parity: Taming Known and Unknown-Unknowns

Markowitz' celebrated optimal portfolio theory generally fails to deliver out-of-sample diversification. In this note, we propose a new portfolio construction strategy based on symmetry arguments only, leading to "Eigenrisk Parity" portfolios that achieve equal realized risk on all the principal components of the covariance matrix. This holds true for any other definition of uncorrelated factors. We then specialize our general formula to the most agnostic case where the indicators of future returns are assumed to be uncorrelated and of equal variance. This "Agnostic Risk Parity" (AGP) portfolio minimizes unknown-unknown risks generated by over-optimistic hedging of the different bets. AGP is shown to fare quite well when applied to standard technical strategies such as trend following.

q-fin.PM↗

Rotational invariant estimator for general noisy matrices

We investigate the problem of estimating a given real symmetric signal matrix $\textbf{C}$ from a noisy observation matrix $\textbf{M}$ in the limit of large dimension. We consider the case where the noisy measurement $\textbf{M}$ comes either from an arbitrary additive or multiplicative rotational invariant perturbation. We establish, using the Replica method, the asymptotic global law estimate for three general classes of noisy matrices, significantly extending previously obtained results. We give exact results concerning the asymptotic deviations (called overlaps) of the perturbed eigenvectors away from the true ones, and we explain how to use these overlaps to "clean" the noisy eigenvalues of $\textbf{M}$. We provide some numerical checks for the different estimators proposed in this paper and we also make the connection with some well known results of Bayesian statistics.

cond-mat.stat-mech↗