Searcharxiv⌕ Search

arXiv subjects

Alex Shkolnik

Publications and source records attributed to Alex Shkolnik.

5 recordsLinked to original sources

Recovery Limits for Eigenvector Alignment in HDLSS Spiked Covariance Models

In a spiked covariance model, let $\mathcal{H}$ and $\mathcal{B}$ be selected sample and population eigenvector matrices. Their alignment matrix $Ξ=\mathcal{H}^\top\mathcal{B}$ is a latent oracle diagnostic of direction-specific correspondence beyond subspace overlap. We study its uniform pathwise recovery in a nested high-dimensional, low-sample-size experiment with fixed sample size and growing dimension. At every fixed model, an observable spectral contrast consistently estimates the row Gram matrix $ΞΞ^\top$. For two or more spikes, however, no measurable estimator sequence achieves uniformly reliable almost-sure path recovery of $Ξ$ over a family having common spike strengths and a common signal subspace but different ordered eigenframes. For every $0<ε<1/\sqrt{2}$, a finite orbit forces each estimator to have some orbit point at which the approximate path-recovery probability is at most a variational bound $u(ε)$, where $u(ε)$ tends to zero as $ε$ tends to zero. The worst-model exact-recovery probability over a countable orbit is zero. Thus the Gram summary is recoverable model by model, while the full alignment matrix is not uniformly recoverable along the nested path.

math.ST↗

The Quadratic Optimization Bias Of Large Covariance Matrices

We describe a puzzle involving the interactions between an optimization of a multivariate quadratic function and a "plug-in" estimator of a spiked covariance matrix. When the largest eigenvalues (i.e., the spikes) diverge with the dimension, the gap between the true and the out-of-sample optima typically also diverges. We show how to "fine-tune" the plug-in estimator in a precise way to avoid this outcome. Central to our description is a "quadratic optimization bias" function, the roots of which determine this fine-tuning property. We derive an estimator of this root from a finite number of observations of a high dimensional vector. This leads to a new covariance estimator designed specifically for applications involving quadratic optimization. Our theoretical results have further implications for improving low dimensional representations of data, and principal component analysis in particular.

math.ST↗

Unbiased Simulation Estimators for Multivariate Jump-Diffusions

We develop and analyze a class of unbiased Monte Carlo estimators for multivariate jump-diffusion processes with state-dependent drift, volatility, jump intensity and jump size. A change of measure argument is used to extend existing unbiased estimators for the inter-arrival diffusion to include state-dependent jumps. Under standard regularity conditions on the coefficient and target functions, we prove the unbiasedness and finite variance properties of the resulting jump-diffusion estimators. Numerical experiments illustrate the efficiency of our estimators.

math.PR↗

James-Stein estimation of the first principal component

The Stein paradox has played an influential role in the field of high dimensional statistics. This result warns that the sample mean, classically regarded as the "usual estimator", may be suboptimal in high dimensions. The development of the James-Stein estimator, that addresses this paradox, has by now inspired a large literature on the theme of "shrinkage" in statistics. In this direction, we develop a James-Stein type estimator for the first principal component of a high dimension and low sample size data set. This estimator shrinks the usual estimator, an eigenvector of a sample covariance matrix under a spiked covariance model, and yields superior asymptotic guarantees. Our derivation draws a close connection to the original James-Stein formula so that the motivation and recipe for shrinkage is intuited in a natural way.

math.ST↗

The Dispersion Bias

Estimation error has plagued quantitative finance since Harry Markowitz launched modern portfolio theory in 1952. Using random matrix theory, we characterize a source of bias in the sample eigenvectors of financial covariance matrices. Unchecked, the bias distorts weights of minimum variance portfolios and leads to risk forecasts that are severely biased downward. To address these issues, we develop an eigenvector bias correction. Our approach is distinct from the regularization and eigenvalue shrinkage methods found in the literature. We provide theoretical guarantees on the improvement our correction provides as well as estimation methods for computing the optimal correction from data.

stat.ME↗