SearcharxivSearch

arXiv subjects

Yongcheng Qi

Publications and source records attributed to Yongcheng Qi.

At least 19 recordsLinked to original sources

Joint Distributions of Minimum and Maximum Angles on High-Dimensional Spheres

Consider $n$ independent random vectors sampled from uniform distribution on $(p-1)$-dimensional unit sphere. This paper investigates the limiting joint distribution for the minimum and the maximum values of their pairwise angles. It proves that the minimum and the maximum angles are asymptotically independent when both $n$ and $p$ tend to infinity, which solves an open problem raised in Cai, Fan and Jiang (2013) [\emph{Journal of Machine Learning Research} 14, 1837-1864]. Cai, Fan and Jiang (2013) obtained the limiting marginal distributions for both the minimum and the maximum angles under assumption $\lim_{n\to\infty}{\ln n}/p=β$ according to whether $β=0$, $β\in (0,\infty)$, or $β=\infty$. This paper presents unified limits for both joint distributions and marginal distributions regardless of the relative divergence rate of $n$ and $p$. The paper also derives the limiting distributions for some statistics based on the minimum and the maximum angles,

math.ST

Maximum of sparsely equicorrelated Gaussian fields and applications

We investigate the extreme values of a sparse and equicorrelated Gaussian field on a triangle: the correlations on every vertical or horizontal line are all equal to a parameter $r \in [0,1/2]$ and are zero everywhere else. This problem is closely linked with various problems in high-dimensional statistics and extreme-value theory. We identify the threshold for $r$ at which the standard Gumbel law breaks down. Our result is based on a subtle application of the Chen-Stein method for Poisson approximation. As applications, we discuss the implication of our results on multiple testing and resolve several questions that were left open in \cite{heiny2024maximum}, \cite{tang2022asymptotic} and \cite{Jiang19}.

math.PR

Eigenvalues of Product of Ginibre Ensembles and Their Inverses and that of Truncated Haar Unitary Matrices and Their Inverses

Consider two types of products of independent random matrices, including products of Ginibre matrices and inverse Ginibre matrices and products of truncated Haar unitary matrices and inverse truncated Haar matrices. Each product matrix has $m$ multiplicands of $n$ by $n$ square matrices, and the empirical distribution based on the $n$ eigenvalues of the product matrix is called empirical spectral distribution of the matrix. In this paper, we investigate the limiting empirical spectral distribution of the product matrices when $n$ tends to infinity and $m$ changes with $n$. For properly scaled eigenvalues for two types of the product matrices, we obtain the necessary and sufficient conditions for the convergence of the empirical spectral distributions.

math.PR

Some results on probabilities of moderate deviations

Let $\{X, X_{n}; n \geq 1\}$ be a sequence of i.i.d. non-degenerate real-valued random variables with $\mathbb{E}X^{2} < \infty$. Let $S_{n} = \sum_{i=1}^{n} X_{i}$, $n \geq 1$. Let $g(\cdot): ~[0, \infty) \rightarrow [0, \infty)$ be a nondecreasing regularly varying function with index $ρ\geq 0$ and $\lim_{t \rightarrow \infty} g(t) = \infty$. Let $μ= \mathbb{E}X$ and $σ^{2} = \mathbb{E}(X - μ)^{2}$. In this paper, on the scale $g(\log n)$, we obtain precise asymptotic estimates for the probabilities of moderate deviations of the form $\displaystyle \log \mathbb{P}\left(S_{n} - n μ> x \sqrt{ng(\log n)} \right)$, $\displaystyle \log \mathbb{P}\left(S_{n} - n μ< -x \sqrt{ng(\log n)} \right)$, and $\displaystyle \log \mathbb{P}\left(\left|S_{n} - n μ\right| > x \sqrt{ng(\log n)} \right)$ for all $x > 0$. Unlike those known results in the literature, the moderate deviation results established in this paper depend on both the variance and the asymptotic behavior of the tail distribution of $X$.

math.PR

A Simplified Condition For Quantile Regression

Quantile regression is effective in modeling and inferring the conditional quantile given some predictors and has become popular in risk management due to wide applications of quantile-based risk measures. When forecasting risk for economic and financial variables, quantile regression has to account for heteroscedasticity, which raises the question of whether the identification condition on residuals in quantile regression is equivalent to one independent of heteroscedasticity. In this paper, we present some identification conditions under three probability models and use them to establish simplified conditions in quantile regression.

math.ST

Largest Eigenvalues of Principal Minors of Deformed Gaussian Orthogonal Ensembles and Wishart Matrices

Consider a high-dimensional Wishart matrix $\bd{W}=\bd{X}^T\bd{X}$ where the entries of $\bd{X}$ are i.i.d. random variables with mean zero, variance one, and a finite fourth moment $η$. Motivated by problems in signal processing and high-dimensional statistics, we study the maximum of the largest eigenvalues of any two-by-two principal minors of $\bd{W}$. Under certain restrictions on the sample size and the population dimension of $\bd{W}$, we obtain the limiting distribution of the maximum, which follows the Gumbel distribution when $η$ is between 0 and 3, and a new distribution when $η$ exceeds 3. To derive this result, we first address a simpler problem on a new object named a deformed Gaussian orthogonal ensemble (GOE). The Wishart case is then resolved using results from the deformed GOE and a high-dimensional central limit theorem. Our proof strategy combines the Stein-Poisson approximation method, conditioning, U-statistics, and the Hájek projection. This method may also be applicable to other extreme-value problems. Some open questions are posed.

math.PR

Inference of high quantiles of a heavy-tailed distribution from block data

In this paper we consider the estimation problem for high quantiles of a heavy-tailed distribution from block data when only a few largest values are observed within blocks. We propose estimators for high quantiles and prove that these estimators are asymptotically normal. Furthermore, we employ empirical likelihood method and adjusted empirical likelihood method to constructing the confidence intervals of high quantiles. Through a simulation study we also compare the performance of the normal approximation method and the adjusted empirical likelihood methods in terms of the coverage probability and length of the confidence intervals.

math.ST

Asymptotic Distributions for Likelihood Ratio Tests for the Equality of Covariance Matrices

Consider $k$ independent random samples from $p$-dimensional multivariate normal distributions. We are interested in the limiting distribution of the log-likelihood ratio test statistics for testing for the equality of $k$ covariance matrices. It is well known from classical multivariate statistics that the limit is a chi-square distribution when $k$ and $p$ are fixed integers. Jiang and Yang~\cite{JY13} and Jiang and Qi~\cite{JQ15} have obtained the central limit theorem for the log-likelihood ratio test statistics when the dimensionality $p$ goes to infinity with the sample sizes. In this paper, we derive the central limit theorem when either $p$ or $k$ goes to infinity. We also propose adjusted test statistics which can be well approximated by chi-squared distributions regardless of values for $p$ and $k$. Furthermore, we present numerical simulation results to evaluate the performance of our adjusted test statistics and the log-likelihood ratio statistics based on classical chi-square approximation and the normal approximation.

math.ST

Limiting distributions of the likelihood ratio test statistics for independence of normal random vectors

Consider the likelihood ratio test (LRT) statistics for the independence of sub-vectors from a $p$-variate normal random vector. We are devoted to deriving the limiting distributions of the LRT statistics based on a random sample of size $n$. It is well known that the limit is chi-square distribution when the dimension of the data or the number of the parameters are fixed. In a recent work by Qi, Wang and Zhang (Ann Inst Stat Math (2019) 71: 911--946), it was shown that the LRT statistics are asymptotically normal under condition that the lengths of the normal random sub-vectors are relatively balanced if the dimension $p$ goes to infinity with the sample size $n$. In this paper, we investigate the limiting distributions of the LRT statistic under general conditions. We find out all types of limiting distributions and obtain the necessary and sufficient conditions for the LRT statistic to converge to a normal distribution when $p$ goes to infinity. We also investigate the limiting distribution of the adjusted LRT test statistic proposed in Qi, Wang and Zhang (2019). Moreover, we present simulation results to compare the performance of classical chi-square approximation, normal and non-normal approximation to the LRT statistics, chi-square approximation to the adjusted test statistic, and some other test statistics.

math.ST

Spectral Radii of Products of Random Rectangular Matrices

We consider m independent random rectangular matrices whose entries are independent and identically distributed standard complex Gaussian random variables. Assume the product of the m rectangular matrices is an n by n square matrix. The maximum absolute values of the n eigenvalues of the product matrix is called spectral radius. In this paper, we study the limiting spectral radii of the product when m changes with n and can even diverge. We give a complete description for the limiting distribution of the spectral radius. Our results reduce to those in Jiang and Qi [26] when the rectangular matrices are square ones.

math.PR

Empirical likelihood method for complete independence test on high dimensional data

Given a random sample of size $n$ from a $p$ dimensional random vector, where both $n$ and $p$ are large, we are interested in testing whether the $p$ components of the random vector are mutually independent. This is the so-called complete independence test. In the multivariate normal case, it is equivalent to testing whether the correlation matrix is an identity matrix. In this paper, we propose a one-sided empirical likelihood method for the complete independence test for multivariate normal data based on squared sample correlation coefficients. The limiting distribution for our one-sided empirical likelihood test statistic is proved to be $Z^2I(Z>0)$ when both $n$ and $p$ tend to infinity, where $Z$ is a standard normal random variable. In order to improve the power of the empirical likelihood test statistic, we also introduce a rescaled empirical likelihood test statistic. We carry out an extensive simulation study to compare the performance of the rescaled empirical likelihood method and two other statistics which are related to the sum of squared sample correlation coefficients.

math.ST

Pearson's goodness-of-fit tests for sparse distributions

Pearson's chi-squared test is widely used to test the goodness of fit between categorical data and a given discrete distribution function. When the number of sets of the categorical data, say $k$, is a fixed integer, Pearson's chi-squared test statistic converges in distribution to a chi-squared distribution with $k-1$ degrees of freedom when the sample size $n$ goes to infinity. In real applications, the number $k$ often changes with $n$ and may be even much larger than $n$. By using the martingale techniques, we prove that Pearson's chi-squared test statistic converges to the normal under quite general conditions. We also propose a new test statistic which is more powerful than chi-squared test statistic based on our simulation study. A real application to lottery data is provided to illustrate our methodology.

stat.ME

Limiting Empirical Spectral Distribution for Products of Rectangular Matrices

In this paper, we consider $m$ independent random rectangular matrices whose entries are independent and identically distributed standard complex Gaussian random variables and assume the product of the $m$ rectangular matrices is an $n$ by $n$ square matrix. We study the limiting empirical spectral distributions of the product where the dimension of the product matrix goes to infinity, and $m$ may change with the dimension of the product matrix and diverge. We give a complete description for the limiting distribution of the empirical spectral distributions for the product matrix and illustrate some examples.

math.PR

Limiting Spectral Radii of Circular Unitary Matrices under Light Truncation

Consider a truncated circular unitary matrix which is a $p_n$ by $p_n$ submatrix of an $n$ by $n$ circular unitary matrix after deleting the last $n-p_n$ columns and rows. Jiang and Qi \cite{JiangQi2017} and Gui and Qi \cite{GQ2018} study the limiting distributions of the maximum absolute value of the eigenvalues (known as spectral radius) of the truncated matrix. Some limiting distributions for the spectral radius for the truncated circular unitary matrix have been obtained under the following conditions: (1). $p_n/n$ is bounded away from $0$ and $1$; (2). $p_n\to\infty$ and $p_n/n\to 0$ as $n\to\infty$; (3). $(n-p_n)/n\to 0$ and $(n-p_n)/(\log n)^3\to\infty$ as $n\to\infty$; (4). $n-p_n\to\infty$ and $(n-p_n)/\log n\to 0$ as $n\to\infty$; and (5). $n-p_n=k\ge 1$ is a fixed integer. The spectral radius converges in distribution to the Gumbel distribution under the first four conditions and to a reversed Weibull distribution under the fifth condition. Apparently, the conditions above do not cover the case when $n-p_n$ is of order between $\log n$ and $(\log n)^3$. In this paper, we prove that the spectral radius converges in distribution to the Gumbel distribution as well in this case, as conjectured by Gui and Qi \cite{GQ2018}.

math.PR

Adjusted Empirical Likelihood Method for the Tail Index of A Heavy-Tailed Distribution

Empirical likelihood is a well-known nonparametric method in statistics and has been widely applied in statistical inference. The method has been employed by Lu and Peng (2002) to constructing confidence intervals for the tail index of a heavy-tailed distribution. It is demonstrated in Lu and Peng (2002) that the empirical likelihood-based confidence intervals performs better than confidence intervals based on normal approximation in terms of the coverage probability. In general, the empirical likelihood method can be hindered by its imprecision in the coverage probability when the sample size is small. This may cause a serious undercoverage issue when we apply the empirical likelihood to the tail index as only a very small portion of observations can be used in the estimation of the tail index. In this paper, we employ an adjusted empirical likelihood method, developed by Chen et al. (2008) and Liu and Chen (2010), to constructing confidence intervals of the tail index so as to achieve a better accuracy. We conduct a simulation study to compare the performance of the adjusted empirical likelihood method and the normal approximation method. Our simulation results indicate that the adjusted empirical likelihood method outperforms other methods in terms of the coverage probability and length of confidence intervals. We also apply the adjusted empirical likelihood method to a real data set.

stat.ME

Limiting Distributions of Spectral Radii for Product of Matrices from the Spherical Ensemble

Consider the product of $m$ independent $n\times n$ random matrices from the spherical ensemble for $m\ge 1$. The spectral radius is defined as the maximum absolute value of the $n$ eigenvalues of the product matrix. When $m=1$, the limiting distribution for the spectral radii has been obtained by Jiang and Qi (2017). In this paper, we investigate the limiting distributions for the spectral radii in general. When $m$ is a fixed integer, we show that the spectral radii converge weakly to distributions of functions of independent Gamma random variables. When $m=m_n$ tends to infinity as $n$ goes to infinity, we show that the logarithmic spectral radii have a normal limit.

math.ST

Empirical Distributions of Eigenvalues of Product Ensembles

Assume a finite set of complex random variables form a determinantal point process, we obtain a theorem on the limit of the empirical distribution of these random variables. The result is applied to %We study the limits of the empirical distributions of the eigenvalues of two types of $n$ by $n$ random matrices as $n$ goes to infinity. The first one is the product of $m$ i.i.d. (complex) Ginibre ensembles, and the second one is the product of truncations of $m$ independent Haar unitary matrices with sizes $n_j\times n_j$ for $1\leq j \leq m$. Assuming $m$ depends on $n$, by using the special structures of the eigenvalues we developed, explicit limits of spectral distributions are obtained regardless of the speed of $m$ compared to $n$. For the product of $m$ Ginibre ensembles, as $m$ is fixed, the limiting distribution is known by various authors, e.g., Götze and Tikhomirov (2010), Bordenave (2011), O'Rourke and Soshnikov (2011) and O'Rourke {\it et al}. (2014). Our results hold for any $m\geq 1$ which may depend on $n$. For the product of truncations of Haar-invariant unitary matrices, we show a rich feature of the limiting distribution as $n_j/n$'s vary. In addition, some general results on arbitrary rotation-invariant determinantal point processes are also derived. Especially, we obtain an inequality for the fourth moment of linear statistics of complex random variables forming a determinantal point process. This inequality is known for the complex Ginibre ensemble only [Hwang (1986)]. Our method is the determinantal point process rather than the contour integral by Hwang.

math.PR

Spectral Radii of Truncated Circular Unitary Matrices

Consider a truncated circular unitary matrix which is a $p_n$ by $p_n$ submatrix of an $n$ by $n$ circular unitary matrix by deleting the last $n-p_n$ columns and rows. Jiang and Qi (2017) proved that the maximum absolute value of the eigenvalues (known as spectral radius) of the truncated matrix, after properly normalized, converges in distribution to the Gumbel distribution if $p_n/n$ is bounded away from $0$ and $1$. In this paper we investigate the limiting distribution of the spectral radius under one of the following four conditions: (1). $p_n\to\infty$ and $p_n/n\to 0$ as $n\to\infty$; (2). $(n-p_n)/n\to 0$ and $(n-p_n)/(\log n)^3\to\infty$ as $n\to\infty$; (3). $n-p_n\to\infty$ and $(n-p_n)/\log n\to 0$ as $n\to\infty$ and (4). $n-p_n=k\ge 1$ is a fixed integer. We prove that the spectral radius converges in distribution to the Gumbel distribution under the first three conditions and to a reversed Weibull distribution under the fourth condition.

math.ST