SearcharxivSearch

arXiv subjects

Thomas Verdebout

Publications and source records attributed to Thomas Verdebout.

At least 19 recordsLinked to original sources

High-dimensional Sobolev tests on hyperspheres

We derive the limit null distribution of the class of Sobolev tests of uniformity on the hypersphere as the dimension and the sample size diverge to infinity at arbitrary rates. The limiting non-null behavior of these tests is also explored: (i) a general consistency result for Sobolev tests in high dimensions is shown and (ii) the asymptotic power of the tests under sequences of integrated von Mises-Fisher local alternatives is obtained. The asymptotic results are applied to test for high-dimensional rotational symmetry and spherical symmetry. Numerical experiments illustrate the derived behavior of the uniformity and spherical symmetry tests under the null and under local and fixed alternatives. A real data application tests the high-dimensional normality of the cosmic microwave background.

math.ST

Nonparametric Measure-Transportation-Based Methods for Directional Data

This paper proposes various nonparametric tools based on measure transportation for directional data. We use optimal transports to define new notions of distribution and quantile functions on the hypersphere, with meaningful quantile contours and regions and closed-form formulas under the classical assumption of rotational symmetry. The empirical versions of our distribution functions enjoy the expected Glivenko-Cantelli property of traditional distribution functions. They provide fully distribution-free concepts of ranks and signs and define data-driven systems of (curvilinear) parallels and (hyper)meridians. Based on this, we also construct a universally consistent test of uniformity and a class of fully distribution-free and universally consistent tests for directional MANOVA which, in simulations, outperform all their existing competitors. A real-data example involving the analysis of sunspots concludes the paper.

math.ST

On a class of Sobolev tests for symmetry of directions, their detection thresholds, and asymptotic powers

We consider a class of symmetry hypothesis testing problems including testing isotropy on $\mathbb{R}^d$ and testing rotational symmetry on the hypersphere $\mathcal{S}^{d-1}$. For this class, we study the null and non-null behaviors of Sobolev tests, with emphasis on their consistency rates. Our main results show that: (i) Sobolev tests exhibit a detection threshold (see Bhattacharya, 2019, 2020) that does not only depend on the coefficients defining these tests; and (ii) tests with non-zero coefficients at odd (respectively, even) ranks only are blind to alternatives with angular functions whose $k$th-order derivatives at zero vanish for any $k$ odd (even). Our non-standard asymptotic results are illustrated with Monte Carlo exercises. A case study in astronomy applies the testing toolbox to evaluate the symmetry of orbits of long- and short-period comets.

math.ST

Nonparametric tests of independence for circular data based on trigonometric moments

We introduce nonparametric tests of independence for bivariate circular data based on trigonometric moments. Our contributions lie in (i) proposing nonparametric tests that are locally and asymptotically optimal against bivariate cosine von Mises alternatives and (ii) extending these tests, via the empirical characteristic function, to obtain consistent tests against broader sets of alternatives, eventually being omnibus. We thus provide a collection of trigonometric-based tests of varying generality and known optimalities. The large-sample behaviours of the tests under the null and alternative hypotheses are obtained, while simulations show that the new tests are competitive against previous proposals. Two data applications in astronomy and forest science illustrate the usage of the tests.

stat.ME

On optimal tests for rotational symmetry against new classes of hyperspherical distributions

Motivated by the central role played by rotationally symmetric distributions in directional statistics, we consider the problem of testing rotational symmetry on the hypersphere. We adopt a semiparametric approach and tackle problems where the location of the symmetry axis is either specified or unspecified. For each problem, we define two tests and study their asymptotic properties under very mild conditions. We introduce two new classes of directional distributions that extend the rotationally symmetric class and are of independent interest. We prove that each test is locally asymptotically maximin, in the Le Cam sense, for one kind of the alternatives given by the new classes of distributions, both for specified and unspecified symmetry axis. The tests, aimed to detect location-like and scatter-like alternatives, are combined into convenient hybrid tests that are consistent against both alternatives. We perform Monte Carlo experiments that illustrate the finite-sample performances of the proposed tests and their agreement with the asymptotic results. Finally, the practical relevance of our tests is illustrated on a real data application from astronomy. The R package rotasym implements the proposed tests and allows practitioners to reproduce the data application.

stat.ME

On the power of axial tests of uniformity on spheres

Testing uniformity on the $p$-dimensional unit sphere is arguably the most fundamental problem in directional statistics. In this paper, we consider this problem in the framework of axial data, that is, under the assumption that the $n$ observations at hand are randomly drawn from a distribution that charges antipodal regions equally. More precisely, we focus on axial, rotationally symmetric, alternatives and first address the problem under which the direction $θ$ of the corresponding symmetry axis is specified. In this setup, we obtain Le Cam optimal tests of uniformity, that are based on the sample covariance matrix (unlike their non-axial analogs, that are based on the sample average). For the more important unspecified-$θ$ problem, some classical tests are available in the literature, but virtually nothing is known on their non-null behavior. We therefore study the non-null behavior of the celebrated Bingham test and of other tests that exploit the single-spiked nature of the considered alternatives. We perform Monte Carlo exercises to investigate the finite-sample behavior of our tests and to show their agreement with our asymptotic results.

math.ST

Sign tests for weak principal directions

We consider inference on the first principal direction of a $p$-variate elliptical distribution. We do so in challenging double asymptotic scenarios for which this direction eventually fails to be identifiable. In order to achieve robustness not only with respect to such weak identifiability but also with respect to heavy tails, we focus on sign-based statistical procedures, that is, on procedures that involve the observations only through their direction from the center of the distribution. We actually consider the generic problem of testing the null hypothesis that the first principal direction coincides with a given direction of $\mathbb{R}^p$. We first focus on weak identifiability setups involving single spikes (that is, involving spectra for which the smallest eigenvalue has multiplicity $p-1$). We show that, irrespective of the degree of weak identifiability, such setups offer local alternatives for which the corresponding sequence of statistical experiments converges in the Le Cam sense. Interestingly, the limiting experiments depend on the degree of weak identifiability. We exploit this convergence result to build optimal sign tests for the problem considered. In classical asymptotic scenarios where the spectrum is fixed, these tests are shown to be asymptotically equivalent to the sign-based likelihood ratio tests available in the literature. Unlike the latter, however, the proposed sign tests are robust to arbitrarily weak identifiability. We show that our tests meet the asymptotic level constraint irrespective of the structure of the spectrum, hence also in possibly multi-spike setups. We fully characterize the non-null asymptotic distributions of the corresponding test statistics under weak identifiability, which allows us to quantify the corresponding local asymptotic powers.

math.ST

Preliminary test estimation in ULAN models

Preliminary test estimation, which is a natural procedure when it is suspected a priori that the parameter to be estimated might take value in a submodel of the model at hand, is a classical topic in estimation theory. In the present paper, we establish general results on the asymptotic behavior of preliminary test estimators. More precisely, we show that, in uniformly locally asymptotically normal (ULAN) models, a general asymptotic theory can be derived for preliminary test estimators based on estimators admitting generic Bahadur-type representations. This allows for a detailed comparison between classical estimators and preliminary test estimators in ULAN models. Our results, that, in standard linear regression models, are shown to reduce to some classical results, are also illustrated in more modern and involved setups, such as the multisample one where $m$ covariance matrices ${\pmbΣ}_1, \ldots, {\pmbΣ}_m$ are to be estimated when it is suspected that these matrices might be equal, might be proportional, or might share a common "scale". Simulation results confirm our theoretical findings.

math.ST

Inference for spherical location under high concentration

Motivated by the fact that circular or spherical data are often much concentrated around a location $\pmbθ$, we consider inference about $\pmbθ$ under "high concentration" asymptotic scenarios for which the probability of any fixed spherical cap centered at $\pmbθ$ converges to one as the sample size $n$ diverges to infinity. Rather than restricting to Fisher-von Mises-Langevin distributions, we consider a much broader, semiparametric, class of rotationally symmetric distributions indexed by the location parameter $\pmbθ$, a scalar concentration parameter $κ$ and a functional nuisance $f$. We determine the class of distributions for which high concentration is obtained as $κ$ diverges to infinity. For such distributions, we then consider inference (point estimation, confidence zone estimation, hypothesis testing) on $\pmbθ$ in asymptotic scenarios where $κ_n$ diverges to infinity at an arbitrary rate with the sample size $n$. Our asymptotic investigation reveals that, interestingly, optimal inference procedures on $\pmbθ$ show consistency rates that depend on $f$. Using asymptotics "à la Le Cam", we show that the spherical mean is, at any $f$, a parametrically super-efficient estimator of $\pmbθ$ and that the Watson and Wald tests for $\mathcal{H}_0:{\pmbθ}={\pmbθ}_0$ enjoy similar, non-standard, optimality properties. We illustrate our results through simulations and treat a real data example. On a technical point of view, our asymptotic derivations require challenging expansions of rotationally symmetric functionals for large arguments of $f$.

math.ST

Detecting the direction of a signal on high-dimensional spheres: Non-null and Le Cam optimality results

We consider one of the most important problems in directional statistics, namely the problem of testing the null hypothesis that the spike direction $θ$ of a Fisher-von Mises-Langevin distribution on the $p$-dimensional unit hypersphere is equal to a given direction $θ_0$. After a reduction through invariance arguments, we derive local asymptotic normality (LAN) results in a general high-dimensional framework where the dimension $p_n$ goes to infinity at an arbitrary rate with the sample size $n$, and where the concentration $κ_n$ behaves in a completely free way with $n$, which offers a spectrum of problems ranging from arbitrarily easy to arbitrarily challenging ones. We identify various asymptotic regimes, depending on the convergence/divergence properties of $(κ_n)$, that yield different contiguity rates and different limiting experiments. In each regime, we derive Le Cam optimal tests under specified $κ_n$ and we compute, from the Le Cam third lemma, asymptotic powers of the classical Watson test under contiguous alternatives. We further establish LAN results with respect to both spike direction and concentration, which allows us to discuss optimality also under unspecified $κ_n$. To investigate the non-null behavior of the Watson test outside the parametric framework above, we derive its local asymptotic powers through martingale CLTs in the broader, semiparametric, model of rotationally symmetric distributions. A Monte Carlo study shows that the finite-sample behaviors of the various tests remarkably agree with our asymptotic results.

math.ST

Testing for Principal Component Directions under Weak Identifiability

We consider the problem of testing, on the basis of a $p$-variate Gaussian random sample, the null hypothesis ${\cal H}_0: {\pmb θ}_1= {\pmb θ}_1^0$ against the alternative ${\cal H}_1: {\pmb θ}_1 \neq {\pmb θ}_1^0$, where ${\pmb θ}_1$ is the "first" eigenvector of the underlying covariance matrix and ${\pmb θ}_1^0$ is a fixed unit $p$-vector. In the classical setup where eigenvalues $λ_1>λ_2\geq \ldots\geq λ_p$ are fixed, the Anderson (1963) likelihood ratio test (LRT) and the Hallin, Paindaveine and Verdebout (2010) Le Cam optimal test for this problem are asymptotically equivalent under the null hypothesis, hence also under sequences of contiguous alternatives. We show that this equivalence does not survive asymptotic scenarios where $λ_{n1}/λ_{n2}=1+O(r_n)$ with $r_n=O(1/\sqrt{n})$. For such scenarios, the Le Cam optimal test still asymptotically meets the nominal level constraint, whereas the LRT severely overrejects the null hypothesis. Consequently, the former test should be favored over the latter one whenever the two largest sample eigenvalues are close to each other. By relying on the Le Cam's asymptotic theory of statistical experiments, we study the non-null and optimality properties of the Le Cam optimal test in the aforementioned asymptotic scenarios and show that the null robustness of this test is not obtained at the expense of power. Our asymptotic investigation is extensive in the sense that it allows $r_n$ to converge to zero at an arbitrary rate. While we restrict to single-spiked spectra of the form $λ_{n1}>λ_{n2}=\ldots=λ_{np}$ to make our results as striking as possible, we extend our results to the more general elliptical case. Finally, we present an illustrative real data example.

math.ST

An overview of uniformity tests on the hypersphere

When modeling directional data, that is, unit-norm multivariate vectors, a first natural question is to ask whether the directions are uniformly distributed or, on the contrary, whether there exist modes of variation significantly different from uniformity. We review in this article a reasonably exhaustive collection of uniformity tests for assessing uniformity in the hypersphere. Specifically, we review the classical circular-specific tests, the large class of Sobolev tests with its many notable particular cases, some recent alternative tests, and novel results in the high-dimensional low-sample size case. A reasonably comprehensive bibliography on the topic is provided.

stat.ME

Optimal tests for circular reflective symmetry about an unknown central direction

Parametric and semiparametric tests of circular reflective symmetry about an unknown central direction are developed that are locally and asymptotically optimal in the Le Cam sense against asymmetric $k$-sine-skewed alternatives. The results from Monte Carlo studies comparing the rejection rates of tests with those of previously proposed tests lead to recommendations regarding the use of the various tests with small- to medium-sized samples. Analyses of data on the directions of cracks in cemented femoral components and the times of gun crimes in Pittsburgh illustrate the proposed methodology and its bootstrap extension.

stat.ME

Testing uniformity on high-dimensional spheres against monotone rotationally symmetric alternatives

We consider the problem of testing uniformity on high-dimensional unit spheres. We are primarily interested in non-null issues. We show that rotationally symmetric alternatives lead to two Local Asymptotic Normality (LAN) structures. The first one is for fixed modal location $θ$ and allows to derive locally asymptotically most powerful tests under specified $θ$. The second one, that addresses the Fisher-von Mises-Langevin (FvML) case, relates to the unspecified-$θ$ problem and shows that the high-dimensional Rayleigh test is locally asymptotically most powerful invariant. Under mild assumptions, we derive the asymptotic non-null distribution of this test, which allows to extend away from the FvML case the asymptotic powers obtained there from Le Cam's third lemma. Throughout, we allow the dimension $p$ to go to infinity in an arbitrary way as a function of the sample size $n$. Some of our results also strengthen the local optimality properties of the Rayleigh test in low dimensions. We perform a Monte Carlo study to illustrate our asymptotic results. Finally, we treat an application related to testing for sphericity in high dimensions.

math.ST

On high-dimensional sign tests

Sign tests are among the most successful procedures in multivariate nonparametric statistics. In this paper, we consider several testing problems in multivariate analysis, directional statistics and multivariate time series analysis, and we show that, under appropriate symmetry assumptions, the fixed-$p$ multivariate sign tests remain valid in the high-dimensional case. Remarkably, our asymptotic results are universal, in the sense that, unlike in most previous works in high-dimensional statistics, $p$ may go to infinity in an arbitrary way as $n$ does. We conduct simulations that (i) confirm our asymptotic results, (ii) reveal that, even for relatively large $p$, chi-square critical values are to be favoured over the (asymptotically equivalent) Gaussian ones and (iii) show that, for testing i.i.d.-ness against serial dependence in the high-dimensional case, Portmanteau sign tests outperform their competitors in terms of validity-robustness.

math.ST

Inference on the mode of weak directional signals: a Le Cam perspective on hypothesis testing near singularities

We revisit, in an original and challenging perspective, the problem of testing the null hypothesis that the mode of a directional signal is equal to a given value. Motivated by a real data example where the signal is weak, we consider this problem under asymptotic scenarios for which the signal strength goes to zero at an arbitrary rate~$η_n$. Both under the null and the alternative, we focus on rotationally symmetric distributions. We show that, while they are asymptotically equivalent under fixed signal strength, the classical Wald and Watson tests exhibit very different (null and non-null) behaviours when the signal becomes arbitrarily weak. To fully characterize how challenging the problem is as a function of~$η_n$, we adopt a Le Cam, convergence-of-statistical-experiments, point of view and show that the resulting limiting experiments crucially depend on~$η_n$. In the light of these results, the Watson test is shown to be \emph{adaptively} rate-consistent and essentially adaptively Le Cam optimal. Throughout, our theoretical findings are illustrated via Monte-Carlo simulations. The practical relevance of our results is also shown on the real data example that motivated the present work.

math.ST

High-dimensional tests for spherical location and spiked covariance

Rotationally symmetric distributions on the p-dimensional unit hypersphere, extremely popular in directional statistics, involve a location parameter theta that indicates the direction of the symmetry axis. The most classical way of addressing the spherical location problem H_0:theta=theta_0, with theta_0 a fixed location, is the so-called Watson test, which is based on the sample mean of the observations. This test enjoys many desirable properties, but its implementation requires the sample size n to be large compared to the dimension p. This is a severe limitation, since more and more problems nowadays involve high-dimensional directional data (e.g., in genetics or text mining). In this work, we therefore introduce a modified Watson statistic that can cope with high-dimensionality. We derive its asymptotic null distribution as both n and p go to infinity. This is achieved in a universal asymptotic framework that allows p to go to infinity arbitrarily fast (or slowly) as a function of n. We further show that our results also provide high-dimensional tests for a problem that has recently attracted much attention, namely that of testing that the covariance matrix of a multinormal distribution has a "theta_0-spiked" structure. Finally, a Monte Carlo simulation study corroborates our asymptotic results.

math.ST

On Hodges and Lehmann's "$6/π$ result"

While the asymptotic relative efficiency (ARE) of Wilcoxon rank-based tests for location and regression with respect to their parametric Student competitors can be arbitrarily large, Hodges and Lehmann (1961) have shown that the ARE of the same Wilcoxon tests with respect to their van der Waerden or normal-score counterparts is bounded from above by $6/π\approx 1.910$. In this paper, we revisit that result, and investigate similar bounds for statistics based on Student scores. We also consider the serial version of this ARE. More precisely, we study the ARE, under various densities, of the Spearman-Wald-Wolfowitz and Kendall rank-based autocorrelations with respect to the van der Waerden or normal-score ones used to test (ARMA) serial dependence alternatives.

math.ST