Higher-order accuracy of multiscale-double bootstrap for testing regions

Abstract

We consider hypothesis testing for the null hypothesis being represented as an arbitrary-shaped region in the parameter space. We compute an approximate p-value by counting how many times the null hypothesis holds in bootstrap replicates. This frequency, known as bootstrap probability, is widely used in evolutionary biology, but often reported as biased in the literature. Based on the asymptotic theory of bootstrap confidence intervals, there have been some new attempts for adjusting the bias via bootstrap probability without direct access to the parameter value. One such an attempt is the double bootstrap which adjusts the bias by bootstrapping the bootstrap probability. Another new attempt is the multiscale bootstrap which is similar to the m-out-of-n bootstrap but very unusually extrapolating the bootstrap probability to $m=-n$. In this paper, we employ these two attempts at the same time, and call the new procedure as multiscale-double bootstrap. By focusing on the multivariate normal model, we investigate higher-order asymptotics up to fourth-order accuracy. Geometry of the region plays important roles in the asymptotic theory. It was known in the literature that the curvature of the boundary surface of the region determines the bias of bootstrap probability. We found out that the curvature-of-curvature determines the remaining bias of double bootstrap. The multiscale bootstrap removes these biases. The multiscale-double bootstrap is fourth order accurate with coverage probability erring only $O(n^{-2})$, and it is robust against computational error of parameter estimation used for generating bootstrap replicates from the null distribution.