Inference on Directionally Differentiable Functions

Abstract

This paper studies an asymptotic framework for conducting inference on parameters of the form $ϕ(θ_0)$, where $ϕ$ is a known directionally differentiable function and $θ_0$ is estimated by $\hat θ_n$. In these settings, the asymptotic distribution of the plug-in estimator $ϕ(\hat θ_n)$ can be readily derived employing existing extensions to the Delta method. We show, however, that the "standard" bootstrap is only consistent under overly stringent conditions -- in particular we establish that differentiability of $ϕ$ is a necessary and sufficient condition for bootstrap consistency whenever the limiting distribution of $\hat θ_n$ is Gaussian. An alternative resampling scheme is proposed which remains consistent when the bootstrap fails, and is shown to provide local size control under restrictions on the directional derivative of $ϕ$. We illustrate the utility of our results by developing a test of whether a Hilbert space valued parameter belongs to a convex set -- a setting that includes moment inequality problems and certain tests of shape restrictions as special cases.