arXiv subjects

Andreas Anastasiou

Publications and source records attributed to Andreas Anastasiou.

23 records · Page 2Linked to original sources

arXiv2018

Assessing the multivariate normal approximation of the maximum likelihood estimator from high-dimensional, heterogeneous data

The asymptotic normality of the maximum likelihood estimator (MLE) under regularity conditions is a cornerstone of statistical theory. In this paper, we give explicit upper bounds on the distributional distance between the distribution of the MLE of a vector parameter, and the multivariate normal distribution. We work with possibly high-dimensional, independent but not necessarily identically distributed random vectors. In addition, we obtain explicit upper bounds even in cases where the MLE cannot be expressed analytically.

math.ST↗

arXiv2018

Bounds for the asymptotic distribution of the likelihood ratio

In this paper we give an explicit bound on the distance to chisquare for the likelihood ratio statistic when the data are realisations of independent and identically distributed random elements. To our knowledge this is the first explicit bound which is available in the literature. The bound depends on the number of samples as well as on the dimension of the parameter space. We illustrate the bound with three examples: samples from an exponential distribution, samples from a normal distribution, and logistic regression.

math.ST↗

arXiv2016

Bounds for the normal approximation of the maximum likelihood estimator

While the asymptotic normality of the maximum likelihood estimator under regularity conditions is long established, this paper derives explicit bounds for the bounded Wasserstein distance between the distribution of the maximum likelihood estimator (MLE) and the normal distribution. For this task, we employ Stein's method. We focus on independent and identically distributed random variables, covering both discrete and continuous distributions as well as exponential and non-exponential families. In particular, a closed form expression of the MLE is not required. We also use a perturbation method to treat cases where the MLE has positive probability of being on the boundary of the parameter space.

math.ST↗

arXiv2016

Bounds for the normal approximation of the maximum likelihood estimator from m-dependent random variables

The asymptotic normality of the Maximum Likelihood Estimator (MLE) is a long established result. Explicit bounds for the distributional distance between the distribution of the MLE and the normal distribution have recently been obtained for the case of independent random variables. In this paper, a local dependence structure is introduced between the random variables and we give upper bounds which are specified for the Wasserstein metric.

math.ST↗

arXiv2016

Bounds for the asymptotic normality of the maximum likelihood estimator using the Delta method

The asymptotic normality of the Maximum Likelihood Estimator (MLE) is a cornerstone of statistical theory. In the present paper, we provide sharp explicit upper bounds on Zolotarev-type distances between the exact, unknown distribution of the MLE and its limiting normal distribution. Our approach to this fundamental issue is based on a sound combination of the Delta method, Stein's method, Taylor expansions and conditional expectations, for the classical situations where the MLE can be expressed as a function of a sum of independent and identically distributed terms. This encompasses in particular the broad exponential family of distributions.

math.ST↗