Searcharxiv⌕ Search

arXiv subjects

Robert E. Gaunt

Publications and source records attributed to Robert E. Gaunt.

At least 55 records · Page 3Linked to original sources

Comparing directed networks via denoising graphlet distributions

Network comparison is a widely-used tool for analyzing complex systems, with applications in varied domains including comparison of protein interactions or highlighting changes in structure of trade networks. In recent years, a number of network comparison methodologies based on the distribution of graphlets (small connected network subgraphs) have been introduced. In particular, NetEmd has recently achieved state of the art performance in undirected networks. In this work, we propose an extension of NetEmd to directed networks and deal with the significant increase in complexity of graphlet structure in the directed case by denoising through linear projections. Simulation results show that our framework is able to improve on the performance of a simple translation of the undirected NetEmd algorithm to the directed case, especially when networks differ in size and density.

cs.SI↗

The variance-gamma ratio distribution

Let $X$ and $Y$ be independent variance-gamma random variables with zero location parameter; then the exact probability density function of the ratio $X/Y$ is derived. Some basic distributional properties are also derived, including identification of parameter regimes under which the density is bounded, asymptotic approximations of tail probabilities, and fractional moments; in particular, we see that the mean is undefined. In the case that $X$ and $Y$ are independent symmetric variance-gamma random variables, an exact formula is also given for the cumulative distribution function of the ratio $X/Y$.

math.PR↗

Bounding Kolmogorov distances through Wasserstein and related integral probability metrics

We establish general upper bounds on the Kolmogorov distance between two probability distributions in terms of the distance between these distributions as measured with respect to the Wasserstein or smooth Wasserstein metrics. These bounds generalise existing results from the literature. To illustrate the broad applicability of our general bounds, we apply them to extract Kolmogorov distance bounds from multivariate normal, beta and variance-gamma approximations that have been established in the Stein's method literature.

math.PR↗

An asymptotic approach to proving sufficiency of Stein characterisations

In extending Stein's method to new target distributions, the first step is to find a Stein operator that suitably characterises the target distribution. In this paper, we introduce a widely applicable technique for proving sufficiency of these Stein characterisations, which can be applied when the Stein operators are linear differential operators with polynomial coefficients. The approach involves performing an asymptotic analysis to prove that only one characteristic function satisfies a certain differential equation associated to the Stein characterisation. We use this approach to prove that all Stein operators with linear coefficients characterise their target distribution, and verify on a case-by-case basis that all polynomial Stein operators in the literature with coefficients of degree at most two are characterising. For $X$ denoting a standard Gaussian random variable and $H_p$ the $p$-th Hermite polynomial, we also prove, amongst other examples, that the Stein operators for $H_p(X)$, $p=3,4,\ldots,8$, with coefficients of minimal possible degree characterise their target distribution, and that the Stein operators for the products of $p=3,4,\ldots,8$ independent standard Gaussian random variables are characterising (in both settings the Stein operators for the cases $p=1,2$ are already known to be characterising). We leverage our Stein characterisations of $H_3(X)$ and $H_4(X)$ to derive characterisations of these target distributions in terms of iterated Gamma operators from Malliavin calculus, that are natural in the context of the Malliavin-Stein method.

math.PR↗

Improved bounds in Stein's method for functions of multivariate normal random vectors

In a recent paper, Gaunt 2020 extended Stein's method to limit distributions that can be represented as a function $g:\mathbb{R}^d\rightarrow\mathbb{R}$ of a centered multivariate normal random vector $Σ^{1/2}\mathbf{Z}$ with $\mathbf{Z}$ a standard $d$-dimensional multivariate normal random vector and $Σ$ a non-negative definite covariance matrix. In this paper, we obtain improved bounds, in the sense of weaker moment conditions, smaller constants and simpler forms, for the case that $g$ has derivatives with polynomial growth. We obtain new non-uniform bounds for the derivatives of the solution of the Stein equation and use these inequalities to obtain general bounds on the distance, measured using smooth test functions, between the distributions of $g(\mathbf{W}_n)$ and $g(\mathbf{Z})$, where $\mathbf{W}_n$ is a standardised sum of random vectors with independent components and $\mathbf{Z}$ is a standard $d$-dimensional multivariate normal random vector. We apply these general bounds to obtain bounds for the chi-square approximation of the family of power divergence statistics (special cases include the Pearson and likelihood ratio statistics), for the case of two cell classifications, that improve on existing results in the literature.

math.PR↗

Bounds for the chi-square approximation of Friedman's statistic by Stein's method

Friedman's chi-square test is a non-parametric statistical test for $r\geq2$ treatments across $n\ge1$ trials to assess the null hypothesis that there is no treatment effect. We use Stein's method with an exchangeable pair coupling to derive an explicit bound on the distance between the distribution of Friedman's statistic and its limiting chi-square distribution, measured using smooth test functions. Our bound is of the optimal order $n^{-1}$, and also has an optimal dependence on the parameter $r$, in that the bound tends to zero if and only if $r/n\rightarrow0$. From this bound, we deduce a Kolmogorov distance bound that decays to zero under the weaker condition $r^{1/2}/n\rightarrow0$.

math.ST↗

Stein's Method Meets Computational Statistics: A Review of Some Recent Developments

Stein's method compares probability distributions through the study of a class of linear operators called Stein operators. While mainly studied in probability and used to underpin theoretical statistics, Stein's method has led to significant advances in computational statistics in recent years. The goal of this survey is to bring together some of these recent developments and, in doing so, to stimulate further research into the successful field of Stein's method and statistics. The topics we discuss include tools to benchmark and compare sampling methods such as approximate Markov chain Monte Carlo, deterministic alternatives to sampling methods, control variate techniques, parameter estimation and goodness-of-fit testing.

stat.ME↗

Stein factors for variance-gamma approximation in the Wasserstein and Kolmogorov distances

We obtain new bounds for the solution of the variance-gamma (VG) Stein equation that are of the correct form for approximations in terms of the Wasserstein and Kolmorogorov metrics. These bounds hold for all parameters values of the four parameter VG class. As an application we obtain explicit Wasserstein and Kolmogorov distance error bounds in a six moment theorem for VG approximation of double Wiener-Itô integrals.

math.PR↗

Bounds for an integral involving the modified Lommel function of the first kind

Simple upper and lower bounds are established for the integral $\int_0^x\mathrm{e}^{-βu}u^νt_{μ,ν}(u)\,\mathrm{d}u$, where $x>0$, $0<β<1$, $μ+ν>-2$, $μ-ν\geq-3$, and $t_{μ,ν}(x)$ is the modified Lommel function of the first kind. Our bounds complement and improve on existing bounds for this integral, by either being sharper or increasing the range of validity. Our bounds also generalise recent bounds for an integral involving the modified Struve function of the first kind, and in some cases more a direct approach lead to sharper bounds when our general bounds are specialised to the modified Struve case.

math.CA↗

The basic distributional theory for the product of zero mean correlated normal random variables

The product of two zero mean correlated normal random variables, and more generally the sum of independent copies of such random variables, has received much attention in the statistics literature and appears in many application areas. However, many important distributional properties are yet to be recorded. This review paper fills this gap by providing the basic distributional theory for the sum of independent copies of the product of two zero mean correlated normal random variables. Properties covered include probability and cumulative distribution functions, generating functions, moments and cumulants, mode and median, Stein characterisations, representations in terms of other random variables, and a list of related distributions. We also review how the product of two zero mean correlated normal random variables arises naturally as a limiting distribution, with an example given for the distributional approximation of double Wiener-Itô integrals.

math.ST↗

On algebraic Stein operators for Gaussian polynomials

The first essential ingredient to build up Stein's method for a continuous target distribution is to identify a so-called \textit{Stein operator}, namely a linear differential operator with polynomial coefficients. In this paper, we introduce the notion of \textit{algebraic} Stein operators (see Definition \ref{def:algebraic-Stein-Operator}), and provide a novel algebraic method to find \emph{all} the algebraic Stein operators up to a given order and polynomial degree for a target random variable of the form $Y=h(X)$, where $X=(X_1,\dots, X_d)$ has i.i.d$.$ standard Gaussian components and $h\in \mathbb{K}[X]$ is a polynomial with coefficients in the ring $\mathbb{K}$. Our approach links the existence of an algebraic Stein operator with \textit{null controllability} of a certain linear discrete system. A \texttt{MATLAB} code checks the null controllability up to a given finite time $T$ (the order of the differential operator), and provides all \textit{null control} sequences (polynomial coefficients of the differential operator) up to a given maximum degree $m$. This is the first paper that connects Stein's method with computational algebra to find Stein operators for highly complex probability distributions, such as $H_{20}(X_1)$, where $H_p$ is the $p$-th Hermite polynomial. Some examples of Stein operators for $H_p(X_1)$, $p=3,4,5,6$, are gathered in the Appendix and many other examples are given in the Supplementary Information.

math.PR↗

Bounds for the chi-square approximation of the power divergence family of statistics

It is well-known that each statistic in the family of power divergence statistics, across $n$ trials and $r$ classifications with index parameter $λ\in\mathbb{R}$ (the Pearson, likelihood ratio and Freeman-Tukey statistics correspond to $λ=1,0,-1/2$, respectively) is asymptotically chi-square distributed as the sample size tends to infinity. In this paper, we obtain explicit bounds on this distributional approximation, measured using smooth test functions, that hold for a given finite sample $n$, and all index parameters ($λ>-1$) for which such finite sample bounds are meaningful. We obtain bounds that are of the optimal order $n^{-1}$. The dependence of our bounds on the index parameter $λ$ and the cell classification probabilities is also optimal, and the dependence on the number of cells is also respectable. Our bounds generalise, complement and improve on recent results from the literature.

math.ST↗

Functional inequalities and monotonicity results for modified Lommel functions of the first kind

We establish some monotonicity results and functional inequalities for modified Lommel functions of the first kind. In particular, we obtain new Turán type inequalities and bounds for ratios of modified Lommel functions of the first kind, as well as the function itself. These results complement and in some cases improve on existing results, and also generalise a number of the results from the literature on monotonicity patterns and functional inequalities for the modified Struve function of the first kind.

math.CA↗

Wasserstein distance error bounds for the multivariate normal approximation of the maximum likelihood estimator

We obtain explicit $p$-Wasserstein distance error bounds between the distribution of the multi-parameter MLE and the multivariate normal distribution. Our general bounds are given for possibly high-dimensional, independent and identically distributed random vectors. Our general bounds are of the optimal $\mathcal{O}(n^{-1/2})$ order. Explicit numerical constants are given when $p\in(1,2]$, and in the case $p>2$ the bounds are explicit up to a constant factor that only depends on $p$. We apply our general bounds to derive Wasserstein distance error bounds for the multivariate normal approximation of the MLE in several settings; these being single-parameter exponential families, the normal distribution under canonical parametrisation, and the multivariate normal distribution under non-canonical parametrisation. In addition, we provide upper bounds with respect to the bounded Wasserstein distance when the MLE is implicitly defined.

math.ST↗

New error bounds for Laplace approximation via Stein's method

We use Stein's method to obtain explicit bounds on the rate of convergence for the Laplace approximation of two different sums of independent random variables; one being a random sum of mean zero random variables and the other being a deterministic sum of mean zero random variables in which the normalisation sequence is random. We make technical advances to the framework of Pike and Ren \cite{pike} for Stein's method for Laplace approximation, which allows us to give bounds in the Kolmogorov and Wasserstein metrics. Under the additional assumption of vanishing third moments, we obtain faster convergence rates in smooth test function metrics. As part of the derivation of our bounds for the Laplace approximation for the deterministic sum, we obtain new bounds for the solution, and it first two derivatives, of the Rayleigh Stein equation.

math.PR↗

Bounds for an integral involving the modified Struve function of the first kind

Simple upper and lower bounds are established for the integral $\int_0^x\mathrm{e}^{-βt}t^ν\mathbf{L}_ν(t)\,\mathrm{d}t$, where $x>0$, $ν>-1$, $0<β<1$ and $\mathbf{L}_ν(x)$ is the modified Struve function of the first kind. These bounds complement and improve on existing results, through either sharper bounds or increased ranges of validity. In deriving our bounds, we obtain some monotonicity results and inequalities for products of the modified Struve function of the first kind and the modified Bessel function of the second kind $K_ν(x)$, as well as a new bound for the ratio $\mathbf{L}_ν(x)/\mathbf{L}_{ν-1}(x)$.

math.CA↗

On bounds for the mode and median of the generalized hyperbolic and related distributions

Except for certain parameter values, a closed form formula for the mode of the generalized hyperbolic (GH) distribution is not available. In this paper, we exploit results from the literature on modified Bessel functions and their ratios to obtain simple but tight two-sided inequalities for the mode of the GH distribution for general parameter values. As a special case, we deduce tight two-sided inequalities for the mode of the variance-gamma (VG) distribution, and through a similar approach we also obtain tight two-sided inequalities for the mode of the McKay Type I distribution. The analogous problem for the median is more challenging, but we conjecture some monotonicity results for the median of the VG and McKay Type I distributions, from we which we conjecture some tight two-sided inequalities for their medians. Numerical experiments support these conjectures and also lead us to a conjectured tight lower bound for the median of the GH distribution.

math.ST↗

Bounds for an integral of the modified Bessel function of the first kind and expressions involving it

Simple upper and lower bounds are obtained for the integral $\int_0^x\mathrm{e}^{-γt}t^νI_ν(t)\,\mathrm{d}t$, $x>0$, $ν>-\frac{1}{2}$, $0<γ<1$. Most of our bounds for this integral are tight as $x\rightarrow\infty$. We apply one of our inequalities to bound some expressions involving this integral. Two of these expressions appear in Stein's method for variance-gamma approximation, and our bounds will allow for a technical advancement to be made to the method.

math.CA↗