SearcharxivSearch

arXiv subjects

Yuzo Maruyama

Publications and source records attributed to Yuzo Maruyama.

At least 19 recordsLinked to original sources

Minimax Simple Bayes Estimators of a Normal Variance

This paper is a follow-up to Maruyama and Strawderman (2006, Journal of Statistical Planning and Inference), which identified a new class of generalized Bayes estimators with a particularly simple form for estimating a normal variance under entropy loss. Although their previous work established the Bayesianity of these estimators, it did not provide a closed-form result for their minimaxity. In this paper, we revisit the problem and establish a definitive closed-form minimaxity result for this class of simple Bayes estimators.

math.ST

A new perspective on dominating the James-Stein estimator

This paper presents a novel approach to constructing estimators that dominate the classical James-Stein estimator under the quadratic loss for multivariate normal means. Building on Stein's risk representation, we introduce a new sufficient condition involving a monotonicity property of a transformed shrinkage function. We derive a general class of shrinkage estimators that satisfy minimaxity and dominance over the James-Stein estimator, including cases with polynomial or logarithmic convergence to the optimal shrinkage factor. We also provide conditions for uniform dominance across dimensions and for improved asymptotic risk performance. We present several examples and numerical validations to illustrate the theoretical results.

math.ST

Minimaxity under the half-Cauchy prior

This is a follow-up paper of Polson and Scott (2012, Bayesian Analysis), which claimed that the half-Cauchy prior is a sensible default prior for a scale parameter in hierarchical models. For estimation of a p-variate normal mean under the quadratic loss, they demonstrated that the Bayes estimator with respect to the half-Cauchy prior seems to be minimax through numerical experiments. In this paper, we theoretically establish the minimaxity of the corresponding Bayes estimator using the interval arithmetric.

math.ST

A sharper bound of the Hotelling-Solomons inequality

The original Hotelling-Solomons inequality indicates that an upper bound of |mean - median|/(standard deviation) is 1. In this note, we find a new bound depending on the sample size, which is strictly smaller than 1.

math.ST

Minimaxity under half-Cauchy type priors

This is a follow-up paper of Polson and Scott (2012, Bayesian Analysis), which claimed that the half-Cauchy prior is a sensible default prior for a scale parameter in hierarchical models. For estimation of a normal mean vector under the quadratic loss, they showed that the Bayes estimator with respect to the half-Cauchy prior seems to be minimax through numerical experiments. In terms of the shrinkage coefficient, the half-Cauchy prior has a U-shape and can be interpreted as a continuous spike and slab prior. In this paper, we consider a general class of priors with U-shapes and theoretically establish sufficient conditions for the minimaxity of the corresponding (generalized) Bayes estimators. We also develop an algorithm for posterior sampling and present numerical results.

math.ST

Non-minimaxity of debiased shrinkage estimators

We consider the estimation of the $p$-variate normal mean of $X\sim N_p(θ,I)$ under the quadratic loss function. We investigate the decision theoretic properties of debiased shrinkage estimator, the estimator which shrinks towards the origin for smaller $\|x\|^2$ and which is exactly equal to the unbiased estimator $X$ for larger $\|x\|^2$. Such debiased shrinkage estimator seems superior to the unbiased estimator $X$, which implies minimaxity. However we show that it is not minimax under mild conditions.

math.ST

Ensemble minimaxity of James-Stein estimators

This article discusses estimation of a multivariate normal mean based on heteroscedastic observations. Under heteroscedasticity, estimators shrinking more on the coordinates with larger variances, seem desirable. Although they are not necessarily minimax in the ordinary sense, we show that such James-Stein type estimators can be ensemble minimax, minimax with respect to the ensemble risk, related to empirical Bayes perspective of Efron and Morris.

math.ST

A Review of Brown 1971 (in)admissibility results under scale mixtures of Gaussian priors

Brown's 1971 paper "Admissible estimators, recurrent diffusions and insoluble boundary value problems" is a landmark in the admissibility literature. It nearly completely settles the issue of admissibility/inadmissibility for estimating the mean of a multivariate normal distribution with identity covariance under sum of squared error loss. We revisit this wonderful tour de force on its 50th anniversary and present an alternative and more direct proof of the result for generalized Bayes estimators corresponding to priors which are a subclass of scale mixtures of spherical normals.

math.ST

On admissible estimation of a mean vector when the scale is unknown

We consider admissibility of generalized Bayes estimators of the mean of a multivariate normal distribution when the scale is unknown under quadratic loss. The priors considered put the improper invariant prior on the scale while the prior on the mean has a hierarchical normal structure conditional on the scale. This conditional hierarchical prior is essentially that of Maruyama and Strawderman (2021, Biometrika) (MS21) which is indexed by a hyperparameter $a$. In that paper $a$ is chosen so this conditional prior is proper which corresponds to $a>-1$. This paper extends MS21 by considering improper conditional priors with $a$ in the closed interval $[-2, -1]$, and establishing admissibility for such $a$. The authors, in Maruyama and Strawderman (2017, JMVA), have earlier shown that such conditional priors with $a < -2$ lead to inadmissible estimators. This paper therefore completes the determination of admissibility/inadmissibility for this class of priors. It establishes the the boundary as $a = -2$, with admissibility holding for $a\geq -2$ and inadmissibility for $a < -2$. This boundary corresponds exactly to that in the known scale case for these conditional priors, and which follows from Brown (1971, AOMS). As a notable benefit of this enlargement of the class of admissible generalized Bayes estimators, we give admissible and minimax estimators in all dimensions greater than $2$ as opposed to MS21 which required the dimension to be greater than $4$. In one particularly interesting special case, we establish that the joint Stein prior for the unknown scale case leads to a minimax admissible estimator in all dimensions greater than $2$.

math.ST

A Gaussian sequence approach for proving minimaxity: A Review

This paper reviews minimax best equivariant estimation in these invariant estimation problems: a location parameter, a scale parameter and a (Wishart) covariance matrix. We briefly review development of the best equivariant estimator as a generalized Bayes estimator relative to right invariant Haar measure in each case. Then we prove minimaxity of the best equivariant procedure by giving a least favorable prior sequence based on non-truncated Gaussian distributions. The results in this paper are all known, but we bring a fresh and somewhat unified approach by using, in contrast to most proofs in the literature, a smooth sequence of non truncated priors. This approach leads to some simplifications in the minimaxity proofs.

math.ST

Admissible Bayes equivariant estimation of location vectors for spherically symmetric distributions with unknown scale

This paper investigates estimation of the mean vector under invariant quadratic loss for a spherically symmetric location family with a residual vector with density of the form $ f(x,u)=η^{(p+n)/2}f(η\{\|x-θ\|^2+\|u\|^2\}) $, where $η$ is unknown. We show that the natural estimator $x$ is admissible for $p=1,2$. Also, for $p\geq 3$, we find classes of generalized Bayes estimators that are admissible within the class of equivariant estimators of the form $\{1-ξ(x/\|u\|)\}x$. In the Gaussian case, a variant of the James--Stein estimator, $[1-\{(p-2)/(n+2)\}/\{\|x\|^2/\|u\|^2+(p-2)/(n+2)+1\}]x$, which dominates the natural estimator $x$, is also admissible within this class. We also study the related regression model.

math.ST

Harmonic Bayesian prediction under alpha-divergence

We investigate Bayesian shrinkage methods for constructing predictive distributions. We consider the multivariate Normal model with a known covariance matrix and show that the Bayesian predictive density with respect to Stein's harmonic prior dominates the best invariant Bayesian predictive density, when the dimension is greater than three. Alpha-divergence from the true distribution to a predictive distribution is adopted as a loss function.

math.ST

A sharp boundary for SURE-based admissibility for the Normal means problem under unknown scale

We consider quasi-admissibility/inadmissibility of Stein-type shrinkage estimators of the mean of a multivariate normal distribution with covariance matrix an unknown multiple of the identity. Quasi-admissibility/inadmissibility is defined in terms of non-existence/existence of a solution to a differential inequality based on Stein's unbiased risk estimate (SURE). We find a sharp boundary between quasi-admissible and quasi-inadmissible estimators related to the optimal James-Stein estimator. We also find a class of priors related to the Strawderman class in the known variance case where the boundary between quasi-admissibility and quasi-inadmissibility corresponds to the boundary between admissibility and inadmissibility in the known variance case. Additionally, we also briefly consider generalization to the case of general spherically symmetric distributions with a residual vector.

math.ST

Consistency of Bayes factor for nonnested model selection when the model dimension grows

Zellner's $g$-prior is a popular prior choice for the model selection problems in the context of normal regression models. Wang and Sun [J. Statist. Plann. Inference 147 (2014) 95-105] recently adopt this prior and put a special hyper-prior for $g$, which results in a closed-form expression of Bayes factor for nested linear model comparisons. They have shown that under very general conditions, the Bayes factor is consistent when two competing models are of order $O(n^τ)$ for $τ<1$ and for $τ=1$ is almost consistent except a small inconsistency region around the null hypothesis. In this paper, we study Bayes factor consistency for nonnested linear models with a growing number of parameters. Some of the proposed results generalize the ones of the Bayes factor for the case of nested linear models. Specifically, we compare the asymptotic behaviors between the proposed Bayes factor and the intrinsic Bayes factor in the literature.

math.ST

Noise Addition for Individual Records to Preserve Privacy and Statistical Characteristics: Case Study of Real Estate Transaction Data

We propose a new method of perturbing a major variable by adding noise such that results of regression analysis are unaffected. The extent of the perturbation can be controlled using a single parameter, which eases an actual perturbation application. On the basis of results of a numerical experiment, we recommend an appropriate value of the parameter that can achieve both sufficient perturbation to mask original values and sufficient coherence between perturbed and original data.

stat.ME

l_p-norm based James-Stein estimation with minimaxity and sparsity

A new class of minimax Stein-type shrinkage estimators of a multivariate normal mean is studied where the shrinkage factor is based on an l_p norm. The proposed estimators allow some but not all coordinates to be estimated by 0 thereby allow sparsity as well as minimaxity.

math.ST

An alternative to Moran's I for spatial autocorrelation

Moran's I statistic, a popular measure of spatial autocorrelation, is revisited. The exact range of Moran's I is given as a function of spatial weights matrix. We demonstrate that some spatial weights matrices lead the absolute value of upper (lower) bound larger than 1 and that others lead the lower bound larger than -0.5. Thus Moran's I is unlike Pearson's correlation coefficient. It is also pointed out that some spatial weights matrices do not allow Moran's I to take positive values regardless of observations. An alternative measure with exact range [-1,1] is proposed through a monotone transformation of Moran's I.

math.ST