Searcharxiv⌕ Search

arXiv · 2610.13460

Brown's loss function and estimation of the scale parameter and the entropy in scale mixture models with unknown location

Abstract

This paper deals with the problems of decision theoretic estimation of the scale parameter, $σ$, and the entropy (Shannon or Renyi) in general scale mixture models with unknown location. Employing Kubokawa's approach, under convexity of the loss $L(t)$ either in $t$ or in $lnt$, improved estimators of $σ$ are derived. If $L(t)$ satisfies an additional condition, the problem reduces to estimating $σ$ in the degenerate (scale mixture) model. As the entropy is a linear translation of $lnσ$, its estimation under a loss $L_0(u)$ amounts to estimating $σ$ under $L(t)=L_0(lnt)$, with the quadratic loss $L_0(u)=u^2$ and Brown's loss $L(t)=(lnt)^2$ being a typical case. Thus, in the case that $L_0(u)$ is convex improved estimators of the entropy are directly obtained from respective estimators of $σ$. The results are applied to scale mixtures of normal and exponential distributions, including the multivariate $t$ and multivariate Lomax distributions.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Stavros Kourouklis. 2026-10-09. Brown's loss function and estimation of the scale parameter and the entropy in scale mixture models with unknown location. https://arxiv.org/abs/2610.13460

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The Harmonic Entropy Estimator: Minimax Optimality and Semiparametric Efficiency for Infinite Alphabets

Shannon entropy estimation for discrete distributions is a classical nonparametric problem whose statistical limits are well characterized under finite support. Whether minimax and efficiency guarantees extend to infinite-support distributions remains open, in part because the expectation and variance of logarithm-transformed multinomial counts lack closed forms, forcing analyses to rely on bounding arguments rather than exact moment expressions. We address this obstacle with an algebraic framework built on an exact identity relating harmonic-transformed counts to their log-probabilities, yielding the harmonic entropy estimator. With this framework, we obtain two main results characterizing the statistical limits of this problem for distributions with sufficiently fast-decaying tails. First, for the class of distributions with at least quadratically decaying tails ($p_j \lesssim j^{-2}$), we establish that the $L_2$-minimax convergence rate is $1/n$, a rate anchored by estimator variance for both finite- and infinite-support distributions. Second, under the stronger condition $p_j = o(j^{-2})$, we demonstrate that the harmonic estimator is semiparametrically efficient: $\sqrt{n}[\hat{H}(\mathbf{X}_n) - H(X)]$ converges weakly to a normal distribution with variance achieving the semiparametric efficiency bound, $\mathrm{Var}[\log p(X)]$. Furthermore, the harmonic estimator is universally less biased than the plug-in estimator by circumventing the approximation error inherent to expectations of logarithm-transformed counts. More broadly, the harmonic approach may provide a foundation for developing new theory in entropy-based estimation, such as inference for mutual information under similar nonparametric regimes.

math.ST↗

Dense alternating sign matrices and imprecise copulas

In this paper, we study discrete quasi-copulas and discrete imprecise copulas of minimal range, which naturally correspond to alternating sign matrices. We identify dense alternating sign matrices as a particularly well-behaved subclass. We prove that the associated discrete imprecise copulas are always coherent and hence avoid sure loss. We further show that a particular extension of the corresponding discrete quasi-copulas to the full domain preserves this structure and yields self-dual imprecise copulas. To the best of our knowledge, this provides the first general result in the literature showing how properties established for discrete imprecise copulas can be preserved when extending them to their full-domain counterpart. We conclude the paper by showing that, for general alternating sign matrices, the associated discrete imprecise copulas need not avoid sure loss, further emphasizing the special role of the subclass of dense alternating sign matrices. We establish, however, that the class of discrete quasi-copulas of minimal range is invariant under all defect transformations

math.ST↗

How Much Can Gaussian Dependence Inflate the Benjamini-Hochberg Procedure's FDR?

We study the worst-case false discovery rate (FDR) of the Benjamini-Hochberg procedure for both one- and two-sided Gaussian tests with general correlation matrices. For each setting and given target FDR level $q$, we construct a family of finite Gaussian models whose FDR divided by $q$ diverges as $q\downarrow0$. This disproves any universal multiplicative FDR bound. Moreover, we establish new FDR lower bounds that are independent of the number of hypotheses. For two-sided tests, the worst-case FDR over the number of hypotheses, mean vector, and correlation matrix is at least an explicit ${\ell_{=}}(q)>q$: \[ \ell_{=}(q)=\frac{q\sqrt{\log(1/q)}}{2\sqrtπ}+c_\ell q+o(q), \qquad c_\ell=0.6492828\ldots. \] For one-sided tests, we show a lower bound $\ell_{\le}(q)>q$: \[ \ell_{\le}(q)=\frac{q\sqrt{\log(1/q)}}{\sqrtπ} +\frac q2+o(q). \] Finally, we prove the leading constants are sharp for a class of correlation matrices for both one- and two-sided tests.

math.ST↗