SearcharxivSearch

arXiv subjects

Igor Pruenster

Publications and source records attributed to Igor Pruenster.

3 recordsLinked to original sources

Ferguson's Dirichlet Process Breakthrough: A Lasting Legacy

Ferguson's 1973 introduction of the Dirichlet process marked a breakthrough in Bayesian nonparametric statistics. For the first time, a prior on the space of probability measures fulfilled two key desiderata: large support and analytical tractability. In this paper, we review three complementary constructions of the Dirichlet process, whose roots can be traced back to Ferguson: through finite-dimensional distributions, via normalization of a gamma process, and through predictive distributions. Each perspective not only deepens the understanding of the Dirichlet process but also provides a template for generalizations, from normalized random measures with independent increments to Gibbs--type priors and beyond. Over the past fifty years, the Dirichlet process has become the cornerstone of Bayesian nonparametric methodology and applications, while simultaneously inspiring the expansion of the landscape of nonparametric priors. Since de Finetti laid out the Bayesian nonparametric framework in the 1930s, the key obstacle had been the absence of a tractable nonparametric prior. Ferguson's contribution overcame this challenge, providing a solution to a decades-long open problem. In recognition of this decisive advance, it seems appropriate to refer to the Dirichlet process as the Ferguson--Dirichlet process.

math.ST

Stochastic approximations to the Pitman-Yor process

In this paper we consider approximations to the popular Pitman-Yor process obtained by truncating the stick-breaking representation. The truncation is determined by a random stopping rule that achieves an almost sure control on the approximation error in total variation distance. We derive the asymptotic distribution of the random truncation point as the approximation error epsilon goes to zero in terms of a polynomially tilted positive stable distribution. The practical usefulness and effectiveness of this theoretical result is demonstrated by devising a sampling algorithm to approximate functionals of the epsilon-version of the Pitman-Yor process.

math.ST

Baysian inference via classes of normalized random measures

One of the main research areas in Bayesian Nonparametrics is the proposal and study of priors which generalize the Dirichlet process. Here we exploit theoretical properties of Poisson random measures in order to provide a comprehensive Bayesian analysis of random probabilities which are obtained by an appropriate normalization. Specifically we achieve explicit and tractable forms of the posterior and the marginal distributions, including an explicit and easily used description of generalizations of the important Blackwell-MacQueen Pólya urn distribution. Such simplifications are achieved by the use of a latent variable which admits quite interesting interpretations which allow to gain a better understanding of the behaviour of these random probability measures. It is noteworthy that these models are generalizations of models considered by Kingman (1975) in a non-Bayesian context. Such models are known to play a significant role in a variety of applications including genetics, physics, and work involving random mappings and assemblies. Hence our analysis is of utility in those contexts as well. We also show how our results may be applied to Bayesian mixture models and describe computational schemes which are generalizations of known efficient methods for the case of the Dirichlet process. We illustrate new examples of processes which can play the role of priors for Bayesian nonparametric inference and finally point out some interesting connections with the theory of generalized gamma convolutions initiated by Thorin and further developed by Bondesson.

math.ST