Ferguson's Dirichlet Process Breakthrough: A Lasting Legacy

Abstract

Ferguson's 1973 introduction of the Dirichlet process marked a breakthrough in Bayesian nonparametric statistics. For the first time, a prior on the space of probability measures fulfilled two key desiderata: large support and analytical tractability. In this paper, we review three complementary constructions of the Dirichlet process, whose roots can be traced back to Ferguson: through finite-dimensional distributions, via normalization of a gamma process, and through predictive distributions. Each perspective not only deepens the understanding of the Dirichlet process but also provides a template for generalizations, from normalized random measures with independent increments to Gibbs--type priors and beyond. Over the past fifty years, the Dirichlet process has become the cornerstone of Bayesian nonparametric methodology and applications, while simultaneously inspiring the expansion of the landscape of nonparametric priors. Since de Finetti laid out the Bayesian nonparametric framework in the 1930s, the key obstacle had been the absence of a tractable nonparametric prior. Ferguson's contribution overcame this challenge, providing a solution to a decades-long open problem. In recognition of this decisive advance, it seems appropriate to refer to the Dirichlet process as the Ferguson--Dirichlet process.