Searcharxiv⌕ Search

arXiv subjects

Lancelot F. James

Publications and source records attributed to Lancelot F. James.

At least 37 records · Page 2Linked to original sources

Bayesian nonparametric estimation and consistency of mixed multinomial logit choice models

This paper develops nonparametric estimation for discrete choice models based on the mixed multinomial logit (MMNL) model. It has been shown that MMNL models encompass all discrete choice models derived under the assumption of random utility maximization, subject to the identification of an unknown distribution $G$. Noting the mixture model description of the MMNL, we employ a Bayesian nonparametric approach, using nonparametric priors on the unknown mixing distribution $G$, to estimate choice probabilities. We provide an important theoretical support for the use of the proposed methodology by investigating consistency of the posterior distribution for a general nonparametric prior on the mixing distribution. Consistency is defined according to an $L_1$-type distance on the space of choice probabilities and is achieved by extending to a regression model framework a recent approach to strong consistency based on the summability of square roots of prior probabilities. Moving to estimation, slightly different techniques for non-panel and panel data models are discussed. For practical implementation, we describe efficient and relatively easy-to-use blocked Gibbs sampling procedures. These procedures are based on approximations of the random probability measure by classes of finite stick-breaking processes. A simulation study is also performed to investigate the performance of the proposed methods.

math.ST↗

Lamperti-type laws

This paper explores various distributional aspects of random variables defined as the ratio of two independent positive random variables where one variable has an $α$-stable law, for $0<α<1$, and the other variable has the law defined by polynomially tilting the density of an $α$-stable random variable by a factor $θ>-α$. When $θ=0$, these variables equate with the ratio investigated by Lamperti [Trans. Amer. Math. Soc. 88 (1958) 380--387] which, remarkably, was shown to have a simple density. This variable arises in a variety of areas and gains importance from a close connection to the stable laws. This rationale, and connection to the $\operatorname {PD}(α,θ)$ distribution, motivates the investigations of its generalizations which we refer to as Lamperti-type laws. We identify and exploit links to random variables that commonly appear in a variety of applications. Namely Linnik, generalized Pareto and $z$-distributions. In each case we obtain new results that are of potential interest. As some highlights, we then use these results to (i) obtain integral representations and other identities for a class of generalized Mittag--Leffler functions, (ii) identify explicitly the Lévy density of the semigroup of stable continuous state branching processes (CSBP) and hence corresponding limiting distributions derived in Slack and in Zolotarev [Z. Wahrsch. Verw. Gebiete 9 (1968) 139--145, Teor. Veroyatn. Primen. 2 (1957) 256--266], which are related to the recent work by Berestycki, Berestycki and Schweinsberg, and Bertoin and LeGall [Ann. Inst. H. Poincaré Probab. Statist. 44 (2008) 214--238, Illinois J. Math. 50 (2006) 147--181] on beta coalescents. (iii) We obtain explicit results for the occupation time of generalized Bessel bridges and some interesting stochastic equations for $\operatorname {PD}(α,θ)$-bridges. In particular we obtain the best known results for the density of the time spent positive of a Bessel bridge of dimension $2-2α$.

math.PR↗

Dirichlet mean identities and laws of a class of subordinators

An interesting line of research is the investigation of the laws of random variables known as Dirichlet means. However, there is not much information on interrelationships between different Dirichlet means. Here, we introduce two distributional operations, one of which consists of multiplying a mean functional by an independent beta random variable, the other being an operation involving an exponential change of measure. These operations identify relationships between different means and their densities. This allows one to use the often considerable analytic work on obtaining results for one Dirichlet mean to obtain results for an entire family of otherwise seemingly unrelated Dirichlet means. Additionally, it allows one to obtain explicit densities for the related class of random variables that have generalized gamma convolution distributions and the finite-dimensional distribution of their associated Lévy processes. The importance of this latter statement is that Lévy processes now commonly appear in a variety of applications in probability and statistics, but there are relatively few cases where the relevant densities have been described explicitly. We demonstrate how the technique allows one to obtain the finite-dimensional distribution of several interesting subordinators which have recently appeared in the literature.

math.ST↗

Coag-Frag duality for a class of stable Poisson-Kingman mixtures

Exchangeable sequences of random probability measures (partitions of mass) and their corresponding exchangeable bridges play an important role in a variety of areas in probability, statistics and related areas, including Bayesian statistics, physics, finance and machine learning. An area of theoretical as well as practical interest, is the study of coagulation and fragmentation operators on partitions of mass. In this regard, an interesting but formidable question is the identification of operators and distributional families on mass partitions that exhibit interesting duality relations. In this paper we identify duality relations for a large sub-class of mixed Poisson-Kingman models generated by a stable subordinator. Our results are natural generalizations of the duality relations developed in Pitman, Bertoin and Goldschmidt, and Dong, Goldschmidt and Martin for the two-parameter Poisson Dirichlet family. These results are deduced from results for corresponding bridges.

math.PR↗

On the posterior distribution of classes of random means

The study of properties of mean functionals of random probability measures is an important area of research in the theory of Bayesian nonparametric statistics. Many results are now known for random Dirichlet means, but little is known, especially in terms of posterior distributions, for classes of priors beyond the Dirichlet process. In this paper, we consider normalized random measures with independent increments (NRMI's) and mixtures of NRMI. In both cases, we are able to provide exact expressions for the posterior distribution of their means. These general results are then specialized, leading to distributional results for means of two important particular cases of NRMI's and also of the two-parameter Poisson--Dirichlet process.

math.ST↗

Generalized Gamma Convolutions, Dirichlet means, Thorin measures, with explicit examples

In Section 1, we present a number of classical results concerning the Generalized Gamma Convolution (:GGC) variables, their Wiener-Gamma representations, and relation with the Dirichlet processes.To a GGC variable, one may associate a unique Thorin measure. Let $G$ a positive r.v. and $Γ_t(G)$ (resp. $Γ_t(1/G))$ the Generalized Gamma Convolution with Thorin measure $t$-times the law of $G$ (resp. the law of $1/G$). In Section 2, we compare the laws of $Γ_t(G)$ and $Γ_t(1/G)$.In Section 3, we present some old and some new examples of GGC variables, among which the lengths of excursions of Bessel processes straddling an independent exponential time.

math.PR↗

Large sample asymptotics for the two-parameter Poisson--Dirichlet process

This paper explores large sample properties of the two-parameter $(α,θ)$ Poisson--Dirichlet Process in two contexts. In a Bayesian context of estimating an unknown probability measure, viewing this process as a natural extension of the Dirichlet process, we explore the consistency and weak convergence of the the two-parameter Poisson--Dirichlet posterior process. We also establish the weak convergence of properly centered two-parameter Poisson--Dirichlet processes for large $θ+nα.$ This latter result complements large $θ$ results for the Dirichlet process and Poisson--Dirichlet sequences, and complements a recent result on large deviation principles for the two-parameter Poisson--Dirichlet process. A crucial component of our results is the use of distributional identities that may be useful in other contexts.

math.PR↗

Distributions of linear functionals of two parameter Poisson--Dirichlet random measures

The present paper provides exact expressions for the probability distributions of linear functionals of the two-parameter Poisson--Dirichlet process $\operatorname {PD}(α,θ)$. We obtain distributional results yielding exact forms for density functions of these functionals. Moreover, several interesting integral identities are obtained by exploiting a correspondence between the mean of a Poisson--Dirichlet process and the mean of a suitable Dirichlet process. Finally, some distributional characterizations in terms of mixture representations are proved. The usefulness of the results contained in the paper is demonstrated by means of some illustrative examples. Indeed, our formulae are relevant to occupation time phenomena connected with Brownian motion and more general Bessel processes, as well as to models arising in Bayesian nonparametric statistics.

math.PR↗

Gibbs Partitions (EPPF's) Derived From a Stable Subordinator are Fox H and Meijer G Transforms

This paper derives explicit results for the infinite Gibbs partitions generated by the jumps of an $α-$stable subordinator, derived in Pitman \cite{Pit02, Pit06}. We first show that for general $α$ the conditional EPPF can be represented as ratios of Fox-$H$ functions, and in the case of rational $α,$ Meijer-G functions. Furthermore the results show that the resulting unconditional EPPF's, can be expressed in terms of H and G transforms indexed by a function h. Hence when h is itself a H or G function the EPPF is also an H or G function. An implication, in the case of rational $α,$ is that one can compute explicitly thousands of EPPF's derived from possibly exotic special functions. This would also apply to all $α$ except that computations for general Fox functions are not yet available. However, moving away from special functions, we demonstrate how results from probability theory may be used to obtain calculations. We show that a forward recursion can be applied that only requires calculation of the simplest components. Additionally we identify general classes of EPPF's where explicit calculations can be carried out using distribution theory.

math.PR↗

New Dirichlet Mean Identities

An important line of research is the investigation of the laws of random variables known as Dirichlet means as discussed in Cifarelli and Regazzini(1990). However there is not much information on inter-relationships between different Dirichlet means. Here we introduce two distributional operations, which consist of multiplying a mean functional by an independent beta random variable and an operation involving an exponential change of measure. These operations identify relationships between different means and their densities. This allows one to use the often considerable analytic work to obtain results for one Dirichlet mean to obtain results for an entire family of otherwise seemingly unrelated Dirichlet means. Additionally, it allows one to obtain explicit densities for the related class of random variables that have generalized gamma convolution distributions, and the finite-dimensional distribution of their associated Lévy processes. This has implications in, for instance, the explicit description of Bayesian nonparametric prior and posterior models, and more generally in a variety of applications in probability and statistics involving Levy processes.

math.PR↗

Gamma Tilting Calculus for GGC and Dirichlet means with applications to Linnik processes and Occupation Time Laws for Randomly Skewed Bessel Processes and Bridges

This paper develops some general calculus for GGC and Dirichlet process means functionals. It then proceeds via an investigation of positive Linnik random variables, and more generally random variables derived from compositions of a stable subordinator with GGC subordinators, to establish various distributional equivalences between these models and phenomena connected to local times and occupation times of what are defined as randomly skewed Bessel processes and bridges. This yields a host of interesting identities and explicit density formula for these models. Randomly skewed Bessel processes and bridges may be seen as a randomization of their p-skewed counterparts developed in Barlow, Pitman and Yor (1989) and Pitman and Yor (1997), and are shown to naturally arise via exponential tilting. As a special result it is shown that the occupation time of a p-skewed random Bessel process or (generalized) bridge is equivalent in distribution to the occupation time of a non-trivial randomly skewed process.

math.PR↗

Poisson calculus for spatial neutral to the right processes

Neutral to the right (NTR) processes were introduced by Doksum in 1974 as Bayesian priors on the class of distributions on the real line. Since that time there have been numerous applications to models that arise in survival analysis subject to possible right censoring. However, unlike the Dirichlet process, the larger class of NTR processes has not been used in a wider range of more complex statistical applications. Here, to circumvent some of these limitations, we describe a natural extension of NTR processes to arbitrary Polish spaces, which we call spatial neutral to the right processes. Our construction also leads to a new rich class of random probability measures, which we call NTR species sampling models. We show that this class contains the important two parameter extension of the Dirichlet process. We provide a posterior analysis, which yields tractable NTR analogues of the Blackwell--MacQueen distribution. Our analysis turns out to be closely related to the study of regenerative composition structures. A new computational scheme, which is an ordered variant of the general Chinese restaurant processes, is developed. This can be used to approximate complex posterior quantities. We also discuss some relationships to results that appear outside of Bayesian nonparametrics.

math.ST↗

Spatial Neutral to the Right Species Sampling Mixture Models

This paper describes briefly how one may utilize a class of species sampling mixture models derived from Doksum's (1974) neutral to the right processes. For practical implementation we describe an ordered/ranked variant of the generalized weighted Chinese restaurant process.

math.ST↗

Laws and Likelihoods for Ornstein Uhlenbeck-Gamma and other BNS OU Stochastic Volatilty models with extensions

In recent years there have been many proposals as flexible alternatives to Gaussian based continuous time stochastic volatility models. A great deal of these models employ positive Lévy processes. Among these are the attractive non-Gaussian positive Ornstein-Uhlenbeck (OU) processes proposed by Barndorff-Nielsen and Shephard (BNS) in a series of papers. One current problem of these approaches is the unavailability of a tractable likelihood based statistical analysis for the returns of financial assets. This paper, while focusing on the BNS models, develops general theory for the implementation of statistical inference for a host of models. Specifically we show how to reduce the infinite-dimensional process based models to finite, albeit high, dimensional ones. Inference can then be based on Monte Carlo methods. As highlights, specific to BNS we show that an OU process driven by an infinite activity Gamma process, that is an OU-$Γ$, exhibits unique features which allows one to exactly sample from relevant joint distributions. We show that this is a consequence of the OU structure and the unique calculus of Gamma and Dirichlet processes. Owing to another connection between Gamma/Dirichlet processes and the theory of Generalized Gamma Convolutions (GGC) we identify a large class of models, we call (FGGC), where one can perfectly sample marginal distributions relevant to option pricing and Monte Carlo likelihood analysis. This involves a curious result, we establish as Theorem 6.1. We also discuss analytic techniques and candidate densities for Monte-Carlo procedures which apply more generally.

math.ST↗

Coagulation Fragmentation Laws Induced By General Coagulations of Two-Parameter Poisson-Dirichlet Processes

Pitman~(1999) describes a duality relationship between fragmentation and coagulation operators. An explicit relationship is described for the two-parameter Poisson-Dirichlet laws, with parameters {\footnotesize $(α,θ)$} and $(β,θ/α)$, wherein $PD(α, θ)$ is coagulated by $PD(β,θ/α)$ for $0<α<1$, $0 \leqβ<1$ and $-β<θ/α$. This remarkable explicit agreement was obtained by combinatorial methods via exchangeable partition probability functions~(EPPF). This work discusses an alternative analysis which can feasibly extend the characterizations above to more general models of $PD(α,θ)$ coagulated with some law $Q$. The analysis exploits distributional relationships between compositions of species sampling random probability measures and coagulation operators and recent work on Cauchy-Stieltjes transforms of random probability measures by Vershik, Yor and Tsilevich (2004) and James (2002). We use this to obtain explicit descriptions in the case where {\footnotesize $Q$} corresponds to a large class of power tempered Poisson Kingman models analyzed in James~(2002). That is, explicit results are obtained for models outside of the $PD(β,θ/α)$ family.

math.PR↗

Bayesian Poisson process partition calculus with an application to Bayesian Lévy moving averages

This article develops, and describes how to use, results concerning disintegrations of Poisson random measures. These results are fashioned as simple tools that can be tailor-made to address inferential questions arising in a wide range of Bayesian nonparametric and spatial statistical models. The Poisson disintegration method is based on the formal statement of two results concerning a Laplace functional change of measure and a Poisson Palm/Fubini calculus in terms of random partitions of the integers {1,...,n}. The techniques are analogous to, but much more general than, techniques for the Dirichlet process and weighted gamma process developed in [Ann. Statist. 12 (1984) 351-357] and [Ann. Inst. Statist. Math. 41 (1989) 227-245]. In order to illustrate the flexibility of the approach, large classes of random probability measures and random hazards or intensities which can be expressed as functionals of Poisson random measures are described. We describe a unified posterior analysis of classes of discrete random probability which identifies and exploits features common to all these models. The analysis circumvents many of the difficult issues involved in Bayesian nonparametric calculus, including a combinatorial component. This allows one to focus on the unique features of each process which are characterized via real valued functions h. The applicability of the technique is further illustrated by obtaining explicit posterior expressions for Lévy-Cox moving average processes within the general setting of multiplicative intensity models.

math.ST↗