arXiv subjects

Richard L. Warr

Publications and source records attributed to Richard L. Warr.

12 recordsLinked to original sources

arXiv2026

Bayesian Mixture Models for Histograms: with Applications to Large Datasets

In many real-world scenarios, especially those involving privacy constraints or data summarization, data are available only in aggregated forms, such as histograms or frequency tables. This work introduces a novel Bayesian method for inferring the underlying population distribution by fitting a mixture model to binned data. While we focus on mixtures of normal distributions, the framework is flexible and can be extended to other distributional families. We place a prior distribution on the number of mixture components, accommodating both finite and countably infinite mixtures, and perform inference using reversible jump MCMC. The proposed approach demonstrates strong performance on large-scale data, showcasing the potential of nonparametric Bayesian modeling in practical applications. Furthermore, we extend the method to model multiple histograms simultaneously and cluster them using the Dirichlet process. This enables information sharing across populations and provides a principled posterior probability to assess homogeneity between groups. Some theoretical results supporting the performance of our proposed methodology are also discussed.

stat.ME↗

arXiv2026

Clustering Craters on the Moon with Dysfunctional Families

Summaries of craters on terrestrial bodies, such as the number and size distribution, are essential for understanding the history of the Solar System. Identifying craters, however, has not been automated and thus relies on expert crater-counters marking static images. Robbins et al. (2014) (hereafter R14) showed that, contrary to previously held assumptions, there exists large variability across expert crater-counters' identified crater lists. How best to combine identified crater lists across multiple experts for the purposes of learning about the Solar System is an open and consequential question. R14 combined identified crater lists via clustering through a modification of the popular DBSCAN clustering method. Their approach did not, however, make use of all the constraining information available nor did it provide an estimate of clustering uncertainty. To address the shortcomings of the DBSCAN method, we present a novel clustering approach that can combine multiple lists of identified objects of interest from the same image. The key innovation is incorporating a dysfunctional family constraint into the Bayesian nonparametric clustering approach, the Chinese restaurant process (CRP), which naturally takes into account information about the crater identifier. The dysfunctional family Chinese restaurant process (DFCRP) provides an estimate of clustering uncertainty. In this work, we provide guidance on hyperparameter specification, present a Gibbs sampler, and perform a simulation study to compare the performance of the DFCRP to the CRP. Finally, we apply the DFCRP to the crater identification problem of R14, comparing results, and also demonstrate the types of analyses that can be performed with posterior draws of cluster assignments.

stat.ME↗

arXiv2026

What Quality Engineers Need to Know about Degradation Models

Degradation models play a critical role in quality engineering by enabling the assessment and prediction of system reliability based on data. The objective of this paper is to provide an accessible introduction to degradation models. We explore commonly used degradation data types, including repeated measures degradation data and accelerated destructive degradation test data, and review modeling approaches such as general path models and stochastic process models. Key inference problems, including reliability estimation and prediction, are addressed. Applications across diverse fields, including material science, renewable energy, civil engineering, aerospace, and pharmaceuticals, illustrate the broad impact of degradation models in industry. We also discuss best practices for quality engineers, software implementations, and challenges in applying these models. This paper aims to provide quality engineers with a foundational understanding of degradation models, equipping them with the knowledge necessary to apply these techniques effectively in real-world scenarios.

stat.AP↗

arXiv2024

Dependent Random Partitions by Shrinking Toward an Anchor

Although exchangeable processes from Bayesian nonparametrics have been used as a generating mechanism for random partition models, we deviate from this paradigm to explicitly incorporate clustering information in the formulation of our random partition model. Our shrinkage partition distribution takes any partition distribution and shrinks its probability mass toward an anchor partition. We show how this provides a framework to model hierarchically-dependent and temporally-dependent random partitions. The shrinkage parameter controls the degree of dependence, accommodating at its extremes both independence and complete equality. Since a priori knowledge of items may vary, our formulation allows the degree of shrinkage toward the anchor to be item-specific. Our random partition model has a tractable normalizing constant which allows for standard Markov chain Monte Carlo algorithms for posterior sampling. We prove intuitive theoretical properties for our distribution and compare it to related partition distributions. We show that our model provides better out-of-sample fit in a real data application.

stat.ME↗

arXiv2022

A Bayesian Nonparametric System Reliability Model which Integrates Multiple Sources of Lifetime Information

We present a Bayesian nonparametric system reliability model which scales well and provides a great deal of flexibility in modeling. The Bayesian approach naturally handles the disparate amounts of component and subsystem data that may exist. However, traditional Bayesian reliability models are quite computationally complex, relying on MCMC techniques. Our approach utilizes the conjugate properties of the beta-Stacy process, which is the fundamental building block of our model. These individual models are linked together using a method of moments estimation approach. This model is computationally fast, allows for right-censored data, and is used for estimating and predicting system reliability.

stat.ME↗

arXiv2021

Teaching Bayes' Rule using Mosaic Plots

Students taking statistical courses orientated for business or economics often find the standard presentation of Bayes' Rule challenging. This key concept involves understanding multiple conditional probabilities and how they constitute an unconditional sample space. Many textbooks try to aid the comprehension of Bayes' Rule by illustrating these probabilities with tree diagrams. In our opinion, these diagrams fall short in fully assisting the students to visualize Bayes' Rule. In this article, we demonstrate a graphical approach that we have successfully used in the classroom, but is neglected in introductory texts. This approach uses mosaic plots to show the weighting of the conditional probabilities and greatly aids the student in understanding the sample space and its associated probabilities.

stat.AP↗

arXiv2021

The Attraction Indian Buffet Distribution

We propose the attraction Indian buffet distribution (AIBD), a distribution for binary feature matrices influenced by pairwise similarity information. Binary feature matrices are used in Bayesian models to uncover latent variables (i.e., features) that explain observed data. The Indian buffet process (IBP) is a popular exchangeable prior distribution for latent feature matrices. In the presence of additional information, however, the exchangeability assumption is not reasonable or desirable. The AIBD can incorporate pairwise similarity information, yet it preserves many properties of the IBP, including the distribution of the total number of features. Thus, much of the interpretation and intuition that one has for the IBP directly carries over to the AIBD. A temperature parameter controls the degree to which the similarity information affects feature-sharing between observations. Unlike other nonexchangeable distributions for feature allocations, the probability mass function of the AIBD has a tractable normalizing constant, making posterior inference on hyperparameters straight-forward using standard MCMC methods. A novel posterior sampling algorithm is proposed for the IBP and the AIBD. We demonstrate the feasibility of the AIBD as a prior distribution in feature allocation models and compare the performance of competing methods in simulations and an application.

stat.ME↗

arXiv2021

Bootstrapping Through Discrete Convolutional Methods

Bootstrapping was designed to randomly resample data from a fixed sample using Monte Carlo techniques. However, the original sample itself defines a discrete distribution. Convolutional methods are well suited for discrete distributions, and we show the advantages of utilizing these techniques for bootstrapping. The discrete convolutional approach can provide exact numerical solutions for bootstrap quantities, or at least mathematical error bounds. In contrast, Monte Carlo bootstrap methods can only provide confidence intervals which converge slowly. Additionally, for some problems the computation time of the convolutional approach can be dramatically less than that of Monte Carlo resampling. This article provides several examples of bootstrapping using the proposed convolutional technique and compares the results to those of the Monte Carlo bootstrap, and to those of the competing saddlepoint method.

stat.ME↗

arXiv2021

A Comprehensive Method for Solving Finite-State Semi-Markov Processes

Semi-Markov processes (SMPs) provide a rich framework for many real-world problems. However, due to difficulty implementing practical solutions they are rarely used with their full capability. The theory of SMPs is quite mature but was mainly developed at a time when computational resources were not widely available. With the exception of some of the simplest cases, solutions to SMPs are inherently numerical, and SMPs have been underutilized by practitioners because of difficulty implementing the theory in applications. This paper demonstrates the theory and computational methods needed to implement SMP models in practical settings. Methods are illustrated with an application modeling the movement of coronary patients in a hospital. Our aim is to allow practitioners to use richer SMP models without being burdened with the rigorous mathematical theory.

stat.AP↗

arXiv2021

Exact Confidence Intervals for Linear Combinations of Multinomial Probabilities

Linear combinations of multinomial probabilities, such as those resulting from contingency tables, are of use when evaluating classification system performance. While large sample inference methods for these combinations exist, small sample methods exist only for regions on the multinomial parameter space instead of the linear combinations. However, in medical classification problems it is common to have small samples necessitating a small sample confidence interval on linear combinations of multinomial probabilities. Therefore, in this paper we derive an exact confidence interval, through the use of fiducial inference, for linear combinations of multinomial probabilities. Simulation demonstrates the presented interval's adherence to exact coverage. Additionally, an adjustment to the exact interval is provided, giving shorter lengths while still achieving better coverage than large sample methods. Computational efficiencies in estimation of the exact interval are achieved through the application of a fast Fourier transform and combining a numerical solver and stochastic optimizer to find solutions. The exact confidence interval presented in this paper allows for comparisons between diagnostic methods previously unavailable, demonstrated through an example of diagnosing chronic allograph nephropathy in post kidney transplant patients.

stat.ME↗

arXiv2020

First Passage Moments of Finite-State Semi-Markov Processes

In this paper, we discuss the computation of first passage moments of a time-homogeneous semi-Markov process (SMP) with finite state space to certain of its states that possess the property of universal accessibility (UA). A UA state is one which is accessible from any other state of the SMP, but which may or may not connect back to one or more other states. An important characteristic of UA is that it is the state-level version of the oft-invoked process-level property of irreducibility. We adapt existing results for irreducible SMPs to the derivation of an analytical matrix expression for the first passage moments to a single UA state of the SMP. In addition, consistent estimators for these first passage moments are given.

math.PR↗

arXiv2012

Numerical Approximation of Probability Mass Functions Via the Inverse Discrete Fourier Transform

First passage distributions of semi-Markov processes are of interest in fields such as reliability, survival analysis, and many others. The problem of finding or computing first passage distributions is, in general, quite challenging. We take the approach of using characteristic functions (or Fourier transforms) and inverting them, to numerically calculate the first passage distribution. Numerical inversion of characteristic functions can be numerically unstable for a general probability measure, however, we show for lattice distributions they can be quickly calculated using the inverse discrete Fourier transform. Using the fast Fourier transform algorithm these computations can be extremely fast. In addition to the speed of this approach, we are able to prove a few useful bounds for the numerical inversion error of the characteristic functions. These error bounds rely on the existence of a first or second moment of the distribution, or on an eventual monotonicity condition. We demonstrate these techniques in an example and include R-code.

stat.ME↗