Searcharxiv⌕ Search

arXiv subjects

Davide Agnoletto

Publications and source records attributed to Davide Agnoletto.

3 recordsLinked to original sources

Martingale posteriors for flexible regression via recursive least squares

Predictive Bayes quantifies uncertainty by specifying a sequence of one-step-ahead predictive distributions, inducing a martingale posterior without an explicit prior. Existing parametric constructions rely on stochastic-gradient updates and have seen limited development for flexible regression. We propose a predictive Bayes framework based on recursive least squares, whose martingale posterior has an explicit representation: given future covariates, it is the law of the posterior mean plus a weighted series of independent draws from the standardized predictive distribution. The posterior mean is a penalized least squares estimator, available in closed form and invariant to data ordering, whereas the predictive distribution, for example heavy tailed, is chosen separately without changing the estimator or algorithm. We derive the exact posterior variance under a known design and an asymptotically Gaussian approximation, and obtain the martingale posterior in closed form for Gaussian predictive distributions. Posterior draws are independent by construction, with a known truncation error, and require no Markov chain Monte Carlo. The construction extends to additive, mixed and Gaussian process models. In simulations and an analysis of NHANES triglyceride data, the method attains accuracy comparable to that of a fully Bayesian model with the same response distribution at a fraction of its computational cost.

stat.ME↗

Nonparametric predictive inference for discrete data via Metropolis-adjusted Dirichlet sequences

This article is motivated by challenges in conducting Bayesian inferences on unknown discrete distributions, with a particular focus on count data. To avoid the computational disadvantages of traditional mixture models, we develop a novel Bayesian predictive approach. In particular, our Metropolis-adjusted Dirichlet (MAD) sequence model characterizes the predictive measure as a mixture of a base measure and Metropolis-Hastings kernels centered on previous data points. The resulting MAD sequence is asymptotically exchangeable and the posterior on the data generator takes the form of a martingale posterior. This structure leads to straightforward algorithms for inference on count distributions, with easy extensions to multivariate, regression, and binary data cases. We obtain a useful asymptotic Gaussian approximation and illustrate the methodology on a variety of applications.

stat.ME↗

Bayesian inference for generalized linear models via quasi-posteriors

Generalized linear models (GLMs) are routinely used for modeling relationships between a response variable and a set of covariates. The simple form of a GLM comes with easy interpretability, but also leads to concerns about model misspecification impacting inferential conclusions. A popular semi-parametric solution adopted in the frequentist literature is quasi-likelihood, which improves robustness by only requiring correct specification of the first two moments. We develop a robust approach to Bayesian inference in GLMs through quasi-posterior distributions. We show that quasi-posteriors provide a coherent generalized Bayes inference method, while also approximating so-called coarsened posteriors. In so doing, we obtain new insights into the choice of coarsening parameter. Asymptotically, the quasi-posterior converges in total variation to a normal distribution and has important connections with the loss-likelihood bootstrap posterior. We demonstrate that it is also well-calibrated in terms of frequentist coverage. Moreover, the loss-scale parameter has a clear interpretation as a dispersion, and this leads to a consolidated method of moments estimator.

stat.ME↗