Searcharxiv⌕ Search

arXiv subjects

Geurt Jongbloed

Publications and source records attributed to Geurt Jongbloed.

36 records · Page 2Linked to original sources

Bayesian estimation of a decreasing density

Suppose $X_1,\dots, X_n$ is a random sample from a bounded and decreasing density $f_0$ on $[0,\infty)$. We are interested in estimating such $f_0$, with special interest in $f_0(0)$. This problem is encountered in various statistical applications and has gained quite some attention in the statistical literature. It is well known that the maximum likelihood estimator is inconsistent at zero. This has led several authors to propose alternative estimators which are consistent. As any decreasing density can be represented as a scale mixture of uniform densities, a Bayesian estimator is obtained by endowing the mixture distribution with the Dirichlet process prior. Assuming this prior, we derive contraction rates of the posterior density at zero by carefully revising arguments presented in Salomond (2014). Various methods for estimating the density are compared using a simulation study. We apply the Bayesian procedure to the current durations data described in Keiding et al.(2012).

math.ST↗

Interpretable random forest models through forward variable selection

Random forest is a popular prediction approach for handling high dimensional covariates. However, it often becomes infeasible to interpret the obtained high dimensional and non-parametric model. Aiming for obtaining an interpretable predictive model, we develop a forward variable selection method using the continuous ranked probability score (CRPS) as the loss function. Our stepwise procedure leads to a smallest set of variables that optimizes the CRPS risk by performing at each step a hypothesis test on a significant decrease in CRPS risk. We provide mathematical motivation for our method by proving that in population sense the method attains the optimal set. Additionally, we show that the test is consistent provided that the random forest estimator of a quantile function is consistent. In a simulation study, we compare the performance of our method with an existing variable selection method, for different sample sizes and different correlation strength of covariates. Our method is observed to have a much lower false positive rate. We also demonstrate an application of our method to statistical post-processing of daily maximum temperature forecasts in the Netherlands. Our method selects about 10% covariates while retaining the same predictive power.

stat.ME↗

Isotonic regression for metallic microstructure data: estimation and testing under order restrictions

Investigating the main determinants of the mechanical performance of metals is not a simple task. Already known physical inspired qualitative relations between 2D microstructure characteristics and 3D mechanical properties can act as the starting point of the investigation. Isotonic regression allows to take into account ordering relations and leads to more efficient and accurate results when the underlying assumptions actually hold. The main goal in this paper is to test order relations in a model inspired by a materials science application. The statistical estimation procedure is described considering three different scenarios according to the knowledge of the variances: known variance ratio, completely unknown variances, variances under order restrictions. New likelihood ratio tests are developed in the last two cases. Both parametric and non-parametric bootstrap approaches are developed for finding the distribution of the test statistics under the null hypothesis. Finally an application on the relation between Geometrically Necessary Dislocations and number of observed microstructure precipitations is shown.

stat.AP↗

Improving precipitation forecasts using extreme quantile regression

Aiming to estimate extreme precipitation forecast quantiles, we propose a nonparametric regression model that features a constant extreme value index. Using local linear quantile regression and an extrapolation technique from extreme value theory, we develop an estimator for conditional quantiles corresponding to extreme high probability levels. We establish uniform consistency and asymptotic normality of the estimators. In a simulation study, we examine the performance of our estimator on finite samples in comparison with a method assuming linear quantiles. On a precipitation data set in the Netherlands, these estimators have greater predictive skill compared to the upper member of ensemble forecasts provided by a numerical weather prediction model.

stat.ME↗

General framework for testing Poisson-Voronoi assumption for real microstructures

Modeling microstructures is an interesting problem not just in Materials Science but also in Mathematics and Statistics. The most basic model for steel microstructure is the Poisson-Voronoi diagram. It has mathematically attractive properties and it has been used in the approximation of single phase steel microstructures. The aim of this paper is to develop methods that can be used to test whether a real steel microstructure can be approximated by such a model. Therefore, a general framework for testing the Poisson-Voronoi assumption based on images of 2D sections of real metals is set out. Following two different approaches, according to the use or not of periodic boundary conditions, three different model tests are proposed. The first two are based on the coefficient of variation and the cumulative distribution function of the cells area. The third exploits tools from to Topological Data Analysis, such as persistence landscapes.

stat.AP↗

Probabilistic partial least squares model: Identifiability, estimation and application

With a rapid increase in volume and complexity of data sets, there is a need for methods that can extract useful information, for example the relationship between two data sets measured for the same persons. The Partial Least Squares (PLS) method can be used for this dimension reduction task. Within life sciences, results across studies are compared and combined. Therefore, parameters need to be identifiable, which is not the case for PLS. In addition, PLS is an algorithm, while epidemiological study designs are often outcome-dependent and methods to analyze such data require a probabilistic formulation. Moreover, a probabilistic model provides a statistical framework for inference. To address these issues, we develop Probabilistic PLS (PPLS). We derive maximum likelihood estimators that satisfy the identifiability conditions by using an EM algorithm with a constrained optimization in the M step. We show that the PPLS parameters are identifiable up to sign. A simulation study is conducted to study the performance of PPLS compared to existing methods. The PPLS estimates performed well in various scenarios, even in high dimensions. Most notably, the estimates seem to be robust against departures from normality. To illustrate our method, we applied it to IgG glycan data from two cohorts. Our PPLS model provided insight as well as interpretable results across the two cohorts.

stat.ME↗

Accurate approximation of the distributions of the 3D Poisson-Voronoi typical cell geometrical features

Although Poisson-Voronoi diagrams have interesting mathematical properties, there is still much to discover about the geometrical properties of its grains. Through simulations, many authors were able to obtain numerical approximations of the moments of the distributions of more or less all geometrical characteristics of the grain. Furthermore, many proposals on how to get close parametric approximations to the real distributions were put forward by several authors. In this paper we show that exploiting the scaling property of the underlying Poisson process, we are able to derive the distribution of the main geometrical features of the grain for every value of the intensity parameter. Moreover, we use a sophisticated simulation program to construct a close Monte Carlo based approximation for the distributions of interest. Using this, we also determine the closest approximating distributions within the mentioned frequently used parametric classes of distributions and conclude that these approximations can be quite accurate.

stat.AP↗

Nonparametric confidence intervals for monotone functions

We study nonparametric isotonic confidence intervals for monotone functions. In Banerjee and Wellner (2001) pointwise confidence intervals, based on likelihood ratio tests for the restricted and unrestricted MLE in the current status model, are introduced. We extend the method to the treatment of other models with monotone functions, and demonstrate our method by a new proof of the results in Banerjee and Wellner (2001) and also by constructing confidence intervals for monotone densities, for which still theory had to be developed. For the latter model we prove that the limit distribution of the LR test under the null hypothesis is the same as in the current status model. We compare the confidence intervals, so obtained, with confidence intervals using the smoothed maximum likelihood estimator (SMLE), using bootstrap methods. The `Lagrange-modified' cusum diagrams, developed here, are an essential tool both for the computation of the restricted MLEs and for the development of the theory for the confidence intervals, based on the LR tests.

math.ST↗

On the identifiability of copulas in bivariate competing risks models

In competing risks models, the joint distribution of the event times is not identifiable even when the margins are fully known, which has been referred to as the "identifiability crisis in competing risks analysis" (Crowder, 1991). We model the dependence between the event times by an unknown copula and show that identification is actually possible within many frequently used families of copulas. The result is then extended to the case where one margin is unknown.

math.ST↗

Testing monotonicity of a hazard: asymptotic distribution theory

Two new test statistics are introduced to test the null hypotheses that the sampling distribution has an increasing hazard rate on a specified interval [0,a]. These statistics are empirical L_1-type distances between the isotonic estimates, which use the monotonicity constraint, and either the empirical distribution function or the empirical cumulative hazard. They measure the excursions of the empirical estimates with respect to the isotonic estimates, due to local non-monotonicity. Asymptotic normality of the test statistics, if the hazard is strictly increasing on [0,a], is established under mild conditions. This is done by first approximating the global empirical distance by an distance with respect to the underlying distribution function. The resulting integral is treated as sum of increasingly many local integrals to which a CLT can be applied. The behavior of the local integrals is determined by a canonical process: the difference between the stochastic process x -> W(x)+x^2 where W is standard two-sided Brownian Motion, and its greatest convex minorant.

math.ST↗

A maximum smoothed likelihood estimator in the current status continuous mark model

We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable based on censored data. More specifically, the event time is subject to current status censoring and the continuous mark is only observed in case inspection takes place after the event time. The nonparametric maximum likelihood estimator (MLE) in this model is known to be inconsistent. We propose and study an alternative likelihood based estimator, maximizing a smoothed log-likelihood, hence called a maximum smoothed likelihood estimator (MSLE). This estimator is shown to be well defined and consistent, and a simple algorithm is described that can be used to compute it. The MSLE is compared with other estimators in a small simulation study.

math.ST↗

Smooth and non-smooth estimates of a monotone hazard

We discuss a number of estimates of the hazard under the assumption that the hazard is monotone on an interval [0,a]. The usual isotonic least squares estimators of the hazard are inconsistent at the boundary points 0 and a. We use penalization to obtain uniformly consistent estimators. Moreover, we determine the optimal penalization constants, extending related work in this direction by Woodroofe and Sun (1993) and Woodroofe and Sun (1999). Two methods of obtaining smooth monotone estimates based on a non-smooth monotone estimator are discussed. One is based on kernel smoothing, the other on penalization.

math.ST↗

Smooth plug-in inverse estimators in the current status continuous mark model

We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable when the event time is subject to interval censoring case 1 and the continuous mark variable is only observed in case the event occurred before the time of inspection. The nonparametric maximum likelihood estimator in this model is known to be inconsistent. We study two alternative smooth estimators, based on the explicit (inverse) expression of the distribution function of interest in terms of the density of the observable vector. We derive the pointwise asymptotic distribution of both estimators.

math.ST↗

Isotonic L_2-projection test for local monotonicity of a hazard

We introduce a new test statistic for testing the null hypothesis that the sampling distribution has an increasing hazard rate on a specified interval [0,a]. It is based on a comparison of the empirical distribution function with an isotonic estimate, using the restriction that the hazard is increasing, and measures the excursions of the empirical distribution above the isotonic estimate, due to local non-monotonicity. It is proved in the companion paper Groeneboom and Jongbloed (2011a) that the test statistic is asymptotically normal if the hazard is strictly increasing on the interval [0,a] and certain regularity conditions are satisfied. We discuss a bootstrap method for computing the critical values and compare the test, thus obtained, with other proposals in a simulation study.

math.ST↗

Maximum smoothed likelihood estimation and smoothed maximum likelihood estimation in the current status model

We consider the problem of estimating the distribution function, the density and the hazard rate of the (unobservable) event time in the current status model. A well studied and natural nonparametric estimator for the distribution function in this model is the nonparametric maximum likelihood estimator (MLE). We study two alternative methods for the estimation of the distribution function, assuming some smoothness of the event time distribution. The first estimator is based on a maximum smoothed likelihood approach. The second method is based on smoothing the (discrete) MLE of the distribution function. These estimators can be used to estimate the density and hazard rate of the event time distribution based on the plug-in principle.

math.ST↗

Estimating a concave distribution function from data corrupted with additive noise

We consider two nonparametric procedures for estimating a concave distribution function based on data corrupted with additive noise generated by a bounded decreasing density on $(0,\infty)$. For the maximum likelihood (ML) estimator and least squares (LS) estimator, we state qualitative properties, prove consistency and propose a computational algorithm. For the LS estimator and its derivative, we also derive the pointwise asymptotic distribution. Moreover, the rate $n^{-2/5}$ achieved by the LS estimator is shown to be minimax for estimating the distribution function at a fixed point.

math.ST↗

Asymptotics: Particles, Processes and Inverse Problems. Festschrift for Piet Groeneboom

In September 2006, Piet Groeneboom officially retired as professor of statistics at Delft University of Technology and the Vrije Universiteit in Amsterdam. He did so by delivering his farewell lecture `Summa Cogitatio' ([42] in Piet's publication list) in the Aula of the university in Delft. To celebrate Piet's impressive contributions to statistics and probability, the workshop `Asymptotics: particles, processes and inverse problems' was held from July 10 until July 14, 2006, at the Lorentz Center in Leiden. Many leading researchers in the fields of probability and statistics gave talks at this workshop, and it became a memorable event for all who attended, including the organizers and Piet himself. This volume serves as a Festschrift for Piet Groeneboom. It contains papers that were presented at the workshop as well as some other contributions, and it represents the state of the art in the areas in statistics and probability where Piet has been (and still is) most active. Furthermore, a short CV of Piet Groeneboom and a list of his publications are included.

math.ST↗

The suppport reduction algorithm for computing nonparametric function estimates in mixture models

Vertex direction algorithms have been around for a few decades in the experimental design and mixture models literature. We briefly review this type of algorithm and describe a new member of the family: the support reduction algorithm. The support reduction algorithm is applied to the problem of computing nonparametric estimates in two inverse problems: convex density estimation and the Gaussian deconvolution problem. Usually, VD algorithms solve a finite dimensional (version of the) optimization problem of interest. We introduce a method to solve the true infinite dimensional optimization problem.

math.ST↗