Searcharxiv⌕ Search

arXiv subjects

Yves Tillé

Publications and source records attributed to Yves Tillé.

14 recordsLinked to original sources

Randomized Principal Component Ensembles for High-Dimensional Calibration

Calibration is a widely used method in survey sampling to adjust weights so that estimated totals of some chosen calibration variables match known population totals or totals obtained from other sources. When a large number of auxiliary variables are included as calibration variables, the variance of the total estimator can increase, and the calibration weights can become highly dispersed. To address these issues, we propose an ensemble method based on a principal component decomposition of the auxiliary variables. We repeatedly select sets of principal components without replacement and with unequal selection probabilities. Calibration is performed on each selected set of principal components, and the resulting weights are aggregated to obtain a final set of weights. With our proposed method, it is possible to calibrate exactly for some of the main auxiliary variables, while relaxing the calibration constraints for the remaining variables. It yields a total estimator whose variance does not explode when new auxiliary variables are added while producing weights with low dispersion. Finally, our proposed method allows us to obtain a single weighting system that can be applied to several variables of interest of a survey. An estimator of the variance of the total estimator is also proposed. We evaluate the proposed total estimator and its variance estimator using a simulation study on real survey data from the Swiss Survey on Income and Living Conditions and on synthetic data. The results show that the proposed solution significantly reduces the weight variability and the variance of the total estimator compared with competing total estimators for some variables of interest.

stat.ME↗

Agnostic Model-Assisted Estimation with Machine Learning for Survey Data

Model-assisted estimation uses prediction rules to improve the efficiency of estimators of finite population parameters while retaining design-based inference. Although flexible prediction methods have been considered, existing theoretical results are largely method-specific. We develop a learner-agnostic framework that replaces separate analyses for individual learners with general conditions on the sampling design and prediction error. We connect design-aware and design-agnostic cross-fitting and characterize the sampling designs under which they yield conditional independence across folds. Under suitable conditions, conditional weighting gives exact design-unbiasedness. We establish first-order equivalence to oracle estimators, leading to design consistency and asymptotic normality, and clarify when conditional and original inclusion probabilities yield the same first-order behavior. We propose consistent variance estimators based on cross-fitted residuals and construct asymptotically valid confidence intervals. Under additional model and regularity conditions, we establish asymptotic optimality through attainment of the Godambe--Joshi lower bound. Simulations show that cross-fitting substantially reduces finite-sample bias and improves variance estimation and coverage with adaptive learners.

stat.ME↗

In Search of the Most Balanced Sampling Design

Balanced sampling aims to select random samples in which the estimated totals of the auxiliary variables, weighted by the inverse of the inclusion probabilities, correspond as closely as possible to the known population totals. While several methods, such as rejective sampling, rerandomization, and the cube method, have been proposed to improve balance, identifying the most balanced sampling design under fixed inclusion probabilities remains a challenging combinatorial problem. This problem can be formulated as a linear program defined over the set of all possible samples, but the number of samples grows exponentially with population size, making exact optimization infeasible except for very small populations. To address this issue, we propose a heuristic approach based on a genetic algorithm that iteratively improves the balance of sampling designs by combining minimum support designs with highly balanced candidate samples. Although optimality cannot be guaranteed, the proposed method can substantially improve balance relative to standard procedures such as the cube method. The approach is applicable to both survey sampling and experimental design.

stat.ME↗

Sequential Spatially Balanced Sampling

Sequential sampling occurs when the entire population is not known in advance and data are obtained one at a time or in groups of units. This manuscript proposes a new algorithm to sequentially select a balanced sample. The algorithm respects equal and unequal inclusion probabilities. The method can also be used to select a spatially balanced sample if the population of interest contains spatial coordinates. A simulation study is proposed and the results show that the proposed method outperforms other methods.

stat.ME↗

An Efficient Approach for Statistical Matching of Survey Data Trough Calibration, Optimal Transport and Balanced Sampling

Statistical matching aims to integrate two statistical sources. These sources can be two samples or a sample and the entire population. If two samples have been selected from the same population and information has been collected on different variables of interest, then it is interesting to match the two surveys to analyse, for example, contingency tables or covariances. In this paper, we propose an efficient method for matching two samples that may each contain a weighting scheme. The method matches the records of the two sources. Several variants are proposed in order to create a directly usable file integrating data from both information sources.

stat.ME↗

Stream Sampling with Immediate Decision

The manuscript introduces a method to select a random sample from a stream by deciding on each sampling unit immediately after observing it. The process could be applied to unequal as well as equal probability sampling. The implementation is straightforward. Algorithm selects a unit in the sample based on a single condition. It is particularly effective to make direct decisions on stream data, despite the data arriving in groups or the stream being linear.

cs.DS↗

Sequential Unequal Probability Sampling For Stream Population

A new unequal probability sampling method is proposed. This method is sequential. The decision to select or not each unit is made based on the order in which the units appear. A variant of this method allows selecting a sample from a stream. At each step, the decision to take the units successively according to the order of appearance in the stream is made. This method involves using a sliding window that is as small as possible. The method also allows the sample to be spread and even the level of spreading to be adjusted.

stat.ME↗

Enhanced Cube Implementation For Highly Stratified Population

A balanced sampling design should always be the adopted strategies if auxiliary information is available. Besides, integrating a stratified structure of the population in the sampling process can considerably reduce the variance of the estimators. We propose here a new method to handle the selection of a balanced sample in a highly stratified population. The method improves substantially the commonly used sampling design and reduces the time-consuming problem that could arise if inclusion probabilities within strata do not sum to an integer.

stat.ME↗

Spatial Spread Sampling Using Weakly Associated Vectors

Geographical data are generally autocorrelated. In this case, it is preferable to select spread units. In this paper, we propose a new method for selecting well-spread samples from a finite spatial population with equal or unequal inclusion probabilities. The proposed method is based on the definition of a spatial structure by using a stratification matrix. Our method exactly satisfies given inclusion probabilities and provides samples that are very well-spread. A set of simulations shows that our method outperforms other existing methods such as the Generalized Random Tessellation Stratified (GRTS) or the Local Pivotal Method (LPM). Analysis of the variance on a real dataset shows that our method is more accurate than these two. Furthermore, a variance estimator is proposed.

stat.ME↗

Measuring the spatial balance of a sample: A new measure based on the Moran's I index

Measuring the degree of spatial spreading of a sample can be of great interest when sampling from a spatial population. The commonly used spatial balance index by Grafström et al. (2012) is particularly effective in comparing the level of spatial spreading of different samples from the same population. However, its unbounded and uninterpretable scale of measurement does not allow to assess the level of spatial spreading in absolute terms and confines its use to only raw comparisons. In this paper, we introduce a new absolute measure of the spatial spreading of a sample using a normalized version of the Moran's $I$ index. The properties and behaviour of the proposed measure are analysed through two simulation experiments, one based on artificial populations and the other on a population of real business units located in the province of Siena (Italy).

stat.ME↗

Sampling Designs on Finite Populations with Spreading Control Parameters

We present new sampling methods in finite population that allow to control the joint inclusion probabilities of units and especially the spreading of sampled units in the population. They are based on the use of renewal chains and multivariate discrete distributions to generate the difference of population ranks between two successive selected units. With a Bernoulli sampling design, these differences follow a geometric distribution, and with a simple random sampling design they follow a negative hypergeometric distribution. We propose to use other distributions and introduce a large class of sampling designs with and without fixed sample size. The choice of the rank-difference distribution allows us to control units joint inclusion probabilities with a relatively simple method and closed form formula. Joint inclusion probabilities of neighboring units can be chosen to be larger, or smaller, compared to those of Bernoulli or simple random sampling, thus allowing to more or less spread the sample on the population. This can be useful when neighboring units have similar characteristics or, on the contrary, are very different. A set of simulations illustrates the qualities of this method.

stat.ME↗

Probability Sampling Designs: Principles for Choice of Design and Balancing

The aim of this paper is twofold. First, three theoretical principles are formalized: randomization, overrepresentation and restriction. We develop these principles and give a rationale for their use in choosing the sampling design in a systematic way. In the model-assisted framework, knowledge of the population is formalized by modelling the population and the sampling design is chosen accordingly. We show how the principles of overrepresentation and of restriction naturally arise from the modelling of the population. The balanced sampling then appears as a consequence of the modelling. Second, a review of probability balanced sampling is presented through the model-assisted framework. For some basic models, balanced sampling can be shown to be an optimal sampling design. Emphasis is placed on new spatial sampling methods and their related models. An illustrative example shows the advantages of the different methods. Throughout the paper, various examples illustrate how the three principles can be applied in order to improve inference.

stat.ME↗

Quasi-Systematic Sampling From a Continuous Population

A specific family of point processes are introduced that allow to select samples for the purpose of estimating the mean or the integral of a function of a real variable. These processes, called quasi-systematic processes, depend on a tuning parameter $r>0$ that permits to control the likeliness of jointly selecting neighbor units in a same sample. When $r$ is large, units that are close tend to not be selected together and samples are well spread. When $r$ tends to infinity, the sampling design is close to systematic sampling. For all $r > 0$, the first and second-order unit inclusion densities are positive, allowing for unbiased estimators of variance. Algorithms to generate these sampling processes for any positive real value of $r$ are presented. When $r$ is large, the estimator of variance is unstable. It follows that $r$ must be chosen by the practitioner as a trade-off between an accurate estimation of the target parameter and an accurate estimation of the variance of the parameter estimator. The method's advantages are illustrated with a set of simulations.

stat.ME↗

Balanced $k$-nearest neighbor imputation

In order to overcome the problem of item nonresponse, random imputation methods are often used because they tend to preserve the distribution of the imputed variable. Among the random imputation methods, the random hot-deck has the interesting property of imputing observed values. A new random hot-deck imputation method is proposed. The key innovation of this method is that the selection of donors is viewed as a sampling problem and uses calibration and balanced sampling. This approach makes it possible to select donors such that if the auxiliary variables were imputed, their estimated totals would not change. As a consequence, very accurate and stable totals estimations can be obtained. Moreover, the method is based on a nonparametric procedure. Donors are selected in neighborhoods of recipients. In this way, the missing value of a recipient is replaced with an observed value of a similar unit. This new approach is very flexible and can greatly improve the quality of estimations. Also, this method is unbiased under very different models and is thus resistant to model misspecification. Finally, the new method makes it possible to introduce edit rules while imputing.

stat.ME↗