Searcharxiv⌕ Search

arXiv subjects

Danhyang Lee

Publications and source records attributed to Danhyang Lee.

5 recordsLinked to original sources

A Semiparametric Model Approach to Data Integration under Missing Not at Random

Integrating probability and non-probability samples requires accounting for an unknown selection mechanism that may depend on the outcome. We develop a semiparametric approach in which an unspecified function captures covariate dependence and a scalar tilting parameter governs outcome dependence. Identification follows from an instrumental-variable exclusion restriction and conditional completeness; a zero tilt gives a restricted missing-at-random submodel. We profile out the covariate component and construct cross-fitted, Neyman-orthogonal estimating equations for both the tilting parameter and the finite population mean. The resulting orthogonalized mass-imputation estimator supports centered root-N inference under nuisance product-rate conditions. Its linearization variance accounts for the probability sampling design and estimation of the tilting parameter. Simulations illustrate the cost of flexibility under correct parametric specification, protection against misspecification of the covariate component, and the consequences of invalid instruments or a misspecified tilt. A further simulation using 50,000 national health-screening records finds smaller bias but higher root mean squared error than a parametric competitor under the baseline instrument set. The proposed estimator varies less across alternative instrument sets, although weak instruments and smoothing choices affect precision and interval coverage.

stat.ME↗

Bridge-Anchored Partial Identification of a Target Mean under Outcome-Model Drift

Transporting an outcome relationship from a source population to a target population where the outcome is unobserved requires the conditional outcome law to be stable across populations. When it is not (outcome-model drift), the target mean is not point-identified and existing transportability estimators are biased. We study settings, common in cross-cohort educational and biomedical data integration, in which bridge outcomes are recorded in both populations and can be expected to drift alongside the target outcome. The bridge splits the drift into a component it can detect, fixed by a bridge-matching equation, and a residual orthogonal to the bridge that no observed quantity restricts. Because the target is a mean, the residual acts through a single scalar sensitivity parameter $κ$. We prove that the identified set has a closed-form irreducible core, whose width is governed by the residual bound and by how much of the outcome the bridge leaves unexplained, and that its center is first-order invariant to the residual. These results hold for any working exponential family, with point identification arising only as the $κ=0$ benchmark. We develop a debiased, drift-augmented estimator that is semiparametrically efficient at anchored sensitivity, doubly robust conditional on the bridge-identified drift, and yields rate-robust Imbens-Manski inference for the set. Unlike a bridge-blind sensitivity analysis, which must bound the entire drift channel, the proposed analysis bounds only its bridge-orthogonal part. Simulations confirm that the drift estimator is unbiased under co-drift, that the core width follows its closed form, and that the set fails visibly once the residual bound is exceeded. The motivating setting is the integration of two survey cohorts whose kindergarten mathematics outcome is available in only one.

stat.ME↗

Design-based individual prediction

A design-based individual prediction approach is developed based on the expected cross-validation results, given the sampling design and the sample-splitting design for cross-validation. Whether the predictor is selected from an ensemble of models or a weighted average of them, valid inference of the unobserved prediction errors is defined and obtained with respect to the sampling design, while outcomes and features are treated as constants.

stat.ML↗

Maximum Entropy classification for record linkage

By record linkage one joins records residing in separate files which are believed to be related to the same entity. In this paper we approach record linkage as a classification problem, and adapt the maximum entropy classification method in text mining to record linkage, both in the supervised and unsupervised settings of machine learning. The set of links will be chosen according to the associated uncertainty. On the one hand, our framework overcomes some persistent theoretical flaws of the classical approach pioneered by Fellegi and Sunter (1969); on the other hand, the proposed algorithm is scalable and fully automatic, unlike the classical approach that generally requires clerical review to resolve the undecided cases.

stat.ME↗

Semiparametric Imputation Using Conditional Gaussian Mixture Models under Item Nonresponse

Imputation is a popular technique for handling item nonresponse in survey sampling. Parametric imputation is based on a parametric model for imputation and is less robust against the failure of the imputation model. Nonparametric imputation is fully robust but is not applicable when the dimension of covariates is large due to the curse of dimensionality. Semiparametric imputation is another robust imputation based on a flexible model where the number of model parameters can increase with the sample size. In this paper, we propose another semiparametric imputation based on a more flexible model assumption than the Gaussian mixture model. In the proposed mixture model, we assume a conditional Gaussian model for the study variable given the auxiliary variables, but the marginal distribution of the auxiliary variables is not necessarily Gaussian. We show that the proposed mixture model achieves a lower approximation error bound to any unknown target density than the Gaussian mixture model in terms of the Kullback-Leibler divergence. The proposed method is applicable to high dimensional covariate problem by including a penalty function in the conditional log-likelihood function. The proposed method is applied to 2017 Korean Household Income and Expenditure Survey conducted by Statistics Korea. Supplementary material is available online.

stat.ME↗