Searcharxiv⌕ Search

arXiv subjects

Youwu Lin

Publications and source records attributed to Youwu Lin.

3 recordsLinked to original sources

High-Dimensional Nonsparse Regression under Covariate Shift via Importance-Weighted Partial Least Squares

This paper studies high-dimensional nonsparse regression when the data exhibit both strong predictor dependence and covariate shift. Many existing regression methods struggle with highly correlated predictors, while covariate shift can make components learned from source data less effective for target-domain prediction. To address these joint challenges, we develop an importance-weighted partial least squares (IWPLS) method that reweights source observations to reflect the target covariate distribution and extracts response-relevant components for coefficient estimation. The resulting estimator depends on weighted sample covariances, which generally lack the usual Wishart structure even when the target-domain covariates are Gaussian. We therefore combine a perturbation analysis of weighted PLS moments with an influence-function decomposition to establish consistency for the one- and multi-component estimators and asymptotic normality for the one-component estimator. Simulation studies and real-data analyses show that IWPLS outperforms the benchmark methods considered.

stat.ME↗

Projection-Based Partial Correlation Inference Beyond Sparsity

Valid inference for partial correlation in high-dimensional Gaussian models is challenging when the conditioning variables exhibit dense dependence and conventional sparsity assumptions are inappropriate. We develop a target-specific projection framework for estimating and testing a population partial correlation without requiring coordinate sparsity. A population quadratic criterion characterizes the information retained by a linear reduction and is maximized by a one-dimensional projection. Under a rank-one alignment condition, this optimal projection preserves the original partial correlation. To obtain a feasible procedure, we estimate the optimal direction using diagonal ridge regularization on an independent training sample. Under conditions on regularized effective dimension and target-specific ridge bias, we establish a quantitative direction-estimation rate in the covariance-induced prediction norm. We further show that, under alignment, the induced partial-correlation error is second order in the direction error. These results yield oracle equivalence and asymptotic normality for the feasible split-sample estimator, as well as asymptotically valid testing of the original zero-partial-correlation null. Exact finite-sample \(F\)-calibration holds under the projected null. An explicit coordinate-dense Gaussian model verifies the required rates even when the dimension exceeds the sample size. Numerical experiments illustrate the finite-sample performance of the proposed procedures.

stat.ME↗

MMDCP: A Distribution-free Approach to Outlier Detection and Classification with Coverage Guarantees and SCW-FDR Control

We propose the Modified Mahalanobis Distance Conformal Prediction (MMDCP), a unified framework for multi-class classification and outlier detection under label shift, where the training and test distributions may differ. In such settings, many existing methods construct nonconformity scores based on empirical cumulative or density functions combined with data-splitting strategies. However, these approaches are often computationally expensive due to their heavy reliance on resampling procedures and tend to produce overly conservative prediction sets with unstable coverage, especially in small samples. To address these challenges, MMDCP combines class-specific distance measures with full conformal prediction to construct a score function, thereby producing adaptive prediction sets that effectively capture both inlier and outlier structures. Under mild regularity conditions, we establish convergence rates for the resulting sets and provide the first theoretical characterization of the gap between oracle and empirical conformal $p$-values, which ensures valid coverage and effective control of the class-wise false discovery rate (CW-FDR). We further introduce the Summarized Class-Wise FDR (SCW-FDR), a novel global error metric aggregating false discoveries across classes, and show that it can be effectively controlled within the MMDCP framework. Extensive simulations and two real-data applications support our theoretical findings and demonstrate the advantages of the proposed method.

stat.ME↗