Searcharxiv⌕ Search

arXiv · 2609.33349

Renewable Online Expectile Regression for Heterogeneous Streaming Data with Abnormal Batches

Abstract

Streaming data, characterized by high volume, rapid arrival rates, and evolving distributions, have become increasingly prevalent in modern applications. Developing efficient and reliable estimation procedures is therefore essential for real-time statistical analysis. However, most existing online estimation methods rely on the assumption of batch homogeneity, which can be violated in practice due to abnormal batches, distributional shifts, or other forms of batch heterogeneity. To address this challenge, we develop renewable online expectile regression procedures for heterogeneous streaming data. Specifically, we propose two complementary strategies for handling abnormal batches: (1) a detection-based approach that employs a sequential monitoring mechanism based on score test statistics to identify and remove potentially abnormal batches; and (2) an adaptive-weighting approach that assigns data-driven weights to incoming batches, reducing the influence of abnormal or drifting batches while retaining information from reliable observations. Both strategies rely solely on score test statistics and can be seamlessly integrated into existing renewable estimation and inference frameworks without requiring additional structural assumptions. Furthermore, to enhance robustness against heavy-tailed errors and outliers, we replace the conventional l2 loss with the Huber loss and develop a robust extension of renew?able online expectile regression. Extensive simulation studies and analyses of clinical datasets demonstrate that the proposed methods achieve improved estimation accuracy and robustness in the presence of batch heterogeneity. Overall, the proposed framework provides a flexible and effective solution for renewable expectile regression in complex streaming data environments.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Wei Cao, Shanshan Wang. 2026-09-27. Renewable Online Expectile Regression for Heterogeneous Streaming Data with Abnormal Batches. https://arxiv.org/abs/2609.33349

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Delaunay Weighted Two-sample Test for High-dimensional Data by Incorporating Geometric Information

Two-sample hypothesis testing is a fundamental problem with various applications, which faces new challenges in the high-dimensional context. To mitigate the issue of the curse of dimensionality, high-dimensional data are typically assumed to lie on a low-dimensional manifold. To incorporate geometric information in the data, we propose to apply the Delaunay triangulation and develop the Delaunay weight to measure the geometric proximity among data points. In contrast to existing similarity measures that only utilize pairwise distances, the Delaunay weight can take both the distance and direction information into account. A detailed computation procedure is developed to learn the unknown manifold and approximate the Delaunay weight. We further propose a novel nonparametric test statistic using the Delaunay weight matrix. Asymptotic normality under the null and consistency under the alternative of the test statistic are developed. Applied to simulated data, the new test shows robustness to the learning of the unknown manifold and exhibits substantial power gain if the distributions differ in the principal directions of covariance matrices. The proposed test also detects significant differences on a real dataset of mice protein expression levels.

stat.ME↗

Randomization Tests in Switchback Experiments

Switchback experiments assign an experimental unit, such as a market or a platform, to treatment or control over successive blocks of time. Inference can be challenging because these experiments often contain only a small number of randomized blocks, while outcomes may exhibit serial dependence, seasonality, and treatment effects that persist across periods. We develop a conditional randomization test for the null of no total treatment effect that is finite-sample valid under standard assumptions on temporal interference without requiring a parametric model for outcomes. We also develop randomization tests for these assumptions: a carryover test that assesses whether past assignments continue to affect outcomes beyond a prespecified horizon and a non-anticipation test that assesses whether future assignments affect current outcomes. For hypotheses about average treatment effects, we establish asymptotic validity of studentized randomization tests under additional regularity conditions. Finally, we derive power approximations and characterize the tradeoffs between experimental design choices, the number of informative randomized comparisons, and statistical power. Numerical experiments with stylized potential outcomes and a dynamic rideshare model illustrate finite-sample performance and implications for experimental design.

stat.ME↗

Outcome-blinded sample size re-estimation for externally controlled single-arm trials using baseline covariates

Externally controlled single-arm trials provide an option when limited patient populations or ethical constraints make concurrent randomized controls impractical, including in rare diseases and investigator-initiated trials with limited recruitment. Standardization improves comparability by aligning external controls with the enrolled population, but does not by itself preserve planned power. Differences between anticipated and enrolled covariate distributions can change the precision of the standardized control estimate and leave a fixed-size trial underpowered. We propose an outcome-blinded, covariate-adaptive sample size re-estimation procedure that translates these changes in precision into updated recruitment targets. Historical-control data and accumulating active-arm baseline covariates are used to update external-control standardization and its estimated precision. Adaptation requires no active-arm outcomes and retains the prespecified clinically meaningful effect to be detected. We state sufficient conditions for type I error calibration and power after adaptive stopping, assess operating characteristics through simulations, and illustrate implementation using Alzheimer's Disease Cooperative Study data. In the primary simulations, adaptive recruitment restored power lost under standardized fixed designs, achieving at least the target power across the distribution-shift settings and outcome models examined. Type I error rates were close to nominal, although mild inflation remained with a smaller historical-control sample. The application illustrated how accumulating baseline information guided recruitment revisions. By adapting sample size to the precision of the population-standardized control estimate, the proposed procedure addresses a source of power loss that standardization alone does not resolve.

stat.ME↗