Searcharxiv⌕ Search

arXiv · 2609.37756

Sequential Supersaturated Screening Experiments

Abstract

Supersaturated screening experiments study many candidate factors with few runs. The experimenter must first identify the active factors, then optimize the response. One-shot regularized regression tends to select many factors, and the second-order response surface model in the selected factors is then large and needs many further runs to fit. We propose Sequential Supersaturated Screening ($S^3$), a two-stage framework for supersaturated designs. $S^3$ builds each screening round by coordinate exchange under a new positive-cone design criterion that uses no practitioner-chosen Welch calibration constant. It then removes low-importance factors one round at a time, using a graduated quantile rule. The criterion scores a design by how far its column correlations sit above the Welch lower bound, and it adapts to the current number of runs and candidate factors. We give a round-by-round bound on the probability that a noise factor is ever fixed, under conditions on noise survival and commitment at each round, together with an explicit upper bound on the total number of Stage 1 runs. Across simulated screening problems and the Borehole benchmark, $S^3$ achieves lower Type I error and higher $F_1$ scores than one-shot cross-validated Lasso (LassoCV). It also improves optimization quality in most settings and runs faster.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Songqiao Han, Kalliopi Mylona, Steven Gilmour, Matteo Borrotti. 2026-09-29. Sequential Supersaturated Screening Experiments. https://arxiv.org/abs/2609.37756

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Delaunay Weighted Two-sample Test for High-dimensional Data by Incorporating Geometric Information

Two-sample hypothesis testing is a fundamental problem with various applications, which faces new challenges in the high-dimensional context. To mitigate the issue of the curse of dimensionality, high-dimensional data are typically assumed to lie on a low-dimensional manifold. To incorporate geometric information in the data, we propose to apply the Delaunay triangulation and develop the Delaunay weight to measure the geometric proximity among data points. In contrast to existing similarity measures that only utilize pairwise distances, the Delaunay weight can take both the distance and direction information into account. A detailed computation procedure is developed to learn the unknown manifold and approximate the Delaunay weight. We further propose a novel nonparametric test statistic using the Delaunay weight matrix. Asymptotic normality under the null and consistency under the alternative of the test statistic are developed. Applied to simulated data, the new test shows robustness to the learning of the unknown manifold and exhibits substantial power gain if the distributions differ in the principal directions of covariance matrices. The proposed test also detects significant differences on a real dataset of mice protein expression levels.

stat.ME↗

Randomization Tests in Switchback Experiments

Switchback experiments assign an experimental unit, such as a market or a platform, to treatment or control over successive blocks of time. Inference can be challenging because these experiments often contain only a small number of randomized blocks, while outcomes may exhibit serial dependence, seasonality, and treatment effects that persist across periods. We develop a conditional randomization test for the null of no total treatment effect that is finite-sample valid under standard assumptions on temporal interference without requiring a parametric model for outcomes. We also develop randomization tests for these assumptions: a carryover test that assesses whether past assignments continue to affect outcomes beyond a prespecified horizon and a non-anticipation test that assesses whether future assignments affect current outcomes. For hypotheses about average treatment effects, we establish asymptotic validity of studentized randomization tests under additional regularity conditions. Finally, we derive power approximations and characterize the tradeoffs between experimental design choices, the number of informative randomized comparisons, and statistical power. Numerical experiments with stylized potential outcomes and a dynamic rideshare model illustrate finite-sample performance and implications for experimental design.

stat.ME↗

Minimum Specification Perturbation: Robustness as Distance-to-Falsification in Causal Inference

Empirical causal claims depend on many analyst decisions, from selecting covariates to choosing estimators. Existing robustness tools summarize how results vary across these choices, but, to the best of our knowledge, do not answer: \textbf{How many analyst decisions must change to reach a specification, which is a set of choices, whose confidence interval (CI) contains zero?} We introduce \emph{Minimum Specification Perturbation (MSP)}, the smallest number of changes. MSP is small under the null, grows with effect strength and captures distance-to-falsification information that dispersion-based summaries cannot report; when making decisions under weak effects, an MSP-based rule yields lower false-positive rates than dispersion-based rules. We show that Fragility Index and MSP measure orthogonal vulnerabilities: fragility to influential observations need not imply fragility to specification choices. On the LaLonde benchmark, MSP = 1 implies that one decision change makes the CI contain zero. We further provide exact permutation calibration under randomization and characterize computation, showing tractable cases under additive structure and NP-hardness in general.

stat.ME↗