SearcharxivSearch

arXiv subjects

Christopher Adjaho

Publications and source records attributed to Christopher Adjaho.

2 recordsLinked to original sources

Sequentially-Rerandomized Switchback Experiments

Large-scale online platforms and marketplace systems often evaluate new policies through experiments that randomize treatment across operational units (e.g., geographies, regions, or clusters) over many time periods. In these settings, standard A/B testing can be inefficient or unreliable due to a limited number of units, substantial cross-unit heterogeneity, non-stationarity, and potential carryover across periods. We propose Sequentially-Rerandomized Switchback Experiments (SRSB), a new experimental design that helps mitigate these challenges. SRSB re-randomizes treatment at each time period such as to enforce balance on pre-specified prognostic variables constructed from past observations. In the absence of carryover, SRSB improves precision by leveraging temporal dependence through balancing lagged outcomes and covariates; we develop finite-sample randomization inference under a sharp null as well as asymptotic inference as the number of periods grows. We then extend SRSB to settings with first-order carryover and introduce a blocked SRSB variant that rerandomizes within strata defined by the previous treatment to form stable and comparable "stay" groups. Extensive simulations demonstrate the practical gains and robustness of SRSB relative to standard switchback designs.

stat.ME

Externally Valid Policy Choice

We consider the problem of estimating personalized treatment policies that are "externally valid" or "generalizable": they perform well in target populations that differ from the experimental (or training) population from which the data are sampled. We first show that welfare-maximizing policies for the experimental population are robust to a certain class of shifts in the distribution of potential outcomes between the experimental and target populations (holding characteristics fixed). We then develop methods for estimating policies that are robust to shifts in the joint distribution of outcomes and characteristics. In doing so, we highlight how treatment effect heterogeneity within the experimental population shapes external validity.

econ.EM