SearcharxivSearch

arXiv subjects

Molly Offer-Westort

Publications and source records attributed to Molly Offer-Westort.

3 recordsLinked to original sources

Designing Multi-Arm Experiments for Global Average Treatment Effects Under Partial Interference

When interference is present, a unit's outcome depends on others' assignments and there is generally no single, design-free average treatment effect. We study settings where the decision problem is to choose among several alternative uniform policies---e.g., rolling out one platform configuration to all users, or one policy to all constituents---so the estimand of interest is the Global Average Treatment Effect (GATE), the average outcome difference under two uniform (global) policies. Under partial interference with clusters, cluster-level randomization identifies the GATE but can be statistically inefficient, while unit-level randomization can be highly precise yet biased for the GATE. We propose a continuum of implementable two-stage randomization designs that smoothly interpolate between these extremes by tuning within-cluster treatment correlation. For multi-arm experiments, we operationalize this continuum via a Dirichlet--multinomial design and give a pilot- and model-assisted procedure for selecting the design parameter using estimated finite-sample RMSE for the GATE. We also show that, even under a correctly specified linear interference model, difference-in-means estimators can have lower RMSE than least squares regression for GATE targets.Simulations and a large-scale Facebook video-player configuration experiment (43 million user sessions) illustrate the practical trade-off: intermediate designs can substantially reduce RMSE for estimating global rollout effects while remaining straightforward to deploy at scale.

stat.ME

On the Foundations of the Design-Based Approach

The design-based paradigm may be adopted in causal inference and survey sampling when we assume Rubin's stable unit treatment value assumption (SUTVA) or impose similar frameworks. While often taken for granted, such assumptions entail strong claims about the data generating process. We develop an alternative design-based approach: we first invoke a generalized, non-parametric model that allows for unrestricted forms of interference, such as spillover. We define an associated set of inferential targets and discuss their interpretation under SUTVA and a weaker assumption that we call the No Unmodeled Revealable Variation Assumption (NURVA). We then reconstruct the standard paradigm, reconsidering SUTVA at the end rather than assuming it at the beginning. Despite its similarity to SUTVA, we demonstrate the practical limitations of NURVA alone for identifying substantively interesting quantities. In so doing, we provide clarity on the nature and importance of SUTVA for applied research.

stat.ME

Battling the Coronavirus Infodemic Among Social Media Users in Kenya and Nigeria

How can we induce social media users to be discerning when sharing information during a pandemic? An experiment on Facebook Messenger with users from Kenya (n = 7,498) and Nigeria (n = 7,794) tested interventions designed to decrease intentions to share COVID-19 misinformation without decreasing intentions to share factual posts. The initial stage of the study incorporated: (i) a factorial design with 40 intervention combinations; and (ii) a contextual adaptive design, increasing the probability of assignment to treatments that worked better for previous subjects with similar characteristics. The second stage evaluated the best-performing treatments and a targeted treatment assignment policy estimated from the data. We precisely estimate null effects from warning flags and related article suggestions, tactics used by social media platforms. However, nudges to consider information's accuracy reduced misinformation sharing relative to control by 4.9% (estimate = -2.3 pp, s.e. = 1.0 , Z = -2.31, p = 0.021, 95% CI = [-4.2 , -0.35]). Such low-cost scalable interventions may improve the quality of information circulating online.

cs.SI