arXiv subjects

Vod Vilfort

Publications and source records attributed to Vod Vilfort.

5 recordsLinked to original sources

arXiv2026

Headline Estimation with Multiple Research Designs

To study a scalar parameter, a researcher may consider multiple research designs. Based on the evidence across designs, the researcher may wish to formulate a headline estimate of the parameter. I examine how to choose this headline when it is unclear which design is most appropriate for studying the parameter. I model this setting by assuming that (i) exactly one of the designs is valid for the parameter and (ii) the researcher has ambiguity about which design is valid, represented by a class of priors over the candidate designs. To account for ambiguity, I propose reporting the headline estimate that minimizes the worst-case posterior risk over the class of priors. In three applications, I show cases where accounting for ambiguity materially affects the quantitative conclusion and cases where an existing headline is already close to optimal.

econ.EM↗

arXiv2026

Robust Inference for Weighted Estimands

Researchers often conduct inference on weighted estimands, defined as weighted averages of group-level effects. Example settings include event studies with cohort-level effects and experiments with site-level effects. Under heterogeneous effects, different weighting schemes yield estimands with distinct empirical and policy interpretations, leading to ambiguity and disagreement over the choice of weights. I establish bounds on differences between weighted estimands and confidence bounds on effect heterogeneity, which I use to construct estimators that minimize worst-case bias and confidence intervals that are uniformly valid over classes of weighted estimands. I apply these methods to an event study in Lakdawala, Nakasone, and Kho (2023), which studies the effects of school-based internet access on test scores. I find that results are robust to broad classes of weights. I then apply the methods to Tennessee's Project STAR experiment and find that results are sensitive to small departures from baseline weights.

econ.EM↗

arXiv2026

Integrating Diagnostic Checks into Estimation

Empirical researchers often use diagnostic checks to assess the plausibility of their modeling assumptions, such as testing for covariate balance in RCTs, pre-trends in event studies, or instrument validity in IV designs. While these checks are traditionally treated as external hurdles to estimation, we argue they should be integrated into the estimation process itself. In particular, we propose residualizing one's baseline estimator against the vector of diagnostic check statistics to remove the component of baseline sampling variation explained by the diagnostic checks. This residualized estimator offers researchers a "free lunch," delivering three properties simultaneously: (i) eliminating inference distortions from check-based selective reporting; (ii) reducing variance without changing the estimand when the baseline model is correctly specified; and (iii) minimizing worst-case bias under bounded local misspecification within the class of linear adjustments. We apply our method to the RCT in Kaur et al. (2024) and find that, even in a setting where all balance checks pass comfortably, residualization increases the magnitude of the baseline point estimate and reduces its standard error, equivalent to approximately a 10% increase in sample size.

econ.EM↗

arXiv2025

"Post" Pre-Analysis Plans: Valid Inference for Non-Preregistered Specifications

Pre-analysis plans (PAPs) have become standard in experimental economics research, but it is nevertheless common to see researchers deviating from their PAPs to supplement preregistered estimates with non-prespecified findings. While such ex-post analysis can yield valuable insights, there is broad uncertainty over how to interpret -- or whether to even acknowledge -- non-preregistered results. In this paper, we consider the case of a truth-seeking researcher who, after seeing the data, earnestly wishes to report additional estimates alongside those preregistered in their PAP. We show that, even absent "nefarious" behavior, conventional confidence intervals and point estimators are invalid due to the fact that non-preregistered estimates are only reported in a subset of potential data realizations. We propose inference procedures that account for this conditional reporting. We apply these procedures to Bessone et al. (2021), which studies the economic effects of increased sleep among the urban poor. We demonstrate that, depending on the reason for deviating, the adjustments from our procedures can range from having no difference to an economically significant difference relative to conventional practice. Finally, we consider the robustness of our procedure to certain forms of misspecification, motivating possible heuristic checks and norms for journals to adopt.

econ.EM↗

arXiv2024

Interpreting TSLS Estimators in Information Provision Experiments

To estimate the causal effects of beliefs on actions, researchers often run information provision experiments. We consider the causal interpretation of two-stage least squares (TSLS) estimators in these experiments. We characterize common TSLS estimators as weighted averages of causal effects, and interpret these weights under general belief updating conditions that nest parametric models from the literature. Our framework accommodates TSLS estimators for both passive and active control designs. Notably, we find that some passive control estimators allow for negative weights, which compromises their causal interpretation. We give practical guidance on such issues, and illustrate our results in two empirical applications.

econ.EM↗