SearcharxivSearch

arXiv subjects

Giacomo Opocher

Publications and source records attributed to Giacomo Opocher.

4 recordsLinked to original sources

Stable Policy Learning

In evidence-based policymaking, typically one experimental sample is observed, then a learned policy recommendation is implemented at scale. Policies learned from the experimental data can perform well in expected welfare, yet random sampling in the experiment can produce recommendations with poor welfare outcomes. In this paper, we ask: how should policy learning algorithms balance expected welfare against sampling risk? Our main contribution is to show that algorithmic stability plays a central role in characterizing and navigating the tradeoff. Intuitively, if a policy learning algorithm's recommendation remains stable when one experimental unit is replaced, then that algorithm has limited sampling risk. We propose a method for policy learning called policy-vote bagging, which learns treatment decisions on many subsamples then averages their votes into treatment probabilities. Relative to using one subsample, averaging across subsamples preserves expected welfare and improves expected utility for a risk-averse researcher. We derive sharp bounds linking estimation accuracy, subsample size, and welfare variation, including an exact guarantee under CARA utility.

econ.EM

Producing Policy Recommendations: from Statistical Decision Theory to Empirical Practice

Applied research in economics is intrinsically motivated by broad normative objectives. However, it is not obvious how a researcher should direct their efforts to produce evidence toward such objectives. This paper reviews recent theoretical developments on research design for policy choice and provides new tools applied researchers can use to guide their design choices and communicate their policy recommendations. First, I focus on theoretical contributions in econometrics and provide a general framework that nests all the contexts and results reviewed using a coherent notation and narrative. Then, I present two diagrams applied researchers can use to navigate the theoretical literature starting from concrete scenarios to make thoughtful design choices. Finally, I introduce a new R package that produces one table and two figures applied researchers can plug in their `policy implications' section to provide evidence on the performance of different policy recommendations coming out of their study. The use of such tools is illustrated with an example in development economics.

econ.EM

Learning Where to Look: Delaunay Matching for Policy Choice and Data Collection

This paper studies data-driven policy choices from a geometric perspective. A sample from a donor population fully exposed to an innovation informs a policymaker (PM) on whether to innovate groups in a target population where the innovation was not introduced. Any wrong decision must be compensated from a finite budget and the PM seeks an estimator of the innovation's effect that guarantees an affordable compensation cost. I focus on matching estimators with positive weights and derive affordability guarantees when finite and large samples of the populations of interest are available. In the latter case, Delaunay interpolants, whose properties are well-known from results in computational geometry, deliver the smallest budget that covers the compensation cost uniformly over the admissible target populations, and conditional on the donor collection design. This result informs where to look for new donor observations to decrease the worst-case compensation cost the most. In an empirical application, I show that such collection plans halve the cost by adding three donor units, while random sampling fails to reach the same target within twenty additions.

econ.EM

Better Measurement or Larger Samples? Data Collection for Policy Learning with Unobserved Heterogeneity

Empirical research shows that individuals' responses to treatments vary along latent characteristics, such as innate ability or motivation. Therefore, a policymaker seeking to maximize welfare may consider designing policies based on observed characteristics and estimated latent traits. I characterize how the estimates' precision affects the worst-case performance of policies deriving rate-sharp regret bounds for assignment rules that include or exclude them, highlighting new trade-offs with the policy space complexity. I then study how a policymaker can solve such trade-offs by designing tailored data collections and derive a sufficient condition for a collection plan to be minimax optimal. In an empirical application in development economics, I show that including a proxy for entrepreneurs' business skills in targeting cash transfers increases welfare by 5%, and halves the probability of generating welfare losses. Moreover, I estimate the optimal allocation of resources between improving the precision of the proxy via repeated measurements, and increasing sample size.

econ.EM