Searcharxiv⌕ Search

arXiv · 2611.21230

Shrink Responsibly: Empirical Bayes in Economics

Abstract

Empirical researchers are often interested in the relative causal impact of individuals or institutions such as teachers, schools, hospitals, or neighborhoods. Regression-based estimates of such unit-specific parameters are often noisy; empirical Bayes (eB) methods can help isolate the signal from the estimation noise. This article provides an overview of eB methodology, showing how eB shrinkage can improve compound decisions---such as selecting individuals with the highest causal impacts---even when the working model motivating the shrinkage is misspecified. Not all analyses benefit from eB shrinkage, however, and we discuss which types of causal summaries are best estimated directly and how to do so robustly. We illustrate practical takeaways with a running analysis of public elementary and middle school value-added.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Peter Hull, Michal Kolesár. 2026-11-16. Shrink Responsibly: Empirical Bayes in Economics. https://searcharxiv.com/abs/2611.21230

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

Difference-in-differences for mediation analysis using double machine learning

We propose a difference-in-differences (DiD) framework with mediation for possibly multivalued discrete or continuous treatments and mediators, aimed at identifying the direct effect of the treatment on the outcome (net of effects operating through the mediator), the indirect effect via the mediator, and the joint effects of treatment and mediator, consistent with the framework of dynamic treatment effects. Identification relies on a conditional parallel trends assumption imposed on the mean potential outcome across treatment and mediator states, or (depending on the causal parameter) additionally on the mean potential outcomes and potential mediator distributions across treatment states. We propose ATET estimators for repeated cross sections and panel data within the double/debiased machine learning framework, which allows for data-driven control of covariates, and we establish their asymptotic normality under standard regularity conditions. We investigate the finite-sample performance of the proposed methods in a simulation study and illustrate our approach in an empirical application to the US National Longitudinal Survey of Youth, estimating the direct effect of health care coverage on general health as well as the indirect effect operating through routine checkups.

econ.EM↗

The Online LSTM Prediction Models and The Term Structure of Predictions

We examine and illustrate the properties of the Long Short Term Memory (LSTM) prediction models applied online to stationary inputs. We discuss the effects of: a) the network architecture that defines the admissible prediction functions, b) the objective function used to measure the prediction accuracy, and c) the Stochastic Gradient Descent (SGD) algorithm. We also study the prediction optimality, the term structure of predictions, the filtered memory dynamics. We also introduce a set of diagnostic tools for memory-based prediction models that focus on the estimated dynamics of the hidden states.

econ.EM↗

Estimation and Model Selection in Factor Models with Long Memory

Panels in economics, finance and climate science are often driven by common components that differ in memory, such as common trends, cycles, or joint shocks. We study approximate factor models whose common factors are fractionally integrated with heterogeneous and unknown memory and develop the asymptotic theory of principal components for the panel in levels. Our theory builds on the eigenvalues of the sample covariance matrix being ordered by memory asymptotically: a nonstationary factor group with memory $d>1/2$ generates eigenvalues of order $NT^{2d-1}$, whereas stationary factors generate eigenvalues of order $N$. Principal components estimate the factors consistently up to rotation, while adjacent factor groups are separated at a rate given by their memory gap. The information criteria of Bai and Ng remain consistent for the total number of factors, with their penalties acting as thresholds on eigenvalues that are asymptotically ordered by factor memory. When the nonstationary factors lose their variance advantage, estimation in levels remains consistent, whereas after differencing the factors can become undetectable. A Monte Carlo study shows that factor-number selection in levels tolerates more idiosyncratic noise than selection after first differencing. For monthly temperatures at $308$ European weather stations, our methods select two factors. The first is a persistent common warming factor. The estimated common component implies that 2021-2025 was $2.15^\circ\mathrm{C}$ warmer than 1960-1990, with the strongest warming in Eastern Europe. After first differencing, the criterion selects one factor, and loses regional heterogeneity as compared to the model in levels.

econ.EM↗