Searcharxiv⌕ Search

arXiv · 2611.14385

Semiparametric Inference in Panel Data with Interactive and High-dimensional Confounding

Abstract

This paper develops inference for a low-dimensional treatment coefficient in partially linear panel models with high-dimensional observed covariates and latent interactive confounding. Flexible adjustment for observed covariates can leave correlated factor components in treatment and outcome residuals, invalidating standard double/debiased machine learning (DML). We propose Factor-Augmented DML (FA-DML), which estimates treatment-side and reduced-form factor spaces from first-stage residuals. The estimator combines a feasible double projection with three-fold, unit-level cross-fitting. The double projection controls interactions between the two estimated factor spaces. The separate folds eliminate same-training-unit pairings in the leading disturbance components of the factor-estimation errors. Under fixed factor ranks, pervasive factor signals, strict exogeneity, and joint asymptotics in the number of units N and periods T , FA-DML is first-order equivalent to an infeasible oracle, is asymptotically normal, and admits consistent variance estimation. In the baseline simulation design with strong interactive confounding, FA-DML confidence intervals have coverage close to the nominal level. Standard DML and a two-fold variant that estimates both factor spaces on the same units substantially undercover. In an application to U.S. states, FA-DML finds that a 10% increase in the real minimum wage is associated with a roughly 1.1% lower 50/10 wage ratio. The estimate is stable across control sets and first-stage learners.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Bin Chen, Yukun Ma, Qiyang Yu. 2026-11-10. Semiparametric Inference in Panel Data with Interactive and High-dimensional Confounding. https://searcharxiv.com/abs/2611.14385

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

Difference-in-differences for mediation analysis using double machine learning

We propose a difference-in-differences (DiD) framework with mediation for possibly multivalued discrete or continuous treatments and mediators, aimed at identifying the direct effect of the treatment on the outcome (net of effects operating through the mediator), the indirect effect via the mediator, and the joint effects of treatment and mediator, consistent with the framework of dynamic treatment effects. Identification relies on a conditional parallel trends assumption imposed on the mean potential outcome across treatment and mediator states, or (depending on the causal parameter) additionally on the mean potential outcomes and potential mediator distributions across treatment states. We propose ATET estimators for repeated cross sections and panel data within the double/debiased machine learning framework, which allows for data-driven control of covariates, and we establish their asymptotic normality under standard regularity conditions. We investigate the finite-sample performance of the proposed methods in a simulation study and illustrate our approach in an empirical application to the US National Longitudinal Survey of Youth, estimating the direct effect of health care coverage on general health as well as the indirect effect operating through routine checkups.

econ.EM↗

The Online LSTM Prediction Models and The Term Structure of Predictions

We examine and illustrate the properties of the Long Short Term Memory (LSTM) prediction models applied online to stationary inputs. We discuss the effects of: a) the network architecture that defines the admissible prediction functions, b) the objective function used to measure the prediction accuracy, and c) the Stochastic Gradient Descent (SGD) algorithm. We also study the prediction optimality, the term structure of predictions, the filtered memory dynamics. We also introduce a set of diagnostic tools for memory-based prediction models that focus on the estimated dynamics of the hidden states.

econ.EM↗

Estimation and Model Selection in Factor Models with Long Memory

Panels in economics, finance and climate science are often driven by common components that differ in memory, such as common trends, cycles, or joint shocks. We study approximate factor models whose common factors are fractionally integrated with heterogeneous and unknown memory and develop the asymptotic theory of principal components for the panel in levels. Our theory builds on the eigenvalues of the sample covariance matrix being ordered by memory asymptotically: a nonstationary factor group with memory $d>1/2$ generates eigenvalues of order $NT^{2d-1}$, whereas stationary factors generate eigenvalues of order $N$. Principal components estimate the factors consistently up to rotation, while adjacent factor groups are separated at a rate given by their memory gap. The information criteria of Bai and Ng remain consistent for the total number of factors, with their penalties acting as thresholds on eigenvalues that are asymptotically ordered by factor memory. When the nonstationary factors lose their variance advantage, estimation in levels remains consistent, whereas after differencing the factors can become undetectable. A Monte Carlo study shows that factor-number selection in levels tolerates more idiosyncratic noise than selection after first differencing. For monthly temperatures at $308$ European weather stations, our methods select two factors. The first is a persistent common warming factor. The estimated common component implies that 2021-2025 was $2.15^\circ\mathrm{C}$ warmer than 1960-1990, with the strongest warming in Eastern Europe. After first differencing, the criterion selects one factor, and loses regional heterogeneity as compared to the model in levels.

econ.EM↗