Searcharxiv⌕ Search

arXiv · 2610.25589

Linear Regression with Common Unobserved Heterogeneity

Abstract

We study inference on common slope parameters in linear panel models with two-way unobserved heterogeneity. In linear regression, bias arises from unobserved heterogeneity that is shared between the residual and the covariates. Our common unobserved heterogeneity (CUH) estimator targets this common variation directly: it searches over functionals of the residualised outcome for variation that also resides in the covariates, and seeks to further project out only bias-inducing variation. This makes the estimator less sensitive to weak outcome factors while avoiding the complete removal of exogenous variation in covariates that is unrelated to the confounding heterogeneity. We develop a weak-factor theory based on a singular-value strength index and establish $\sqrt{NT}$-asymptotic normality of the cross-fitted CUH estimator. Under homoskedastic errors, its asymptotic variance is no larger than that of a common correlated effects factor estimator. Simulations and empirical applications illustrate the resulting bias--variance trade-off and the gains from selectively removing common variation.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Kaicheng Chen, Hugo Freeman. 2026-10-18. Linear Regression with Common Unobserved Heterogeneity. https://arxiv.org/abs/2610.25589

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Quasi-Score Matching Estimation for Spatial Autoregressive Model with Random Weights Matrix and Regressors

With the rapid advancements in technology for data collection, the application of the spatial autoregressive (SAR) model has become increasingly prevalent in real-world analysis, particularly when dealing with large datasets. However, the commonly used quasi-maximum likelihood estimation (QMLE) for the SAR model is not computationally scalable to handle the data with a large size. In addition, when establishing the asymptotic properties of the parameter estimators of the SAR model, both weights matrix and regressors are assumed to be nonstochastic in classical spatial econometrics, which is perhaps not realistic in real applications. Motivated by the machine learning literature, this paper proposes quasi-score matching estimation for the SAR model. This new estimation approach is developed based on the likelihood, but significantly reduces the computational complexity of the QMLE. The asymptotic properties of parameter estimators under the random weights matrix and regressors are established, which provides a new theoretical framework for the asymptotic inference of the SAR-type models. The usefulness of the quasi-score matching estimation and its asymptotic inference is illustrated via extensive simulation studies and a case study of an anti-conflict social network experiment for middle school students.

econ.EM↗

What Impulse Response Do Instrumental Variables Identify?

We study what local projection instrumental variable (LP-IV) regressions identify when an instrument is correlated with several structural shocks, such as defense and non-defense spending shocks. LP-IV identifies an instrument-specific affine combination of the component impulse responses, possibly with negative weights. Over-identified 2SLS or GMM yields another such combination, and the over-identification test can reject even with valid instruments. With as many instruments as shocks, the component responses are identified when each shock has a policy variable (e.g., sectoral spending) and its impact on the other policy variables is restricted. We illustrate with government spending and tax multipliers.

econ.EM↗

Identifying Elasticities in Autocorrelated Time Series Using Causal Mechanism Graphs

Instrumental variable (IV) methods are widely used to estimate the price elasticity of demand from observational data. However, naive IV estimators may be inconsistent in settings with autocorrelated time series. We argue that causal graphs taking into account time structure can simplify IV identification and help select consistent estimators. More precisely, we propose to model equilibrium conditions using causal mechanism time graphs. These (acyclic) graphs allow us to maintain the assumption of a simultaneous determination of prices and quantities and come with an interpretable notion of intervention. They further allow us to exploit recent advances in graphical inference to derive valid IV estimators that are consistent under weak assumptions. Finally, we argue that observing significant differences between the estimates of presumably valid estimators can help to reject false model assumptions, thereby improving our understanding of underlying economic dynamics. We apply our approach to the German electricity market, estimating the price elasticity of demand from simulated and real-world data. The findings underscore the importance of accounting for structural autocorrelation in IV-based analysis.

econ.EM↗