arXiv · 2611.21207
Who Is the Regression About? Auditing AI-Labeled Treatments When Effects Differ
Abstract
Researchers increasingly regress outcomes on treatments labeled by large language models. When effects differ, OLS averages the effect on the treated (ATT) and on the untreated (ATU), weighting the smaller group more. A label's bias then has two parts: classical attenuation from misclassification, and a selective term when its errors are correlated with the outcome. In LinkedIn postings, the model misses better-paid remote jobs: a precision check passes, yet the remote pay gap is understated by nearly 40 percent, a bias that more data cannot remove. A stratified, blind audit of both labeled groups corrects it and recovers both effects.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Ayman Farahat. 2026-11-16. Who Is the Regression About? Auditing AI-Labeled Treatments When Effects Differ. https://searcharxiv.com/abs/2611.21207
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.