arXiv · 2610.10851
Treatment Effect Modification by Latent Classes
Abstract
Many treatments have effects that plausibly vary by latent classes. For example, the effect of personalized video recommendations may be stronger for users who seek a new discovery than for users seeking to rewatch something familiar. In the context of user journeys on digital platforms, we can conceptualize user moods as dynamic latent states that lead to distinct action distributions. Because mood is unobserved, we infer it from a user's pre-treatment actions using a hidden Markov model (HMM), and then leverage the latent state as an interpretable treatment effect modifier when evaluating experiment results. Under a treatment-effect sufficiency assumption, each observable conditional effect is a known mixture of the latent effects, so state-specific effects are identified when state posteriors are sufficiently heterogeneous. We propose an estimator that is Neyman-orthogonal to errors in the fitted HMM, enabling standard influence-function confidence intervals. In a real-world large-scale A/B test of a new recommendation model at Netflix, our latent-state analysis reveals that heavy-engagement users show significantly positive effects across all treatment variants, with limited evidence of benefit among less-active and rewatch-oriented users.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Hui Lan, Nathan Kallus, Winston Chou. 2026-10-07. Treatment Effect Modification by Latent Classes. https://searcharxiv.com/abs/2610.10851
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.