Searcharxiv⌕ Search

arXiv subjects

Issa J Dahabreh

Publications and source records attributed to Issa J Dahabreh.

3 recordsLinked to original sources

Does Predictive Performance Translate to Causal Performance? Evaluating tabular foundation models as nuisance learners for causal effect estimation

Tabular foundation models based on prior-data fitted networks (PFNs) achieve strong predictive performance, but their value for causal inference is unclear. We evaluated whether PFNs, which predict through in-context learning, could match or outperform conventional nuisance learners in supporting accurate causal estimation and reliable uncertainty quantification (inference). Learners modeled propensity scores and outcome regressions within doubly robust estimators of average causal effects, with and without cross-fitting, across synthetic and semi-synthetic settings with varying confounding complexity and effect heterogeneity. Under simple parametric data-generating processes, the PFNs were competitive with correctly specified parametric regressions and ensembles containing them. In more complex settings, they outperformed all conventional learners evaluated, including richly specified Super Learner ensembles, for both accuracy and uncertainty quantification. As sample size increased, only the two PFN models (TabPFN and Mitra) consistently approached nominal confidence interval coverage, whereas under-coverage persisted for conventional learners. In some settings, PFNs achieved near-nominal coverage and well-calibrated standard errors even without cross-fitting. At the smallest sample size (n=200) and in the higher-dimensional semi-synthetic settings, PFNs and other flexible learners exhibited poor coverage without cross-fitting. For PFNs, this appeared to be driven by propensity score overfitting consistent with in-sample memorization of treatment labels. These findings highlight the promise of prior-data fitted networks as in-context nuisance learners for causal estimation, while underscoring the need for further evaluation in challenging settings.

stat.AP↗

Transportability methods for failure-time outcomes under assumptions for relative effect measures

In certain clinical areas, relative effect measures are believed to remain more constant across populations than absolute measures. This suggests that exchangeability assumptions on the relative scale may be more plausible than those on the absolute scale. Despite this, most methods for extending trial results to a target population rely on strong and often implausible distributional exchangeability assumptions between the trial and target population (distributional transportability). We propose identification results for failure-time outcomes under a more plausible assumption of exchangeability on the relative scale, focusing primarily on the risk ratio (risk ratio transportability). We applied these methods to estimate the effect of screening strategies on all-cause mortality, using data from the National Lung Screening Trial (NLST) to a nationally representative target population from the National Health Interview Survey (NHIS). All-cause mortality data was available from NHIS, along with no confounding of screening, allowing a falsification assessment of the distributional transportability analysis against the observed baseline risk.We found that this approach substantially underestimated mortality risk. In comparison, the risk ratio transportability approach produced reasonable estimates that matched the baseline risk.Thus, assumptions on relative scales may be more plausible in certain settings where distributional transportability fails.

stat.ME↗

Regression-based estimation of heterogeneous treatment effects when extending inferences from a randomized trial to a target population

Methods for extending -- generalizing or transporting -- inferences from a randomized trial to a target population involve conditioning on a large set of covariates that is sufficient for rendering the randomized and non-randomized groups exchangeable. Yet, decision-makers are often interested in examining treatment effects in subgroups of the target population defined in terms of only a few discrete covariates. Here, we propose methods for estimating subgroup-specific potential outcome means and average treatment effects in generalizability and transportability analyses, using outcome model-based (g-formula), weighting, and augmented weighting estimators. We consider estimating subgroup-specific average treatment effects in the target population and its non-randomized subset, and provide methods that are appropriate both for nested and non-nested trial designs. As an illustration, we apply the methods to data from the Coronary Artery Surgery Study to compare the effect of surgery plus medical therapy versus medical therapy alone for chronic coronary artery disease in subgroups defined by history of myocardial infarction.

stat.ME↗