Searcharxiv⌕ Search

arXiv subjects

Yuhao Deng

Publications and source records attributed to Yuhao Deng.

At least 19 recordsLinked to original sources

Causal mediation analysis for a time-to-event endpoint in the presence of competing events

Causal mediation analysis is widely used to decompose a treatment's effect into components operating through distinct causal pathways and to characterize the mediator--outcome relationship. In time-to-event settings, competing events --- events that preclude the primary endpoint --- substantially complicate this decomposition. We provide a unified treatment of causal mediation analysis for a time-to-event endpoint under competing events. We show that the total effect on the cause-specific cumulative incidence decomposes into a direct effect, an indirect effect through the mediator of interest, and an indirect effect through the competing events. We develop this decomposition under the natural effects, stochastic interventional effects, and separable effects frameworks, and show that, in certain settings, all three yield identical statistical functionals despite relying on distinct identification assumptions. We derive efficient influence functions for the counterfactual cumulative incidence curves and the decomposed effects, and propose double-machine-learning-type estimators that are multiply robust and attain the semiparametric efficiency bound, with a sensitivity analysis to address unmeasured common causes of time-to-event endpoints. We further study the mediator--outcome response relationship via kernel-smoothed estimands. We apply the methods to immune correlates analyses of COVID-19 vaccine and HIV-1 prevention trials.

stat.ME↗

Difference-in-differences with a mediator

Causal mediation analysis is a powerful tool for decomposing the total effect of a treatment into its direct effect on the outcome and its indirect effect mediated through an intermediate variable. However, in observational studies, confounding between treatment and potential outcomes typically renders the total and natural effects non-identifiable. In this work, we advance the mediation analysis within the difference-in-differences framework. Under a mediator-adjusted parallel trends assumption and additional conditions, we demonstrate that natural indirect, direct, and total effects are identifiable in the treated group. We further derive efficient influence functions for these estimands, enabling the construction of multiply robust and nonparametrically efficient estimators. Applying our methodology to data from the Job Corps Study, we find that job training has a positive direct effect on short-term earnings, holding employment intensity fixed at its level under training, which is masked in the total effect by reduced work time; in the longer run, the total effect is positive and operates mainly through higher employment intensity.

econ.EM↗

Cause-specific structural nested cumulative survival time models for competing risks, with application to the Antibody Mediated Prevention trials

The Antibody Mediated Prevention (AMP) trials randomized participants to VRC01, a broadly neutralizing antibody, or placebo; the primary analysis estimated prevention efficacy against overall HIV-1 acquisition and against acquisition of VRC01-sensitive strains. All participants were offered daily oral pre-exposure prophylaxis (PrEP), and PrEP uptake in a trial may differ substantially from uptake in other settings. It is therefore of interest to estimate the effect of oral PrEP on acquisition of VRC01-sensitive and VRC01-insensitive strains, as well as the counterfactual cumulative incidence of such acquisition under no or limited PrEP uptake. To address these questions, we extend the structural nested cumulative survival time model (SNCSTM), a causal survival model for time-varying treatments, to a cause-specific version. We show that the cause-specific SNCSTM is closely related to the Fine--Gray subdistribution hazard model, and we study identification under two frameworks. The first, based on sequential ignorability, applies when the time-varying treatment is distinct from the randomized assignment, as with oral PrEP use in AMP. The second, based on an instrumental variable, applies when the time-varying treatment represents compliance with the randomized assignment, and it accommodates unmeasured confounding between the time-varying treatment and event time. Under both frameworks, we propose consistent and asymptotically normal estimators of the structural parameters. We apply the methods to HVTN 704/HPTN 085, one of the two AMP trials, to estimate the effects of oral PrEP use and of VRC01 infusions administered every 8 weeks on acquisition of VRC01-sensitive and VRC01-insensitive HIV-1 strains. We also estimate the counterfactual strain-specific cumulative incidence curves under no oral PrEP use and under full adherence to the scheduled VRC01 infusions.

stat.ME↗

Estimating Treatment Effects Through Intermediate-Event Pathways with Multi-State Data

During clinical trials evaluating a drug's effect on a survival endpoint, intermediate events often occur before the primary event. The treatment can affect the primary event through multiple pathways via intermediate events. With multiple intermediate events, each is a treatment-induced confounder of transitions out of the others, so we cannot identify natural or separable effects. We instead consider stochastic interventions that assign each transition the identifiable observed-history hazard of either arm. Contrasts between the resulting counterfactual cumulative incidences define transition-, event-, and path-targeted effects, identifiable without cross-world or isolation assumptions. Based on the efficient influence functions for the counterfactual cumulative incidences under hypothetical interventions, we construct multiply robust and semiparametrically efficient estimators for these targeted treatment effects. Our proposed framework quantifies treatment effects through each transition, on each event, and along each path. By analyzing data from the LEADER trial, we find that liraglutide significantly reduces the risk of cardiovascular and microvascular events. The reduction in all-cause mortality is primarily mediated by its effects on expanded major adverse cardiovascular events.

stat.ME↗

Doubly Robust Estimation of Treatment Effects in Staggered Difference-in-Differences with Time-Varying Covariates

With staggered adoption, difference-in-differences (DiD) analyses define the average treatment effect on the treated (ATT) at the group-period level and aggregate it into groupwise, periodwise, dynamic, and overall effects. We study a period-by-period version of conditional parallel trends, with covariates unaffected by treatment while allowing covariates to shift the trends in untreated potential outcomes. We propose an augmented inverse probability weighting (AIPW) estimator and an augmented inverse variance weighting (AIVW) generalization. Both are doubly robust and asymptotically normal, with closed-form influence-function-based inference for all group-period and aggregated ATTs. AIVW is statistically efficient in some special cases, while AIPW is computationally more efficient. We illustrate the methods with the staggered provincial adoption of a parallel college admission mechanism in China and its effect on justified envy.

stat.ME↗

tteICE: An R Package for Estimating Treatment Effects on Time-to-Event Outcomes with Intercurrent Events in Two-Arm Trials

Evaluating treatment effects in clinical trials with time-to-event outcomes is complicated by intercurrent events (ICEs), e.g., treatment discontinuation or competing events. While the ICH E9 (R1) addendum outlines five strategies to address these challenges, accessible software implementing these methods is limited. This article introduces the \pkg{tteICE} package for \proglang{R}, which implements five strategies to facilitate valid causal inference in the presence of ICEs. \pkg{tteICE} enables researchers to either nonparametrically or semiparametrically efficiently estimate potential cumulative incidence functions under both treatment and control conditions. The treatment effect is assessed by contrasting these functions, with statistical uncertainty quantified using pointwise confidence intervals and $p$-values. The package supports data from randomized controlled trials and observational studies, including settings with competing risks and semi-competing risks. To reduce barriers for applied researchers, \pkg{tteICE} features integrated plotting functions and an accompanying interactive Shiny application that provides a user-friendly graphical interface with step-by-step instructions.

stat.ME↗

EcoTable: Cost-effective Table Integration in Data Lakes for Natural Language Queries

The diverse formats of CSV and Parquet files in data lakes pose a significant challenge to traditional ETL, which relies on data engineers to pre-define a target database schema and build a complex pipeline for data integration. Moreover, with this approach, the integrated data often cannot support various analytical needs, as the predefined schema does not necessarily satisfy the table format or join relationships required to answer unforeseen queries. To address this, we propose EcoTable, the first natural language-based data integration framework. Given a set of user-specified natural language queries, EcoTable automatically integrates the tables into a form that adequately supports the corresponding SQL queries. EcoTable achieves this by leveraging the semantic understanding and complex reasoning capabilities of LLMs. Moreover, EcoTable addresses the scalability and cost issues introduced by expensive LLM inferences with a set of novel ideas. First, EcoTable introduces a graph to represent the overall search space, where nodes represent tables and edges carry weights indicating join likelihood produced by a lightweight deep learning model. On top of this graph data structure, EcoTable designs three components to achieve our goal: (1) the table identification layer aims to identify relevant tables via a two-stage schema linking based on user queries; (2) the graph-based validation layer aims to discover significant join paths, including necessary data transformations and bridging tables, by modeling the problem as Steiner tree searches; and (3) the table transformation layer generates transformation code to implement the joins using LLMs. We construct 4 real-world benchmark datasets with more than 200 queries. Extensive experiments demonstrate that EcoTable outperforms the state-of-the-art baselines, increasing accuracy by more than 30% and cutting LLM invocation costs by 5 times.

cs.DB↗

Debiased Inference for High-Dimensional Regression Models Based on Profile M-Estimation

Debiased inference for high-dimensional regression models has received substantial recent attention to ensure regularized estimators have valid inference. Many existing methods focus on achieving Neyman orthogonality through explicitly constructing projections onto the space of nuisance parameters, which is infeasible when an explicit form of the projection is unavailable. We introduce a general debiasing framework, Debiased Profile $M$-Estimation (DPME), which applies to a broad class of models and does not require model-specific Neyman orthogonalization or projection derivations as in existing methods. Our approach begins with obtaining an initial estimator of the parameters by optimizing a penalized objective function. To correct for the bias introduced by penalization, we construct a one-step estimator using the Newton--Raphson update, applied to the gradient of a profile function defined as the optimal objective function with the parameter of interest held fixed. We use numerical differentiation without requiring explicit calculation of the gradients. The resulting DPME estimator is shown to be asymptotically linear and normally distributed. Through extensive simulations, we demonstrate that the proposed method achieves better coverage rates than existing alternatives with largely reduced computational cost. Finally, we illustrate the utility of our method by applying it to estimate a treatment rule for multiple myeloma.

stat.ME↗

Randomized interventional effects in semicompeting risks, with application to a hematopoietic cell transplantation study

In clinical studies, the risk of the primary (terminal) event may be modified by intermediate events, resulting in semicompeting risks. To study the treatment effect on the terminal event mediated by the intermediate event, researchers wish to decompose the total effect into direct and indirect effects. In this article, we extend the randomized interventional approach to time-to-event outcomes, where both intermediate and terminal events are subject to right censoring. We envision a random draw for the intermediate event process from a reference distribution, either marginally over time-varying confounders or conditionally given the observed history. We present the identification formula for interventional effects. We also discuss some variants of the identification assumptions. We estimate the treatment effects using nonparametric maximum likelihood estimation and propose a sensitivity analysis that incorporates a latent frailty. As an illustration, we study the effect of matched unrelated donor versus haploidentical donor on death mediated by relapse in a hematopoietic cell transplantation study with graft-versus-host disease (GVHD) as the time-varying confounder. We find that matched unrelated donor transplantation is preferable in terms of survival rates under the use of post-transplant PTCy GVHD prophylaxis for lymphoma patients.

stat.ME↗

Semiparametric Analysis of Interval-Censored Data Subject to Inaccurate Diagnoses with A Terminal Event

Interval-censoring frequently occurs in studies of chronic diseases where disease status is inferred from intermittently collected biomarkers. Although many methods have been developed to analyze such data, they typically assume perfect disease diagnosis, which often does not hold in practice due to the inherent imperfect clinical diagnosis of cognitive functions or measurement errors of biomarkers such as cerebrospinal fluid. In this work, we introduce a semiparametric modeling framework using the Cox proportional hazards model to address interval-censored data in the presence of inaccurate disease diagnosis. Our model incorporates sensitivity and specificity of the diagnosis to account for uncertainty in whether the interval truly contains the disease onset. Furthermore, the framework accommodates scenarios involving a terminal event and when diagnosis is accurate, such as through postmortem analysis. We propose a nonparametric maximum likelihood estimation method for inference and develop an efficient EM algorithm to ensure computational feasibility. The regression coefficient estimators are shown to be asymptotically normal, achieving semiparametric efficiency bounds. We further validate our approach through extensive simulation studies and an application assessing Alzheimer's disease (AD) risk. We find that amyloid-beta is significantly associated with AD, but Tau is predictive of both AD and mortality.

stat.ME↗

Unstructured Data Analysis using LLMs: A Comprehensive Benchmark

Nowadays, the explosion of unstructured data presents immense analytical value. Leveraging the remarkable capability of large language models (LLMs) in extracting attributes of structured tables from unstructured data, researchers are developing LLM-powered data systems for users to analyze unstructured documents as working with a database. These unstructured data analysis (UDA) systems differ significantly in all aspects, including query interfaces, query optimization strategies, and operator implementations, making it unclear which performs best in which scenario. Unfortunately, there does not exist a comprehensive benchmark that offers high-quality, large-volume, and diverse datasets as well as rich query workload to thoroughly evaluate such systems. To fill this gap, we present UDA-Bench, the first benchmark for unstructured data analysis that meets all the above requirements. Specifically, we organize a team with 30 graduate students that spends over in total 10,000 hours on curating 5 datasets from various domains and constructing a relational database view from these datasets by manual annotation. These relational databases can be used as ground truth to evaluate any of these UDA systems despite their differences in programming interfaces. Moreover, we design diverse queries to analyze the attributes defined in the database schema, covering different types of analytical operators with varying selectivities and complexities. We conduct in-depth analysis of the key building blocks of existing UDA systems: query interface, query optimization, operator design, and data processing. We run exhaustive experiments over the benchmark to fully evaluate these systems and different techniques w.r.t. the above building blocks.

cs.DB↗

CSTEapp: An interactive R-Shiny application of the covariate-specific treatment effect curve for visualizing individualized treatment rule

In precision medicine, deriving the individualized treatment rule (ITR) is crucial for recommending the optimal treatment based on patients' baseline covariates. The covariate-specific treatment effect (CSTE) curve presents a graphical method to visualize an ITR within a causal inference framework. Recent advancements have enhanced the causal interpretation of the CSTE curves and provided methods for deriving simultaneous confidence bands for various study types. To facilitate the implementation of these methods and make ITR estimation more accessible, we developed CSTEapp, a web-based application built on the R Shiny framework. CSTEapp allows users to upload data and create CSTE curves through simple point and click operations, making it the first application for estimating the ITRs. CSTEapp simplifies the analytical process by providing interactive graphical user interfaces with dynamic results, enabling users to easily report optimal treatments for individual patients based on their covariates information. Currently, CSTEapp is applicable to studies with binary and time-to-event outcomes, and we continually expand its capabilities to accommodate other outcome types as new methods emerge. We demonstrate the utility of CSTEapp using real-world examples and simulation datasets. By making advanced statistical methods more accessible, CSTEapp empowers researchers and practitioners across various fields to advance precision medicine and improve patient outcomes.

stat.CO↗

Not All Documents Are What You Need for Extracting Instruction Tuning Data

Instruction tuning improves the performance of large language models (LLMs), but it heavily relies on high-quality training data. Recently, LLMs have been used to synthesize instruction data using seed question-answer (QA) pairs. However, these synthesized instructions often lack diversity and tend to be similar to the input seeds, limiting their applicability in real-world scenarios. To address this, we propose extracting instruction tuning data from web corpora that contain rich and diverse knowledge. A naive solution is to retrieve domain-specific documents and extract all QA pairs from them, but this faces two key challenges: (1) extracting all QA pairs using LLMs is prohibitively expensive, and (2) many extracted QA pairs may be irrelevant to the downstream tasks, potentially degrading model performance. To tackle these issues, we introduce EQUAL, an effective and scalable data extraction framework that iteratively alternates between document selection and high-quality QA pair extraction to enhance instruction tuning. EQUAL first clusters the document corpus based on embeddings derived from contrastive learning, then uses a multi-armed bandit strategy to efficiently identify clusters that are likely to contain valuable QA pairs. This iterative approach significantly reduces computational cost while boosting model performance. Experiments on AutoMathText and StackOverflow across four downstream tasks show that EQUAL reduces computational costs by 5-10x and improves accuracy by 2.5 percent on LLaMA-3.1-8B and Mistral-7B

cs.CL↗

Adjusted Nelson--Aalen estimators by inverse treatment probability weighting with an estimated propensity score

Inverse probability of treatment weighting (IPW) has been well applied in causal inference to estimate population-level estimands from observational studies. For time-to-event outcomes, the failure time distribution can be estimated by estimating the cumulative hazard in the presence of random right censoring. IPW can be performed by weighting the event counting process and at-risk process by the inverse treatment probability, resulting in an adjusted Nelson--Aalen estimator for the population-level counterfactual cumulative incidence function. We consider the adjusted Nelson--Aalen estimator with an estimated propensity score in the competing risks setting. When the estimated propensity score is regular and asymptotically linear, we derive the influence functions for the counterfactual cumulative hazard and cumulative incidence. Then we establish the asymptotic properties for the estimators. We show that the uncertainty in the estimated propensity score contributes to an additional variation in the estimators. However, through simulation and real-data application, we find that such an additional variation is usually small.

stat.ME↗

Analysis of Broken Randomized Experiments by Principal Stratification

Although randomized controlled trials have long been regarded as the ``gold standard'' for evaluating treatment effects, there is no natural prevention from post-treatment events. For example, non-compliance makes the actual treatment different from the assigned treatment, truncation-by-death renders the outcome undefined or ill-defined, and missingness prevents the outcomes from being measured. In this paper, we develop a statistical analysis framework using principal stratification to investigate the treatment effect in broken randomized experiments. The average treatment effect in compliers and always-survivors is adopted as the target causal estimand. We establish the asymptotic property for the estimator. To relax the identification assumptions, we also propose an interventionist estimand defined in compliers by adjusting for baseline covariates. We apply the framework to study the effect of training on earnings in the Job Corps study and find that the training program improves employment and earnings in the long term.

stat.ME↗

Inference for Cumulative Incidences and Treatment Effects in Randomized Controlled Trials with Time-to-Event Outcomes under ICH E9 (R1)

In randomized controlled trials (RCTs) that focus on time-to-event outcomes, intercurrent events can arise in two ways: as semi-competing events, which modify the hazard of the primary outcome events, or as competing events, which make the definition of the primary outcome events unclear. Although five strategies have been proposed in the ICH E9 (R1) addendum to address intercurrent events in RCTs, these strategies are not easily applicable to time-to-event outcomes when aiming for causal interpretations. In this study, we show how to define, estimate, and make inferences concerning objectives that have causal interpretations within these contexts. Specifically, we derive the mathematical formulations of the causal estimands corresponding to the five strategies and clarify the data structure needed to identify these causal estimands. Furthermore, we introduce nonparametric methods for estimating and making inferences about these causal estimands, including the asymptotic variance of estimators and hypothesis tests. Finally, we illustrate our methods using data from the LEADER Trial, which aims to investigate the effect of liraglutide on cardiovascular outcomes.

stat.ME↗

Separable pathway effects of semi-competing risks using multi-state models

Semi-competing risks refer to the phenomenon where a primary event (such as mortality) can ``censor'' an intermediate event (such as relapse of a disease), but not vice versa. Under the multi-state model, the primary event consists of two specific types: the direct outcome event and an indirect outcome event developed from intermediate events. Within this framework, we show that the total treatment effect on the cumulative incidence of the primary event can be decomposed into three separable pathway effects, capturing treatment effects on population-level transition rates between states. We next propose two estimators for the counterfactual cumulative incidences of the primary event under hypothetical treatment components. One estimator is given by the generalized Nelson--Aalen estimator with inverse probability weighting under covariates isolation, and the other is given based on the efficient influence function. The asymptotic normality of these estimators is established. The first estimator only involves a propensity score model and avoid modeling the cause-specific hazards. The second estimator has robustness against the misspecification of submodels. As an illustration of its potential usefulness, the proposed method is applied to compare effects of different allogeneic stem cell transplantation types on overall survival after transplantation.

stat.ME↗

Direct and Indirect Treatment Effects in the Presence of Semi-Competing Risks

Semi-competing risks refer to the phenomenon that the terminal event (such as death) can censor the non-terminal event (such as disease progression) but not vice versa. The treatment effect on the terminal event can be delivered either directly following the treatment or indirectly through the non-terminal event. We consider two strategies to decompose the total effect into a direct effect and an indirect effect under the framework of mediation analysis in completely randomized experiments by adjusting the prevalence and hazard of non-terminal events, respectively. They require slightly different assumptions on cross-world quantities to achieve identifiability. We establish asymptotic properties for the estimated counterfactual cumulative incidences and decomposed treatment effects. We illustrate the subtle difference between these two decompositions through simulation studies and two real-data applications.

stat.ME↗