SearcharxivSearch

arXiv subjects

Holly Janes

Publications and source records attributed to Holly Janes.

7 recordsLinked to original sources

Improving the efficiency of infectious disease prevention trials using negative control outcome event times

Baseline covariate adjustment can enhance the efficiency of randomized trials by improving precision of treatment effect estimates. However, the precision gain depends on how strongly the baseline covariates are prognostic for the primary outcome. In randomized trials of infectious disease prevention interventions (e.g., vaccines or passively administered antibodies), an individual's exposure to the pathogen is a leading prognostic factor but is rarely measurable at baseline. Hence, conventional covariate adjustment offers limited precision gain in prevention trials. We propose adjusting for a negative control outcome (NCO) event time, which is causally unaffected by the intervention but shares overlapping exposure mechanisms with the primary outcome. We formalize assumptions under which adjustment for the NCO event time is valid, and show that right-censoring of the NCO event time further complicates adjustment. We derive the efficient influence function for the treatment-arm-specific survivor function of the primary outcome when both the primary outcome and the NCO event time are right-censored, and use it to construct a cross-fitted, one-step estimator that is multiply robust to nuisance misspecification and asymptotically efficient when the nuisances are estimated accurately. In numerical experiments, our estimator compares comparably to benchmarks when the NCO event time is uninformative, and gains precision as the NCO event time is more prognostic for the primary outcome. We apply our method to HVTN 704/HPTN 085, a randomized, double-blinded trial of VRC01, a broadly neutralizing antibody against HIV-1. Adjusting for the time to a bacterial sexually transmitted infection --- a negative control outcome for HIV-1 acquisition --- reduced the estimated variance of the prevention efficacy estimate by approximately 27%, compared to roughly 2.5% for baseline covariate adjustment.

stat.ME

Proximal Learning for Trials With External Controls: A Case Study in HIV Prevention

With the advent of effective pre-exposure prophylaxis agents, active-controlled HIV prevention trials have become a common study design. Nevertheless, estimating absolute efficacy relative to a placebo remains important. In this paper, we introduce a novel application of proximal causal inference methods to estimate the counterfactual cumulative HIV incidence under placebo for participants in an active-controlled trial of cabotegravir, using external control data from a placebo-controlled trial with similar eligibility criteria. We leverage baseline sexually transmitted infection status and geographic region as negative control outcome and exposure variables, respectively. We address two key challenges: unmeasured differences in HIV risk between trials and statistical difficulties arising from low HIV incidence rates in both studies. To overcome these challenges, we develop two proximal inference approaches: (1) a semiparametric inverse probability of censoring weighting estimator, and (2) a two-stage regression-based strategy tailored to low-event-rate settings. Our theoretical and numerical investigations demonstrate these methods yield reliable estimates of the counterfactual one-year cumulative HIV incidence under placebo, and provide robust evidence of the superior efficacy of cabotegravir compared with placebo. These findings highlight the potential of proximal inference methods to estimate placebo-controlled effects in both single-arm and active-controlled trials by leveraging external controls.

stat.ME

Debiasing hazard-based, time-varying vaccine effects using vaccine-irrelevant infections: An observational extension of a pivotal Phase 3 COVID-19 vaccine efficacy trial

Understanding how vaccine effectiveness (VE) changes over time can provide evidence-based guidance for public health decision making. While commonly reported by practitioners, time-varying VE estimates obtained using Cox regression are vul- nerable to hidden biases. To address these limitations, we describe how to leverage vaccine-irrelevant infections to identify hazard-based, time-varying VE in the pres- ence of unmeasured confounding and selection bias. We articulate assumptions under which our approach identifies a causal effect of an intervention deferring vaccination and interaction with the community in which infections circulate. We develop sieve and efficient influence curve-based estimators and discuss imposing monotone shape constraints and estimating VE against multiple variants. As a case study, we examine the observational booster phase of the Coronavirus Vaccine Efficacy (COVE) trial of the Moderna mRNA-1273 COVID-19 vaccine which used symptom-triggered multi- plex PCR testing to identify acute respiratory illnesses (ARIs) caused by SARS-CoV-2 and 20 off-target pathogens previously identified as compelling negative controls for COVID-19. Accounting for vaccine-irrelevant ARIs supported that the mRNA-1273 booster was more effective and durable against Omicron COVID-19 than suggested by Cox regression. Our work offers an approach to mitigate bias in hazard-based, time- varying treatment effects in randomized and non-randomized studies using negative controls.

stat.ME

A General Framework for Designing and Evaluating Active-Controlled Trials with Non-Inferiority Objectives

Active-controlled trials with non-inferiority objectives are often used when effective interventions are available, but new options may offer advantages or meet public health needs. In these trials, participants are randomized to an experimental intervention or an active control. The traditional non-inferiority criterion requires that the new intervention preserve a substantial proportion of the active control effect. A key challenge is the absence of a placebo arm, which necessitates reliance on historical data to estimate the active control effect and assumptions about how well this effect applies to the target population. Another challenge arises when the active control is highly effective, as the new intervention may still be valuable even if it does not meet the traditional criterion. This has motivated alternative criteria based on sufficient efficacy relative to a hypothetical placebo. In this work, we propose a general framework for designing and evaluating non-inferiority trials that integrates all existing analytical methods and accommodates both traditional and alternative success criteria. The framework enables the systematic comparison of methods in terms of type I error, power, and robustness to misspecification of the active control effect. We illustrate its applicability in the design of a future HIV prevention trial with a highly effective active control. In this application, our framework identifies methods that provide greater efficiency and robustness than commonly used approaches and demonstrates practical advantages of the alternative non-inferiority criterion. Overall, this framework offers a comprehensive toolkit for rigorous non-inferiority trial design, supporting method selection and the evaluation of new interventions.

stat.ME

Negative Control Outcome Adjustment in Early-Phase Randomized Trials: Estimating Vaccine Effects on Immune Responses in HIV Exposed Uninfected Infants

Adjustment for prognostic baseline variables can reduce bias due to covariate imbalance and increase efficiency in randomized trials. While the use of covariate adjustment in late-phase trials is justified by favorable large-sample properties, it is seldom used in small, early-phase studies, due to uncertainty in which variables are prognostic and the potential for precision loss, type I error rate inflation, and undercoverage of confidence intervals. To address this problem, we consider adjustment for a valid negative control outcome (NCO), or an auxiliary post-randomization outcome believed completely unaffected by treatment but more highly correlated with the primary outcome than baseline covariates. We articulate the assumptions that permit adjustment for NCOs without producing post-randomization selection bias, and describe plausible data generating models where NCO adjustment can improve upon adjustment for baseline covariates alone. In numerical experiments, we illustrate performance and provide practical recommendations regarding model selection and finite-sample variance corrections. We apply our methods to the reanalysis of two early-phase vaccine trials in HIV exposed uninfected (HEU) infants, where we demonstrate that adjustment for auxiliary post-baseline immunological parameters can enhance precision of vaccine effect estimates relative to standard approaches that avoid adjustment or adjust for baseline covariates alone.

stat.ME

Comparing HIV Vaccine Immunogenicity across Trials with Different Populations and Study Designs

Safe and effective preventive vaccines have the potential to help stem the HIV epidemic. The efficacy of such vaccines is typically measured in randomized, double-blind phase IIb/III trials and described as a reduction in newly acquired HIV infections. However, such trials are often expensive, time-consuming, and/or logistically challenging. These challenges lead to a great interest in immune responses induced by vaccination, and in identifying which immune responses predict vaccine efficacy. These responses are termed vaccine correlates of protection. Studies of vaccine-induced immunogenicity vary in size and design, ranging from small, early phase trials, to case-control studies nested in a broader late-phase randomized trial. Moreover, trials can be conducted in geographically diverse study populations across the world. Such diversity presents a challenge for objectively comparing vaccine-induced immunogenicity. To address these practical challenges, we propose a framework that is capable of identifying appropriate causal estimands and estimators, which can be used to provide standardized comparisons of vaccine-induced immunogenicity across trials. We evaluate the performance of the proposed estimands via extensive simulation studies. Our estimators are well-behaved and enjoy robustness properties. The proposed technique is applied to compare vaccine immunogenicity using data from three recent HIV vaccine trials.

stat.ME

Active-Controlled Trial Design for HIV Prevention Trials with a Counterfactual Placebo

In the quest for enhanced HIV prevention methods, the advent of antiretroviral drugs as pre-exposure prophylaxis (PrEP) has marked a significant stride forward. However, the ethical challenges in conducting placebo-controlled trials for new PrEP agents against a backdrop of highly effective existing PrEP options necessitates innovative approaches. This manuscript delves into the design and implementation of active-controlled trials that incorporate a counterfactual placebo estimate - a theoretical estimate of what HIV incidence would have been without effective prevention. We introduce a novel statistical framework for regulatory approval of new PrEP agents, predicated on the assumption of an available and consistent counterfactual placebo estimate. Our approach aims to assess the absolute efficacy (i.e., against placebo) of the new PrEP agent relative to the absolute efficacy of the active control. We propose a two-step procedure for hypothesis testing and further develop an approach that addresses potential biases inherent in non-randomized comparison to counterfactual placebos. By exploring different scenarios with moderately and highly effective active controls and counterfactual placebo estimates from various sources, we demonstrate how our design can significantly reduce sample sizes compared to traditional non-inferiority trials and offer a robust framework for evaluating new PrEP agents. This work contributes to the methodological repertoire for HIV prevention trials and underscores the importance of adaptability in the face of ethical and practical challenges.

stat.ME