SearcharxivSearch

arXiv subjects

Yefeng Yang

Publications and source records attributed to Yefeng Yang.

5 recordsLinked to original sources

Statistical methods for assessing non-replicable, outlying, and influential studies

Quantitative evidence synthesis method has become a central tool for integration of findings across multiple studies, multi-centre trials, and multi-source cohort data. However, the identification and interpretation of non-replicable, outlying, and influential studies remain insufficiently addressed in practice, despite their potential to substantially affect the robustness and credibility of meta-analytic conclusions. In this paper, we clarify the conceptual distinctions between non-replicability, statistical outlyingness, and study influence, emphasizing that these concepts are related but not interchangeable. We then review the standard principles and procedures of model diagnostics for detecting outlying and influential studies in meta-analysis, together with their underlying statistical rationale. Building on recent methodological developments, we further discuss several practical and methodological refinements, including approaches for handling imprecise and correlated sampling variances, robust diagnostic procedures, and graphical tools for facilitating the identification and interpretation of unusual studies. Finally, we summarize recent advances in outlier and influence diagnostics and provide recommendations for the cautious interpretation and evaluation of studies identified as potentially non-replicable, outlying, or influential within meta-analytic frameworks.

stat.ME

Meta-analysis with the glmmTMB R package

Meta-analytical models are typically formulated as a mixed-effects model where the sampling variances of the effect sizes are treated as known. In principle, such models could be fitted with standard mixed-modelling software such as the glmmTMB R package. This general-purpose package for generalized linear mixed models (GLMMs) provides flexibility in distributions and random effect covariance structures through the Template Model Builder (TMB). However, incorporating known sampling variances in the conventional inverse-variance formulation of meta-analysis was previously not easily accomplished in glmmTMB. Here, we introduce equalto, a new covariance structure in glmmTMB that allows users to supply a known sampling error variance-covariance matrix when fitting meta-analytic models. This enables explicit modelling of heteroscedasticity and dependence among sampling errors. The new implementation provides an alternative way to fit meta-analytic models, convenient for users already familiar with glmmTMB. Using simulations, we show that the new implementation produces model estimates identical to those from the established metafor package and illustrate its applicability with published meta-analyses in medicine, evolutionary ecology, and the social sciences. Further, this novel implementation in glmmTMB supports more flexible modelling of meta-analytical data, expanding the R toolkit available for evidence synthesis.

stat.CO

Distributional regression models for meta-analysis

Meta-analyses are regarded as the highest level in the hierarchy of evidence, yet standard models traditionally concentrated on estimating the mean effect size, often under restrictive assumptions about the underlying distribution, such as homogeneous variance, symmetric shapes. We introduce a distributional regression framework for meta-analysis that generalizes these conventional models by allowing all parameters of the effect size distribution, such as location, scale, and shape, to be modelled as functions of explanatory variables. This unified framework accommodates a wide range of existing models, including random-effects, multilevel, multivariate, location-scale, and outlier-robust meta-analyses, as special cases. We provide an illustrative example, using 67,393 meta-analyses from the Cochrane Database of Systematic Reviews, employing location-scale models to investigate whether smaller studies tend to report larger effect sizes (i.e., small-study effects) and exhibit greater heterogeneity. We discuss implementation strategies using existing software, considerations for model selection and pre-registration, and the need for further methodological development. By moving beyond the mean effect size, distributional regression enables researchers to explore systematic variation in distributional structure, facilitating the joint test of new hypotheses corresponding to multiple distributional parameters.

stat.OT

Mastering an Accurate and Generalizable Simulation-Based Method to Obtain Bias-corrected Point Estimates and Sampling Variance for Any Effect Sizes

Meta-analyses require an effect-size estimate and its corresponding sampling variance from primary studies. In some cases, estimators for the sampling variance of a given effect size statistic may not exist, necessitating the derivation of a new formula for sampling variance. Traditionally, sampling variance formulas are obtained via hand-derived Taylor expansions (the delta method), though this procedure can be challenging for non-statisticians. Building on the idea of single-fit parametric resampling, we introduce SAFE bootstrap: a Single-fit, Accurate, Fast, and Easy simulation recipe that replaces potentially complex algebra with four intuitive steps: fit, draw, transform, and summarise. In a unified framework, the SAFE bootstrap yields bias-corrected point estimates and standard errors for any effect size statistic, regardless of whether the outcome is continuous or discrete. SAFE bootstrapping works by drawing once from a simple sampling model (normal, binomial, etc.), converting each replicate into any effect size of interest and then calculating the bias and sampling variance from simulated data. We demonstrate how to implement the SAFE bootstrap for a simple example first, and then for common effect sizes, such as the standardised mean difference and log odds ratio, as well as for less common effect sizes. With some additional coding, SAFE can also handle zero values and small sample sizes. Our tutorial, with R code supplements, should not only enhance understanding of sampling variance for effect sizes, but also serve as an introduction to the power of simulation-based methods for deriving any effect size with bias correction and its associated sampling variance.

stat.ME

Enriching meta-analyses through scoping review, bibliometrics, and alternative impact metrics: Visualizing study characteristics, hidden risk of bias, societal influence, and research translation

We present a framework consisting of three approaches that can enhance meta-analyses: 1) scoping reviews (evidence map), 2) bibliometrics, and 3) alternative impact metrics. These three "enrichment" approaches facilitate the research synthesis of both quantitative and qualitative evidence, along with academic and non-academic influences. While the meta-analysis yields quantitative insights (e.g., overall estimates), the enrichment analyses provide user-friendly summaries of qualitative information on the evidence base. Scoping reviews can visualize study characteristics, unravelling knowledge gaps and methodological differences. Bibliometric analysis offers a visual assessment of the non-independent evidence, such as hyper-dominant authors and countries, and funding sources, potentially informing the risk of bias. Impact metric analysis employs alternative metrics to gauge societal influence and research translation (e.g., policy and patent citations) of studies in the meta-analysis. To illustrate the application of this framework, we provide sample visualizations and R code.

cs.DL