Accuracy and precision of fixed and random effects in meta‐analyses of randomized control trials for continuous outcomes
Gnambs, Timo; Schroeders, Ulrich (2024): Accuracy and precision of fixed and random effects in meta‐analyses of randomized control trials for continuous outcomes, in: Research synthesis methods, Hoboken, NJ [u.a.]: Wiley, Jg. 15, Nr. 1, S. 86–106, doi: 10.1002/jrsm.1673.
Details
- Faculty/Chair
- Faculty/Professorship
- Author
- Gnambs, TimoSchroeders, Ulrich
- Title of the Journal
- Research synthesis methods
- Publisher Information
- Wiley : Hoboken, NJ [u.a.]
- Year of publication
- 2024
- Volume
- 15
- Issue
- 1
- Language
- English
- DOI
- Abstract
Meta-analyses of treatment effects in randomized control trials are often faced with the problem of missing information required to calculate effect sizes and their sampling variances. Particularly, correlations between pre- and posttest scores are frequently not available. As an ad-hoc solution, researchers impute a constant value for the missing correlation. As an alternative, we propose adopting a multivariate meta-regression approach that models independent group effect sizes and accounts for the dependency structure using robust variance estimation or three-level modeling. A comprehensive simulation study mimicking realistic conditions of meta-analyses in clinical and educational psychology suggested that imputing a fixed correlation 0.8 or adopting a multivariate meta-regression with robust variance estimation work well for estimating the pooled effect but lead to slightly distorted between-study heterogeneity estimates. In contrast, three-level meta-regressions resulted in largely unbiased fixed effects but more inconsistent prediction intervals. Based on these results recommendations for meta-analytic practice and future meta-analytic developments are provided.
- Keywords
- effect sizemeta-analysismissing valuerandomized control trialrobust variance estimation
- DDC Classification
- 150 Psychology
- RVK Classification
- CM 3400
- Type
- Article
- URI
- Activation date
- 2024-03-21