Accuracy and precision of fixed and random effects in meta‐analyses of randomized control trials for continuous outcomes
Gnambs, Timo; Schroeders, Ulrich (2024): Accuracy and precision of fixed and random effects in meta‐analyses of randomized control trials for continuous outcomes, in: Bamberg: Otto-Friedrich-Universität, S. 86–106.
Details
- Faculty/Chair
- Faculty/Professorship
- Author
- Gnambs, TimoSchroeders, Ulrich
- Publisher Information
- Otto-Friedrich-Universität : Bamberg
- Year of publication
- 2024
- Source/Other editions
- Research synthesis methods, 15 (2024), 1, S. 86-106. - ISSN: 1759-2887, 1759-2879
- Year of first publication
- 2024
- Language
- English
- Licence
- URN
- Abstract
Meta-analyses of treatment effects in randomized control trials are often faced with the problem of missing information required to calculate effect sizes and their sampling variances. Particularly, correlations between pre- and posttest scores are frequently not available. As an ad-hoc solution, researchers impute a constant value for the missing correlation. As an alternative, we propose adopting a multivariate meta-regression approach that models independent group effect sizes and accounts for the dependency structure using robust variance estimation or three-level modeling. A comprehensive simulation study mimicking realistic conditions of meta-analyses in clinical and educational psychology suggested that imputing a fixed correlation 0.8 or adopting a multivariate meta-regression with robust variance estimation work well for estimating the pooled effect but lead to slightly distorted between-study heterogeneity estimates. In contrast, three-level meta-regressions resulted in largely unbiased fixed effects but more inconsistent prediction intervals. Based on these results recommendations for meta-analytic practice and future meta-analytic developments are provided.
- Keywords
- effect sizemeta-analysismissing valuerandomized control trialrobust variance estimation
- DDC Classification
- 150 Psychology
- RVK Classification
- CM 3400
- Type
- Article
- URI
- Activation date
- 2024-03-22