Inflated effect estimates for vitamin D supplementation are driven by common meta-analytical errors

Purpose Han et al. (J Int Soc Sports Nutr 16:55, 2019) sought to quantify the effects of vitamin D supplementation on strength outcomes among athletes in a meta-analysis. The authors reported a pooled effect size (standardized mean difference; SMD) of -0.75 (95% CI: -1.82 to 0.32, p = 0.17) in favor...

Full description

Saved in:
Bibliographic Details
Main Author: Eric T. Trexler
Format: Article
Language:English
Published: Taylor & Francis Group 2024-12-01
Series:Journal of the International Society of Sports Nutrition
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/15502783.2024.2413668
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846127023935717376
author Eric T. Trexler
author_facet Eric T. Trexler
author_sort Eric T. Trexler
collection DOAJ
description Purpose Han et al. (J Int Soc Sports Nutr 16:55, 2019) sought to quantify the effects of vitamin D supplementation on strength outcomes among athletes in a meta-analysis. The authors reported a pooled effect size (standardized mean difference; SMD) of -0.75 (95% CI: -1.82 to 0.32, p = 0.17) in favor of supplementation, but the analytical approach was not appropriate for a pooled analysis of randomized controlled trials and the effect sizes were calculated incorrectly. This letter discusses how these issues impact the results and interpretation of the paper, then provides an update on the estimated average effect of vitamin D on strength outcomes in athletes.Methods Identified errors included the use of within-group rather than between-group effect size metrics, the use of standard error values in place of standard deviations, and failure to account for correlated observations within the model. The data were reanalyzed after correcting for these common meta-analytic errors.Results The results of this reanalysis reflect a dramatically smaller and statistically nonsignificant pooled effect estimate of SMD = 0.16 (-0.24 to 0.56, p = 0.43) in favor of supplementation. Further, the model from this reanalysis has more favorable statistical characteristics than the original analysis, as evidenced by a fairly symmetrical funnel plot and a nonsignificant result for Cochrane’s Q test (Q = 5.02, p = 0.41).Conclusion In order to disseminate robust information to sports nutrition practitioners and researchers, it is critically important for meta-analyses to produce valid effect estimates that are appropriate for the underlying study designs and calculated without error. This letter highlights common errors to inform the calculation and interpretation of future meta-analyses in sports nutrition.
format Article
id doaj-art-8811a7c6e8404a27b91a4fed433ca472
institution Kabale University
issn 1550-2783
language English
publishDate 2024-12-01
publisher Taylor & Francis Group
record_format Article
series Journal of the International Society of Sports Nutrition
spelling doaj-art-8811a7c6e8404a27b91a4fed433ca4722024-12-12T06:10:58ZengTaylor & Francis GroupJournal of the International Society of Sports Nutrition1550-27832024-12-0121110.1080/15502783.2024.2413668Inflated effect estimates for vitamin D supplementation are driven by common meta-analytical errorsEric T. Trexler0Duke University, Department of Evolutionary Anthropology, Durham, North Carolina, USAPurpose Han et al. (J Int Soc Sports Nutr 16:55, 2019) sought to quantify the effects of vitamin D supplementation on strength outcomes among athletes in a meta-analysis. The authors reported a pooled effect size (standardized mean difference; SMD) of -0.75 (95% CI: -1.82 to 0.32, p = 0.17) in favor of supplementation, but the analytical approach was not appropriate for a pooled analysis of randomized controlled trials and the effect sizes were calculated incorrectly. This letter discusses how these issues impact the results and interpretation of the paper, then provides an update on the estimated average effect of vitamin D on strength outcomes in athletes.Methods Identified errors included the use of within-group rather than between-group effect size metrics, the use of standard error values in place of standard deviations, and failure to account for correlated observations within the model. The data were reanalyzed after correcting for these common meta-analytic errors.Results The results of this reanalysis reflect a dramatically smaller and statistically nonsignificant pooled effect estimate of SMD = 0.16 (-0.24 to 0.56, p = 0.43) in favor of supplementation. Further, the model from this reanalysis has more favorable statistical characteristics than the original analysis, as evidenced by a fairly symmetrical funnel plot and a nonsignificant result for Cochrane’s Q test (Q = 5.02, p = 0.41).Conclusion In order to disseminate robust information to sports nutrition practitioners and researchers, it is critically important for meta-analyses to produce valid effect estimates that are appropriate for the underlying study designs and calculated without error. This letter highlights common errors to inform the calculation and interpretation of future meta-analyses in sports nutrition.https://www.tandfonline.com/doi/10.1080/15502783.2024.2413668Vitamin Dmeta-analysiseffect size
spellingShingle Eric T. Trexler
Inflated effect estimates for vitamin D supplementation are driven by common meta-analytical errors
Journal of the International Society of Sports Nutrition
Vitamin D
meta-analysis
effect size
title Inflated effect estimates for vitamin D supplementation are driven by common meta-analytical errors
title_full Inflated effect estimates for vitamin D supplementation are driven by common meta-analytical errors
title_fullStr Inflated effect estimates for vitamin D supplementation are driven by common meta-analytical errors
title_full_unstemmed Inflated effect estimates for vitamin D supplementation are driven by common meta-analytical errors
title_short Inflated effect estimates for vitamin D supplementation are driven by common meta-analytical errors
title_sort inflated effect estimates for vitamin d supplementation are driven by common meta analytical errors
topic Vitamin D
meta-analysis
effect size
url https://www.tandfonline.com/doi/10.1080/15502783.2024.2413668
work_keys_str_mv AT ericttrexler inflatedeffectestimatesforvitamindsupplementationaredrivenbycommonmetaanalyticalerrors