Validity of data extraction in acupuncture meta-analysis: a reproducibility study protocol

Introduction Systematic review and meta-analysis occupy the apex of the evidence pyramid, serving as the most comprehensive and reliable form of evidence-based assessment. Data extraction is a crucial juncture in meta-analysis, establishing the underpinnings for the outcomes and deductions drawn fro...

Full description

Saved in:
Bibliographic Details
Main Authors: Shujuan Liu, Wenting Luo, Lin Yu, Yuting Duan, Pinge Zhao, Zewei Chen, Yuening Deng, Binbin Tang, Jinjin Zhou, Ziwen Xu
Format: Article
Language:English
Published: BMJ Publishing Group 2024-11-01
Series:BMJ Open
Online Access:https://bmjopen.bmj.com/content/14/11/e088736.full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846171129763332096
author Shujuan Liu
Wenting Luo
Lin Yu
Yuting Duan
Pinge Zhao
Zewei Chen
Yuening Deng
Binbin Tang
Jinjin Zhou
Ziwen Xu
author_facet Shujuan Liu
Wenting Luo
Lin Yu
Yuting Duan
Pinge Zhao
Zewei Chen
Yuening Deng
Binbin Tang
Jinjin Zhou
Ziwen Xu
author_sort Shujuan Liu
collection DOAJ
description Introduction Systematic review and meta-analysis occupy the apex of the evidence pyramid, serving as the most comprehensive and reliable form of evidence-based assessment. Data extraction is a crucial juncture in meta-analysis, establishing the underpinnings for the outcomes and deductions drawn from systematic reviews (SRs). However, the frequency of data extraction errors in meta-analysis is quite significant. Data extraction errors can lead to biased study results, affect the credibility of study results and even mislead clinical practice. The quantity of acupuncture randomised controlled trials and SRs has expanded rapidly recently, yet the validity of data extraction remains unexplored. Hence, our study aims to investigate the validity of data extraction errors in acupuncture SRs, the effect of data extraction errors on results and the relevant guidelines used erroneous results.Methods and analysis Four databases including MEDLINE, Web of Science, Cochrane linbrary and EMBASE will be searched from 1 January 2019 to 31 December 2023 for acupuncture SRs. Two researchers will independently extract data from the meta-analysis and the original study into a standardised data extraction table. A senior investigator, who did not participate in the data extraction process, will verify the results. In cases of discrepancies, the senior researcher will conduct further extraction and consult with another senior researcher to determine the final results. We will analyse the frequency and type of data extraction errors and data estimation errors and evaluate the effect of data extraction errors on results. Quantile regression will be used to explore the factors influencing data extraction error frequency at 25th, 50th and 75th percentiles. Finally, we will further search for guidelines used erroneous results.Ethics and dissemination Ethical approval is not necessary for this study. This protocol has been registered in Open Science Framework Registries.Registration DOI https://doi.org/10.17605/OSF.IO/CHMPA.
format Article
id doaj-art-911fc96d56a64f2584391ca10c63e728
institution Kabale University
issn 2044-6055
language English
publishDate 2024-11-01
publisher BMJ Publishing Group
record_format Article
series BMJ Open
spelling doaj-art-911fc96d56a64f2584391ca10c63e7282024-11-11T06:55:08ZengBMJ Publishing GroupBMJ Open2044-60552024-11-01141110.1136/bmjopen-2024-088736Validity of data extraction in acupuncture meta-analysis: a reproducibility study protocolShujuan Liu0Wenting Luo1Lin Yu2Yuting Duan3Pinge Zhao4Zewei Chen5Yuening Deng6Binbin Tang7Jinjin Zhou8Ziwen Xu91 Evidence-based Medicine Center, The Affiliated Traditional Chinese Medicine Hospital, Guangzhou Medical University, Guangzhou, Guangdong, China1 Evidence-based Medicine Center, The Affiliated Traditional Chinese Medicine Hospital, Guangzhou Medical University, Guangzhou, Guangdong, China1 Evidence-based Medicine Center, The Affiliated Traditional Chinese Medicine Hospital, Guangzhou Medical University, Guangzhou, Guangdong, China1 Evidence-based Medicine Center, The Affiliated Traditional Chinese Medicine Hospital, Guangzhou Medical University, Guangzhou, Guangdong, China2 Department of Integrated Chinese and Western Medicine, The Affiliated Brain Hospital of Guangzhou Medical University, Guangzhou, Guangdong, China2 Department of Integrated Chinese and Western Medicine, The Affiliated Brain Hospital of Guangzhou Medical University, Guangzhou, Guangdong, China1 Evidence-based Medicine Center, The Affiliated Traditional Chinese Medicine Hospital, Guangzhou Medical University, Guangzhou, Guangdong, China4 Clinical School of Integrated Traditional Chinese and Western Medicine, Guangzhou Medical University, Guangzhou, Guangdong, China3 The Affiliated Guangzhou Hospital of TCM of Guangzhou University of Chinese Medicine, Guangzhou, P. R. China, Guangzhou, Guangdong, China4 Clinical School of Integrated Traditional Chinese and Western Medicine, Guangzhou Medical University, Guangzhou, Guangdong, ChinaIntroduction Systematic review and meta-analysis occupy the apex of the evidence pyramid, serving as the most comprehensive and reliable form of evidence-based assessment. Data extraction is a crucial juncture in meta-analysis, establishing the underpinnings for the outcomes and deductions drawn from systematic reviews (SRs). However, the frequency of data extraction errors in meta-analysis is quite significant. Data extraction errors can lead to biased study results, affect the credibility of study results and even mislead clinical practice. The quantity of acupuncture randomised controlled trials and SRs has expanded rapidly recently, yet the validity of data extraction remains unexplored. Hence, our study aims to investigate the validity of data extraction errors in acupuncture SRs, the effect of data extraction errors on results and the relevant guidelines used erroneous results.Methods and analysis Four databases including MEDLINE, Web of Science, Cochrane linbrary and EMBASE will be searched from 1 January 2019 to 31 December 2023 for acupuncture SRs. Two researchers will independently extract data from the meta-analysis and the original study into a standardised data extraction table. A senior investigator, who did not participate in the data extraction process, will verify the results. In cases of discrepancies, the senior researcher will conduct further extraction and consult with another senior researcher to determine the final results. We will analyse the frequency and type of data extraction errors and data estimation errors and evaluate the effect of data extraction errors on results. Quantile regression will be used to explore the factors influencing data extraction error frequency at 25th, 50th and 75th percentiles. Finally, we will further search for guidelines used erroneous results.Ethics and dissemination Ethical approval is not necessary for this study. This protocol has been registered in Open Science Framework Registries.Registration DOI https://doi.org/10.17605/OSF.IO/CHMPA.https://bmjopen.bmj.com/content/14/11/e088736.full
spellingShingle Shujuan Liu
Wenting Luo
Lin Yu
Yuting Duan
Pinge Zhao
Zewei Chen
Yuening Deng
Binbin Tang
Jinjin Zhou
Ziwen Xu
Validity of data extraction in acupuncture meta-analysis: a reproducibility study protocol
BMJ Open
title Validity of data extraction in acupuncture meta-analysis: a reproducibility study protocol
title_full Validity of data extraction in acupuncture meta-analysis: a reproducibility study protocol
title_fullStr Validity of data extraction in acupuncture meta-analysis: a reproducibility study protocol
title_full_unstemmed Validity of data extraction in acupuncture meta-analysis: a reproducibility study protocol
title_short Validity of data extraction in acupuncture meta-analysis: a reproducibility study protocol
title_sort validity of data extraction in acupuncture meta analysis a reproducibility study protocol
url https://bmjopen.bmj.com/content/14/11/e088736.full
work_keys_str_mv AT shujuanliu validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT wentingluo validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT linyu validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT yutingduan validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT pingezhao validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT zeweichen validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT yueningdeng validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT binbintang validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT jinjinzhou validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol
AT ziwenxu validityofdataextractioninacupuncturemetaanalysisareproducibilitystudyprotocol