Reproducible research policies and software/data management in scientific computing journals: a survey, discussion, and perspectives
IntroductionThe recognized credibility crisis in scientific research has led to an increasing focus on reproducibility studies, particularly in computer science. Existing studies predominantly examine specific technological aspects of reproducibility but neglect the critical interplay between author...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-01-01
|
| Series: | Frontiers in Computer Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fcomp.2024.1491823/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841527860881260544 |
|---|---|
| author | Jose Armando Hernandez Miguel Colom |
| author_facet | Jose Armando Hernandez Miguel Colom |
| author_sort | Jose Armando Hernandez |
| collection | DOAJ |
| description | IntroductionThe recognized credibility crisis in scientific research has led to an increasing focus on reproducibility studies, particularly in computer science. Existing studies predominantly examine specific technological aspects of reproducibility but neglect the critical interplay between authors and publishers in enabling reproducible computational scientific research.MethodsA systematic review was conducted following the PRISMA Literature Review methodology, complemented by a Journals Survey. This approach enabled a comprehensive analysis of reproducibility policies and software/data management practices in scientific computing journals.ResultsThe survey revealed significant variability in reproducibility policies and practices across computer science journals. Many gaps and challenges were identified, including inconsistencies in policy enforcement, lack of standardized tools, and insufficient recognition of software as a research artifact. The analysis highlighted the potential of Reproducibility as a Service (RaaS) as an innovative solution to address these challenges.DiscussionThis study underscores the need for improved standardization and implementation of reproducibility policies. Strategies to enhance reproducibility include fostering collaboration among authors, publishers, and technology providers, as well as recognizing software as a critical research output. The findings aim to guide stakeholders in bridging the current gaps and advancing the reproducibility of computational scientific articles. |
| format | Article |
| id | doaj-art-da96a094c9da40eba807001f93420148 |
| institution | Kabale University |
| issn | 2624-9898 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Computer Science |
| spelling | doaj-art-da96a094c9da40eba807001f934201482025-01-15T06:10:57ZengFrontiers Media S.A.Frontiers in Computer Science2624-98982025-01-01610.3389/fcomp.2024.14918231491823Reproducible research policies and software/data management in scientific computing journals: a survey, discussion, and perspectivesJose Armando HernandezMiguel ColomIntroductionThe recognized credibility crisis in scientific research has led to an increasing focus on reproducibility studies, particularly in computer science. Existing studies predominantly examine specific technological aspects of reproducibility but neglect the critical interplay between authors and publishers in enabling reproducible computational scientific research.MethodsA systematic review was conducted following the PRISMA Literature Review methodology, complemented by a Journals Survey. This approach enabled a comprehensive analysis of reproducibility policies and software/data management practices in scientific computing journals.ResultsThe survey revealed significant variability in reproducibility policies and practices across computer science journals. Many gaps and challenges were identified, including inconsistencies in policy enforcement, lack of standardized tools, and insufficient recognition of software as a research artifact. The analysis highlighted the potential of Reproducibility as a Service (RaaS) as an innovative solution to address these challenges.DiscussionThis study underscores the need for improved standardization and implementation of reproducibility policies. Strategies to enhance reproducibility include fostering collaboration among authors, publishers, and technology providers, as well as recognizing software as a critical research output. The findings aim to guide stakeholders in bridging the current gaps and advancing the reproducibility of computational scientific articles.https://www.frontiersin.org/articles/10.3389/fcomp.2024.1491823/fullrepeatabilityreproducibilityreplicabilityreusabilitydata science ML/AIRaaS |
| spellingShingle | Jose Armando Hernandez Miguel Colom Reproducible research policies and software/data management in scientific computing journals: a survey, discussion, and perspectives Frontiers in Computer Science repeatability reproducibility replicability reusability data science ML/AI RaaS |
| title | Reproducible research policies and software/data management in scientific computing journals: a survey, discussion, and perspectives |
| title_full | Reproducible research policies and software/data management in scientific computing journals: a survey, discussion, and perspectives |
| title_fullStr | Reproducible research policies and software/data management in scientific computing journals: a survey, discussion, and perspectives |
| title_full_unstemmed | Reproducible research policies and software/data management in scientific computing journals: a survey, discussion, and perspectives |
| title_short | Reproducible research policies and software/data management in scientific computing journals: a survey, discussion, and perspectives |
| title_sort | reproducible research policies and software data management in scientific computing journals a survey discussion and perspectives |
| topic | repeatability reproducibility replicability reusability data science ML/AI RaaS |
| url | https://www.frontiersin.org/articles/10.3389/fcomp.2024.1491823/full |
| work_keys_str_mv | AT josearmandohernandez reproducibleresearchpoliciesandsoftwaredatamanagementinscientificcomputingjournalsasurveydiscussionandperspectives AT miguelcolom reproducibleresearchpoliciesandsoftwaredatamanagementinscientificcomputingjournalsasurveydiscussionandperspectives |