Measuring how computer science research translates into innovation and development

Abstract What factors determine the impact of a scientific paper? Does its impact extend to patents and software development, or is it primarily confined to academic circles? While current literature predominantly adopts a descriptive approach, emphasizing patent citations as indicators of industry...

Full description

Saved in:
Bibliographic Details
Main Authors: Federico Cinus, Ali Septiandri, Marios Constantinides, Daniele Quercia
Format: Article
Language:English
Published: SpringerOpen 2025-07-01
Series:EPJ Data Science
Subjects:
Online Access:https://doi.org/10.1140/epjds/s13688-025-00568-4
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849237781888368640
author Federico Cinus
Ali Septiandri
Marios Constantinides
Daniele Quercia
author_facet Federico Cinus
Ali Septiandri
Marios Constantinides
Daniele Quercia
author_sort Federico Cinus
collection DOAJ
description Abstract What factors determine the impact of a scientific paper? Does its impact extend to patents and software development, or is it primarily confined to academic circles? While current literature predominantly adopts a descriptive approach, emphasizing patent citations as indicators of industry impact, the role of research in driving software development is overlooked. To address this gap, we quantitatively assessed the impact of research papers on both patents and software repositories. With a computational social science approach, we collected, curated, and analyzed a large-scale dataset of 200K papers published between 1980 and 2022 across the research areas of AI, Computer Vision, Data Mining, Databases, HCI, and NLP, including conferences like NeurIPS, ICML, ACL, CVPR, CHI, KDD, and The Web Conference. We found that, on average, 7.1% of papers from these venues became patents and 11.6% went into repositories—significantly higher than top general science journals (3.8% for patents and 0.02% for repositories). Despite being a minority, these papers have received a disproportionate number of citations—4% of AI papers became patents, and 18% went into repositories, yet they have received 29% and 42% of the area’s academic citations, respectively. However, after correcting for papers published at different times with survival analysis, we found that there is a significant time lag between patents or repositories and papers (10-15 years for patents, 5 years for repositories in Computer Vision and NLP, and even longer for top general science journals at 30 years). As for consistent trends, Deep Learning has become exponentially popular, and “papers with code” are becoming the norm. Finally, we showed that a paper’s publication venue and the extent to which a paper builds upon (un)conventional knowledge determine the impact on patents and repositories, with greater conventionality predicting impact on patents, and lesser conventionality predicting impact on repositories.
format Article
id doaj-art-73eea8cd13a24e1eb80d0467d4c8d8c9
institution Kabale University
issn 2193-1127
language English
publishDate 2025-07-01
publisher SpringerOpen
record_format Article
series EPJ Data Science
spelling doaj-art-73eea8cd13a24e1eb80d0467d4c8d8c92025-08-20T04:01:52ZengSpringerOpenEPJ Data Science2193-11272025-07-0114111710.1140/epjds/s13688-025-00568-4Measuring how computer science research translates into innovation and developmentFederico Cinus0Ali Septiandri1Marios Constantinides2Daniele Quercia3Sapienza University of RomeNokia Bell LabsNokia Bell LabsNokia Bell LabsAbstract What factors determine the impact of a scientific paper? Does its impact extend to patents and software development, or is it primarily confined to academic circles? While current literature predominantly adopts a descriptive approach, emphasizing patent citations as indicators of industry impact, the role of research in driving software development is overlooked. To address this gap, we quantitatively assessed the impact of research papers on both patents and software repositories. With a computational social science approach, we collected, curated, and analyzed a large-scale dataset of 200K papers published between 1980 and 2022 across the research areas of AI, Computer Vision, Data Mining, Databases, HCI, and NLP, including conferences like NeurIPS, ICML, ACL, CVPR, CHI, KDD, and The Web Conference. We found that, on average, 7.1% of papers from these venues became patents and 11.6% went into repositories—significantly higher than top general science journals (3.8% for patents and 0.02% for repositories). Despite being a minority, these papers have received a disproportionate number of citations—4% of AI papers became patents, and 18% went into repositories, yet they have received 29% and 42% of the area’s academic citations, respectively. However, after correcting for papers published at different times with survival analysis, we found that there is a significant time lag between patents or repositories and papers (10-15 years for patents, 5 years for repositories in Computer Vision and NLP, and even longer for top general science journals at 30 years). As for consistent trends, Deep Learning has become exponentially popular, and “papers with code” are becoming the norm. Finally, we showed that a paper’s publication venue and the extent to which a paper builds upon (un)conventional knowledge determine the impact on patents and repositories, with greater conventionality predicting impact on patents, and lesser conventionality predicting impact on repositories.https://doi.org/10.1140/epjds/s13688-025-00568-4Research impactInnovationDevelopmentPatentsRepositories
spellingShingle Federico Cinus
Ali Septiandri
Marios Constantinides
Daniele Quercia
Measuring how computer science research translates into innovation and development
EPJ Data Science
Research impact
Innovation
Development
Patents
Repositories
title Measuring how computer science research translates into innovation and development
title_full Measuring how computer science research translates into innovation and development
title_fullStr Measuring how computer science research translates into innovation and development
title_full_unstemmed Measuring how computer science research translates into innovation and development
title_short Measuring how computer science research translates into innovation and development
title_sort measuring how computer science research translates into innovation and development
topic Research impact
Innovation
Development
Patents
Repositories
url https://doi.org/10.1140/epjds/s13688-025-00568-4
work_keys_str_mv AT federicocinus measuringhowcomputerscienceresearchtranslatesintoinnovationanddevelopment
AT aliseptiandri measuringhowcomputerscienceresearchtranslatesintoinnovationanddevelopment
AT mariosconstantinides measuringhowcomputerscienceresearchtranslatesintoinnovationanddevelopment
AT danielequercia measuringhowcomputerscienceresearchtranslatesintoinnovationanddevelopment