Added Value of Medical Subject Headings Terms in Search Strategies of Systematic Reviews: Comparative Study
BackgroundThe massive increase in the number of published scientific articles enhances knowledge but makes it more complicated to summarize results. The Medical Subject Headings (MeSH) thesaurus was created in the mid-20th century with the aim of systematizing article indexin...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2024-11-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2024/1/e53781 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846162970230390784 |
|---|---|
| author | Victor Leblanc Aghiles Hamroun Raphaël Bentegeac Bastien Le Guellec Rémi Lenain Emmanuel Chazard |
| author_facet | Victor Leblanc Aghiles Hamroun Raphaël Bentegeac Bastien Le Guellec Rémi Lenain Emmanuel Chazard |
| author_sort | Victor Leblanc |
| collection | DOAJ |
| description |
BackgroundThe massive increase in the number of published scientific articles enhances knowledge but makes it more complicated to summarize results. The Medical Subject Headings (MeSH) thesaurus was created in the mid-20th century with the aim of systematizing article indexing and facilitating their retrieval. Despite the advent of search engines, few studies have questioned the relevance of the MeSH thesaurus, and none have done so systematically.
ObjectiveThe objective of this study was to estimate the added value of using MeSH terms in PubMed queries for systematic reviews (SRs).
MethodsSRs published in 4 high-impact medical journals in general medicine over the past 10 years were selected. Only SRs for which a PubMed query was provided were included. Each query was transformed to obtain 3 versions: the original query (V1), the query with free-text terms only (V2), and the query with MeSH terms only (V3). These 3 queries were compared with each other based on their sensitivity and positive predictive values.
ResultsIn total, 59 SRs were included. The suppression of MeSH terms had an impact on the number of relevant articles retrieved for 24 (41%) out of 59 SRs. The median (IQR) sensitivities of queries V1 and V2 were 77.8% (62.1%-95.2%) and 71.4% (42.6%-90%), respectively. V1 queries provided an average of 2.62 additional relevant papers per SR compared with V2 queries. However, an additional 820.29 papers had to be screened. The cost of screening an additional collected paper was therefore 313.09, which was slightly more than triple the mean reading cost associated with V2 queries (88.67).
ConclusionsOur results revealed that removing MeSH terms from a query decreases sensitivity while slightly increasing the positive predictive value. Queries containing both MeSH and free-text terms yielded more relevant articles but required screening many additional papers. Despite this additional workload, MeSH terms remain indispensable for SRs. |
| format | Article |
| id | doaj-art-57bc3f29038548a294d30d4d050a0c60 |
| institution | Kabale University |
| issn | 1438-8871 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj-art-57bc3f29038548a294d30d4d050a0c602024-11-19T21:01:23ZengJMIR PublicationsJournal of Medical Internet Research1438-88712024-11-0126e5378110.2196/53781Added Value of Medical Subject Headings Terms in Search Strategies of Systematic Reviews: Comparative StudyVictor Leblanchttps://orcid.org/0009-0006-2103-405XAghiles Hamrounhttps://orcid.org/0000-0003-4988-206XRaphaël Bentegeachttps://orcid.org/0000-0003-3608-6240Bastien Le Guellechttps://orcid.org/0000-0002-3618-4791Rémi Lenainhttps://orcid.org/0000-0001-6317-9763Emmanuel Chazardhttps://orcid.org/0000-0001-7841-5925 BackgroundThe massive increase in the number of published scientific articles enhances knowledge but makes it more complicated to summarize results. The Medical Subject Headings (MeSH) thesaurus was created in the mid-20th century with the aim of systematizing article indexing and facilitating their retrieval. Despite the advent of search engines, few studies have questioned the relevance of the MeSH thesaurus, and none have done so systematically. ObjectiveThe objective of this study was to estimate the added value of using MeSH terms in PubMed queries for systematic reviews (SRs). MethodsSRs published in 4 high-impact medical journals in general medicine over the past 10 years were selected. Only SRs for which a PubMed query was provided were included. Each query was transformed to obtain 3 versions: the original query (V1), the query with free-text terms only (V2), and the query with MeSH terms only (V3). These 3 queries were compared with each other based on their sensitivity and positive predictive values. ResultsIn total, 59 SRs were included. The suppression of MeSH terms had an impact on the number of relevant articles retrieved for 24 (41%) out of 59 SRs. The median (IQR) sensitivities of queries V1 and V2 were 77.8% (62.1%-95.2%) and 71.4% (42.6%-90%), respectively. V1 queries provided an average of 2.62 additional relevant papers per SR compared with V2 queries. However, an additional 820.29 papers had to be screened. The cost of screening an additional collected paper was therefore 313.09, which was slightly more than triple the mean reading cost associated with V2 queries (88.67). ConclusionsOur results revealed that removing MeSH terms from a query decreases sensitivity while slightly increasing the positive predictive value. Queries containing both MeSH and free-text terms yielded more relevant articles but required screening many additional papers. Despite this additional workload, MeSH terms remain indispensable for SRs.https://www.jmir.org/2024/1/e53781 |
| spellingShingle | Victor Leblanc Aghiles Hamroun Raphaël Bentegeac Bastien Le Guellec Rémi Lenain Emmanuel Chazard Added Value of Medical Subject Headings Terms in Search Strategies of Systematic Reviews: Comparative Study Journal of Medical Internet Research |
| title | Added Value of Medical Subject Headings Terms in Search Strategies of Systematic Reviews: Comparative Study |
| title_full | Added Value of Medical Subject Headings Terms in Search Strategies of Systematic Reviews: Comparative Study |
| title_fullStr | Added Value of Medical Subject Headings Terms in Search Strategies of Systematic Reviews: Comparative Study |
| title_full_unstemmed | Added Value of Medical Subject Headings Terms in Search Strategies of Systematic Reviews: Comparative Study |
| title_short | Added Value of Medical Subject Headings Terms in Search Strategies of Systematic Reviews: Comparative Study |
| title_sort | added value of medical subject headings terms in search strategies of systematic reviews comparative study |
| url | https://www.jmir.org/2024/1/e53781 |
| work_keys_str_mv | AT victorleblanc addedvalueofmedicalsubjectheadingstermsinsearchstrategiesofsystematicreviewscomparativestudy AT aghileshamroun addedvalueofmedicalsubjectheadingstermsinsearchstrategiesofsystematicreviewscomparativestudy AT raphaelbentegeac addedvalueofmedicalsubjectheadingstermsinsearchstrategiesofsystematicreviewscomparativestudy AT bastienleguellec addedvalueofmedicalsubjectheadingstermsinsearchstrategiesofsystematicreviewscomparativestudy AT remilenain addedvalueofmedicalsubjectheadingstermsinsearchstrategiesofsystematicreviewscomparativestudy AT emmanuelchazard addedvalueofmedicalsubjectheadingstermsinsearchstrategiesofsystematicreviewscomparativestudy |