Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists

Introduction. A new version of Quantra v.2.2.2 artificial intelligence (AI) software is used for mammography breast density (MBD) assessment. This study aimed to determine the intraobserver agreement of radiologists (human readers, HRs) and the interobserver agreement between AI Quantra and HRs in M...

Full description

Saved in:
Bibliographic Details
Main Authors: Beatriz E. Gonzalez-Ulloa, Claudia B. Corona-Gonzalez, Rosa L. Molina-Gutierrez, Sofia Salas-Aguirre
Format: Article
Language:English
Published: Permanyer 2024-10-01
Series:Journal of the Mexican Federation of Radiology and Imaging
Online Access:https://www.jmexfri.com/frame_eng.php?id=118
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841557099728863232
author Beatriz E. Gonzalez-Ulloa
Claudia B. Corona-Gonzalez
Rosa L. Molina-Gutierrez
Sofia Salas-Aguirre
author_facet Beatriz E. Gonzalez-Ulloa
Claudia B. Corona-Gonzalez
Rosa L. Molina-Gutierrez
Sofia Salas-Aguirre
author_sort Beatriz E. Gonzalez-Ulloa
collection DOAJ
description Introduction. A new version of Quantra v.2.2.2 artificial intelligence (AI) software is used for mammography breast density (MBD) assessment. This study aimed to determine the intraobserver agreement of radiologists (human readers, HRs) and the interobserver agreement between AI Quantra and HRs in MBD assessment. Material and methods: This prospective cohort study was conducted in two phases. HRs and AI Quantra version 2.2.2 assessed MBD in 2D mammograms and tomosynthesis in women over 35 years based on the BI-RADS 5th Edition. HRs had training in breast imaging with different levels of experience. MBD assessment between the first (phase 1) and second reading (phase 2) of the HRs was compared using four (a, b, c, d) and two MBD categories (a+b, non-dense, and c+d, dense). Intraobserver and interobserver agreement was assessed with light Kappa and Cohen's Kappa. Results: Four HRs with 2 to 32 years of experience interpreting breast images participated. They evaluated 685 mammograms in each phase. Intraobserver agreement between the two phases was moderate to substantial for the four MBD categories and substantial to near perfect for the two MBD categories. The interobserver agreement between AI Quantra and the four HRs varied from slight to moderate for the four MBD categories and moderate to substantial for the two categories. The interobserver agreement between AI and the four HRs improved in phase 2. Conclusion: Intraobserver agreement between radiologists and interobserver agreement between AI Quantra and HRs increased when assessing non-dense and dense MBD categories. Many factors can influence the visual assessment of MBD by radiologists, making AI a tool that can provide radiologists with additional information when assessing MBD.
format Article
id doaj-art-a48cfd9e8f3f432d88f938a1d46399c0
institution Kabale University
issn 2938-1215
2696-8444
language English
publishDate 2024-10-01
publisher Permanyer
record_format Article
series Journal of the Mexican Federation of Radiology and Imaging
spelling doaj-art-a48cfd9e8f3f432d88f938a1d46399c02025-01-06T22:23:08ZengPermanyerJournal of the Mexican Federation of Radiology and Imaging2938-12152696-84442024-10-013410.24875/JMEXFRI.M24000088Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologistsBeatriz E. Gonzalez-Ulloa0Claudia B. Corona-Gonzalez1Rosa L. Molina-Gutierrez2Sofia Salas-Aguirre3Breast Imaging Department, Specialized Diagnostic Imaging Center, Zapopan, Jalisco, MexicoBreast Imaging Department, Specialized Diagnostic Imaging Center, Zapopan, Jalisco, MexicoBreast Imaging Department, Specialized Diagnostic Imaging Center, Zapopan, Jalisco, MexicoBreast Imaging Department, Specialized Diagnostic Imaging Center, Zapopan, Jalisco, MexicoIntroduction. A new version of Quantra v.2.2.2 artificial intelligence (AI) software is used for mammography breast density (MBD) assessment. This study aimed to determine the intraobserver agreement of radiologists (human readers, HRs) and the interobserver agreement between AI Quantra and HRs in MBD assessment. Material and methods: This prospective cohort study was conducted in two phases. HRs and AI Quantra version 2.2.2 assessed MBD in 2D mammograms and tomosynthesis in women over 35 years based on the BI-RADS 5th Edition. HRs had training in breast imaging with different levels of experience. MBD assessment between the first (phase 1) and second reading (phase 2) of the HRs was compared using four (a, b, c, d) and two MBD categories (a+b, non-dense, and c+d, dense). Intraobserver and interobserver agreement was assessed with light Kappa and Cohen's Kappa. Results: Four HRs with 2 to 32 years of experience interpreting breast images participated. They evaluated 685 mammograms in each phase. Intraobserver agreement between the two phases was moderate to substantial for the four MBD categories and substantial to near perfect for the two MBD categories. The interobserver agreement between AI Quantra and the four HRs varied from slight to moderate for the four MBD categories and moderate to substantial for the two categories. The interobserver agreement between AI and the four HRs improved in phase 2. Conclusion: Intraobserver agreement between radiologists and interobserver agreement between AI Quantra and HRs increased when assessing non-dense and dense MBD categories. Many factors can influence the visual assessment of MBD by radiologists, making AI a tool that can provide radiologists with additional information when assessing MBD. https://www.jmexfri.com/frame_eng.php?id=118
spellingShingle Beatriz E. Gonzalez-Ulloa
Claudia B. Corona-Gonzalez
Rosa L. Molina-Gutierrez
Sofia Salas-Aguirre
Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists
Journal of the Mexican Federation of Radiology and Imaging
title Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists
title_full Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists
title_fullStr Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists
title_full_unstemmed Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists
title_short Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists
title_sort mammography breast density assessment with quantra artificial intelligence software intra and interobserver agreement with radiologists
url https://www.jmexfri.com/frame_eng.php?id=118
work_keys_str_mv AT beatrizegonzalezulloa mammographybreastdensityassessmentwithquantraartificialintelligencesoftwareintraandinterobserveragreementwithradiologists
AT claudiabcoronagonzalez mammographybreastdensityassessmentwithquantraartificialintelligencesoftwareintraandinterobserveragreementwithradiologists
AT rosalmolinagutierrez mammographybreastdensityassessmentwithquantraartificialintelligencesoftwareintraandinterobserveragreementwithradiologists
AT sofiasalasaguirre mammographybreastdensityassessmentwithquantraartificialintelligencesoftwareintraandinterobserveragreementwithradiologists