Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists
Introduction. A new version of Quantra v.2.2.2 artificial intelligence (AI) software is used for mammography breast density (MBD) assessment. This study aimed to determine the intraobserver agreement of radiologists (human readers, HRs) and the interobserver agreement between AI Quantra and HRs in M...
Saved in:
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Permanyer
2024-10-01
|
Series: | Journal of the Mexican Federation of Radiology and Imaging |
Online Access: | https://www.jmexfri.com/frame_eng.php?id=118 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1841557099728863232 |
---|---|
author | Beatriz E. Gonzalez-Ulloa Claudia B. Corona-Gonzalez Rosa L. Molina-Gutierrez Sofia Salas-Aguirre |
author_facet | Beatriz E. Gonzalez-Ulloa Claudia B. Corona-Gonzalez Rosa L. Molina-Gutierrez Sofia Salas-Aguirre |
author_sort | Beatriz E. Gonzalez-Ulloa |
collection | DOAJ |
description | Introduction. A new version of Quantra v.2.2.2 artificial intelligence (AI) software is used for mammography breast density (MBD) assessment. This study aimed to determine the intraobserver agreement of radiologists (human readers, HRs) and the interobserver agreement between AI Quantra and HRs in MBD assessment. Material and methods: This prospective cohort study was conducted in two phases. HRs and AI Quantra version 2.2.2 assessed MBD in 2D mammograms and tomosynthesis in women over 35 years based on the BI-RADS 5th Edition. HRs had training in breast imaging with different levels of experience. MBD assessment between the first (phase 1) and second reading (phase 2) of the HRs was compared using four (a, b, c, d) and two MBD categories (a+b, non-dense, and c+d, dense). Intraobserver and interobserver agreement was assessed with light Kappa and Cohen's Kappa. Results: Four HRs with 2 to 32 years of experience interpreting breast images participated. They evaluated 685 mammograms in each phase. Intraobserver agreement between the two phases was moderate to substantial for the four MBD categories and substantial to near perfect for the two MBD categories. The interobserver agreement between AI Quantra and the four HRs varied from slight to moderate for the four MBD categories and moderate to substantial for the two categories. The interobserver agreement between AI and the four HRs improved in phase 2. Conclusion: Intraobserver agreement between radiologists and interobserver agreement between AI Quantra and HRs increased when assessing non-dense and dense MBD categories. Many factors can influence the visual assessment of MBD by radiologists, making AI a tool that can provide radiologists with additional information when assessing MBD.
|
format | Article |
id | doaj-art-a48cfd9e8f3f432d88f938a1d46399c0 |
institution | Kabale University |
issn | 2938-1215 2696-8444 |
language | English |
publishDate | 2024-10-01 |
publisher | Permanyer |
record_format | Article |
series | Journal of the Mexican Federation of Radiology and Imaging |
spelling | doaj-art-a48cfd9e8f3f432d88f938a1d46399c02025-01-06T22:23:08ZengPermanyerJournal of the Mexican Federation of Radiology and Imaging2938-12152696-84442024-10-013410.24875/JMEXFRI.M24000088Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologistsBeatriz E. Gonzalez-Ulloa0Claudia B. Corona-Gonzalez1Rosa L. Molina-Gutierrez2Sofia Salas-Aguirre3Breast Imaging Department, Specialized Diagnostic Imaging Center, Zapopan, Jalisco, MexicoBreast Imaging Department, Specialized Diagnostic Imaging Center, Zapopan, Jalisco, MexicoBreast Imaging Department, Specialized Diagnostic Imaging Center, Zapopan, Jalisco, MexicoBreast Imaging Department, Specialized Diagnostic Imaging Center, Zapopan, Jalisco, MexicoIntroduction. A new version of Quantra v.2.2.2 artificial intelligence (AI) software is used for mammography breast density (MBD) assessment. This study aimed to determine the intraobserver agreement of radiologists (human readers, HRs) and the interobserver agreement between AI Quantra and HRs in MBD assessment. Material and methods: This prospective cohort study was conducted in two phases. HRs and AI Quantra version 2.2.2 assessed MBD in 2D mammograms and tomosynthesis in women over 35 years based on the BI-RADS 5th Edition. HRs had training in breast imaging with different levels of experience. MBD assessment between the first (phase 1) and second reading (phase 2) of the HRs was compared using four (a, b, c, d) and two MBD categories (a+b, non-dense, and c+d, dense). Intraobserver and interobserver agreement was assessed with light Kappa and Cohen's Kappa. Results: Four HRs with 2 to 32 years of experience interpreting breast images participated. They evaluated 685 mammograms in each phase. Intraobserver agreement between the two phases was moderate to substantial for the four MBD categories and substantial to near perfect for the two MBD categories. The interobserver agreement between AI Quantra and the four HRs varied from slight to moderate for the four MBD categories and moderate to substantial for the two categories. The interobserver agreement between AI and the four HRs improved in phase 2. Conclusion: Intraobserver agreement between radiologists and interobserver agreement between AI Quantra and HRs increased when assessing non-dense and dense MBD categories. Many factors can influence the visual assessment of MBD by radiologists, making AI a tool that can provide radiologists with additional information when assessing MBD. https://www.jmexfri.com/frame_eng.php?id=118 |
spellingShingle | Beatriz E. Gonzalez-Ulloa Claudia B. Corona-Gonzalez Rosa L. Molina-Gutierrez Sofia Salas-Aguirre Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists Journal of the Mexican Federation of Radiology and Imaging |
title | Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists |
title_full | Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists |
title_fullStr | Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists |
title_full_unstemmed | Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists |
title_short | Mammography breast density assessment with Quantra artificial intelligence software: intra- and interobserver agreement with radiologists |
title_sort | mammography breast density assessment with quantra artificial intelligence software intra and interobserver agreement with radiologists |
url | https://www.jmexfri.com/frame_eng.php?id=118 |
work_keys_str_mv | AT beatrizegonzalezulloa mammographybreastdensityassessmentwithquantraartificialintelligencesoftwareintraandinterobserveragreementwithradiologists AT claudiabcoronagonzalez mammographybreastdensityassessmentwithquantraartificialintelligencesoftwareintraandinterobserveragreementwithradiologists AT rosalmolinagutierrez mammographybreastdensityassessmentwithquantraartificialintelligencesoftwareintraandinterobserveragreementwithradiologists AT sofiasalasaguirre mammographybreastdensityassessmentwithquantraartificialintelligencesoftwareintraandinterobserveragreementwithradiologists |