Automating quality control in cardiac magnetic resonance: Artificial intelligence for discriminative assessment of planning and motion artifacts and real-time reacquisition guidance

Background: Accurate measurements from cardiovascular magnetic resonance (CMR) images require precise positioning of scan planes and elimination of motion artifacts from arrhythmia or breathing. Unidentified or incorrectly managed artifacts degrade image quality, invalidate clinical measurements, an...

Full description

Saved in:
Bibliographic Details
Main Authors: Hoi C. Cheung, Kavitha Vimalesvaran, Sameer Zaman, Michalis Michaelides, Matthew J. Shun-Shin, Darrel P. Francis, Graham D. Cole, James P. Howard
Format: Article
Language:English
Published: Elsevier 2024-01-01
Series:Journal of Cardiovascular Magnetic Resonance
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S1097664724010949
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846121417551118336
author Hoi C. Cheung
Kavitha Vimalesvaran
Sameer Zaman
Michalis Michaelides
Matthew J. Shun-Shin
Darrel P. Francis
Graham D. Cole
James P. Howard
author_facet Hoi C. Cheung
Kavitha Vimalesvaran
Sameer Zaman
Michalis Michaelides
Matthew J. Shun-Shin
Darrel P. Francis
Graham D. Cole
James P. Howard
author_sort Hoi C. Cheung
collection DOAJ
description Background: Accurate measurements from cardiovascular magnetic resonance (CMR) images require precise positioning of scan planes and elimination of motion artifacts from arrhythmia or breathing. Unidentified or incorrectly managed artifacts degrade image quality, invalidate clinical measurements, and decrease diagnostic confidence. Currently, radiographers must manually inspect each acquired image to confirm diagnostic quality and decide whether reacquisition or a change in sequences is warranted. We aimed to develop artificial intelligence (AI) to provide continuous quality scores across different quality domains, and from these, determine whether cines are clinically adequate, require replanning, or warrant a change in protocol. Methods: A three-dimensional convolutional neural network was trained to predict cine quality graded on a continuous scale by a level 3 CMR expert, focusing separately on planning and motion artifacts. It incorporated four distinct output heads for the assessment of image quality in terms of (a, b, c) 2-, 3- and 4-chamber misplanning, and (d) long- and short-axis arrhythmia/breathing artifact. Backpropagation was selectively performed across these heads based on the labels present for each cine. Each image in the testing set was reported by four level 3 CMR experts, providing a consensus on clinical adequacy. The AI's assessment of image quality and ability to identify images requiring replanning or sequence changes were evaluated with Spearman’s rho and the area under receiver operating characteristic curve (AUROC), respectively. Results: A total of 1940 cines across 1387 studies were included. On the test set of 383 cines, AI-judged image quality correlated strongly with expert judgment, with Spearman’s rho of 0.84, 0.84, 0.81, and 0.81 for 2-, 3- and 4-chamber planning quality and the extent of arrhythmia or breathing artifacts, respectively. The AI also showed high efficacy in flagging clinically inadequate cines (AUROC 0.88, 0.93, and 0.93 for identifying misplanning of 2-, 3- and 4-chamber cines, and 0.90 for identifying movement artifacts). Conclusion: AI can assess distinct domains of CMR cine quality and provide continuous quality scores that correlate closely with a consensus of experts. These ratings could be used to identify cases where reacquisition is warranted and guide corrective actions to optimize image quality, including replanning, prospective gating, or real-time imaging.
format Article
id doaj-art-c54237a8a7984ab5b5b30852aef125a3
institution Kabale University
issn 1097-6647
language English
publishDate 2024-01-01
publisher Elsevier
record_format Article
series Journal of Cardiovascular Magnetic Resonance
spelling doaj-art-c54237a8a7984ab5b5b30852aef125a32024-12-16T05:34:42ZengElsevierJournal of Cardiovascular Magnetic Resonance1097-66472024-01-01262101067Automating quality control in cardiac magnetic resonance: Artificial intelligence for discriminative assessment of planning and motion artifacts and real-time reacquisition guidanceHoi C. Cheung0Kavitha Vimalesvaran1Sameer Zaman2Michalis Michaelides3Matthew J. Shun-Shin4Darrel P. Francis5Graham D. Cole6James P. Howard7National Heart and Lung Institute, Imperial College London, London, United KingdomNational Heart and Lung Institute, Imperial College London, London, United KingdomNational Heart and Lung Institute, Imperial College London, London, United KingdomNational Heart and Lung Institute, Imperial College London, London, United KingdomNational Heart and Lung Institute, Imperial College London, London, United KingdomNational Heart and Lung Institute, Imperial College London, London, United KingdomNational Heart and Lung Institute, Imperial College London, London, United KingdomCorresponding author: National Heart and Lung Institute, B Block, Imperial College London, Hammersmith Hospital, London W12 0HS, United Kingdom.; National Heart and Lung Institute, Imperial College London, London, United KingdomBackground: Accurate measurements from cardiovascular magnetic resonance (CMR) images require precise positioning of scan planes and elimination of motion artifacts from arrhythmia or breathing. Unidentified or incorrectly managed artifacts degrade image quality, invalidate clinical measurements, and decrease diagnostic confidence. Currently, radiographers must manually inspect each acquired image to confirm diagnostic quality and decide whether reacquisition or a change in sequences is warranted. We aimed to develop artificial intelligence (AI) to provide continuous quality scores across different quality domains, and from these, determine whether cines are clinically adequate, require replanning, or warrant a change in protocol. Methods: A three-dimensional convolutional neural network was trained to predict cine quality graded on a continuous scale by a level 3 CMR expert, focusing separately on planning and motion artifacts. It incorporated four distinct output heads for the assessment of image quality in terms of (a, b, c) 2-, 3- and 4-chamber misplanning, and (d) long- and short-axis arrhythmia/breathing artifact. Backpropagation was selectively performed across these heads based on the labels present for each cine. Each image in the testing set was reported by four level 3 CMR experts, providing a consensus on clinical adequacy. The AI's assessment of image quality and ability to identify images requiring replanning or sequence changes were evaluated with Spearman’s rho and the area under receiver operating characteristic curve (AUROC), respectively. Results: A total of 1940 cines across 1387 studies were included. On the test set of 383 cines, AI-judged image quality correlated strongly with expert judgment, with Spearman’s rho of 0.84, 0.84, 0.81, and 0.81 for 2-, 3- and 4-chamber planning quality and the extent of arrhythmia or breathing artifacts, respectively. The AI also showed high efficacy in flagging clinically inadequate cines (AUROC 0.88, 0.93, and 0.93 for identifying misplanning of 2-, 3- and 4-chamber cines, and 0.90 for identifying movement artifacts). Conclusion: AI can assess distinct domains of CMR cine quality and provide continuous quality scores that correlate closely with a consensus of experts. These ratings could be used to identify cases where reacquisition is warranted and guide corrective actions to optimize image quality, including replanning, prospective gating, or real-time imaging.http://www.sciencedirect.com/science/article/pii/S1097664724010949Artificial intelligenceMachine learningCardiac magnetic resonanceQuality controlQuality assessmentConvolutional neural networks
spellingShingle Hoi C. Cheung
Kavitha Vimalesvaran
Sameer Zaman
Michalis Michaelides
Matthew J. Shun-Shin
Darrel P. Francis
Graham D. Cole
James P. Howard
Automating quality control in cardiac magnetic resonance: Artificial intelligence for discriminative assessment of planning and motion artifacts and real-time reacquisition guidance
Journal of Cardiovascular Magnetic Resonance
Artificial intelligence
Machine learning
Cardiac magnetic resonance
Quality control
Quality assessment
Convolutional neural networks
title Automating quality control in cardiac magnetic resonance: Artificial intelligence for discriminative assessment of planning and motion artifacts and real-time reacquisition guidance
title_full Automating quality control in cardiac magnetic resonance: Artificial intelligence for discriminative assessment of planning and motion artifacts and real-time reacquisition guidance
title_fullStr Automating quality control in cardiac magnetic resonance: Artificial intelligence for discriminative assessment of planning and motion artifacts and real-time reacquisition guidance
title_full_unstemmed Automating quality control in cardiac magnetic resonance: Artificial intelligence for discriminative assessment of planning and motion artifacts and real-time reacquisition guidance
title_short Automating quality control in cardiac magnetic resonance: Artificial intelligence for discriminative assessment of planning and motion artifacts and real-time reacquisition guidance
title_sort automating quality control in cardiac magnetic resonance artificial intelligence for discriminative assessment of planning and motion artifacts and real time reacquisition guidance
topic Artificial intelligence
Machine learning
Cardiac magnetic resonance
Quality control
Quality assessment
Convolutional neural networks
url http://www.sciencedirect.com/science/article/pii/S1097664724010949
work_keys_str_mv AT hoiccheung automatingqualitycontrolincardiacmagneticresonanceartificialintelligencefordiscriminativeassessmentofplanningandmotionartifactsandrealtimereacquisitionguidance
AT kavithavimalesvaran automatingqualitycontrolincardiacmagneticresonanceartificialintelligencefordiscriminativeassessmentofplanningandmotionartifactsandrealtimereacquisitionguidance
AT sameerzaman automatingqualitycontrolincardiacmagneticresonanceartificialintelligencefordiscriminativeassessmentofplanningandmotionartifactsandrealtimereacquisitionguidance
AT michalismichaelides automatingqualitycontrolincardiacmagneticresonanceartificialintelligencefordiscriminativeassessmentofplanningandmotionartifactsandrealtimereacquisitionguidance
AT matthewjshunshin automatingqualitycontrolincardiacmagneticresonanceartificialintelligencefordiscriminativeassessmentofplanningandmotionartifactsandrealtimereacquisitionguidance
AT darrelpfrancis automatingqualitycontrolincardiacmagneticresonanceartificialintelligencefordiscriminativeassessmentofplanningandmotionartifactsandrealtimereacquisitionguidance
AT grahamdcole automatingqualitycontrolincardiacmagneticresonanceartificialintelligencefordiscriminativeassessmentofplanningandmotionartifactsandrealtimereacquisitionguidance
AT jamesphoward automatingqualitycontrolincardiacmagneticresonanceartificialintelligencefordiscriminativeassessmentofplanningandmotionartifactsandrealtimereacquisitionguidance