A Novel ConvLSTM-Based U-net for Improved Brain Tumor Segmentation
Using 2D scans or simple 3D convolutions are two limitations of previous works on segmentation of brain tumors by deep learning, which lead to ignoring the temporal distribution of the scans. This study proposes a novel extension to the well-known U-net model for brain tumor segmentation, utilizing...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10721476/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846150386024448000 |
|---|---|
| author | Osama Majeed Hilal Almiahi Alaa Taima Albu-Salih Dhafer Alhajim |
| author_facet | Osama Majeed Hilal Almiahi Alaa Taima Albu-Salih Dhafer Alhajim |
| author_sort | Osama Majeed Hilal Almiahi |
| collection | DOAJ |
| description | Using 2D scans or simple 3D convolutions are two limitations of previous works on segmentation of brain tumors by deep learning, which lead to ignoring the temporal distribution of the scans. This study proposes a novel extension to the well-known U-net model for brain tumor segmentation, utilizing 3D Magnetic Resonance Imaging (MRI) volumes as inputs. The method, called ConvLSTM-based U-net + up skip connections, incorporates the ConvLSTM blocks to capture spatio-temporal dependencies in the 3D MRI volumes, and up skip connections to capture low-level feature maps extracted from the encoding path, enhancing the information flow through the network to the standard U-net architecture. A novel intensity normalization technique is used to improve the comparability of scans. This technique normalizes image intensity by subtracting the grey-value of the most frequent bin from the image. The novel method is tested on the Multimodal Brain Tumor Segmentation (BRATS) 2015 dataset, showing that the use of ConvLSTM blocks improved segmentation quality by 1.6% on the test subset. The addition of skip connections further improved performance by 3.3% and 1.7% relative to the U-net and ConvLSTM-based U-net models, respectively. Moreover, the inclusion of up skip connections could enhance the performance by 5.7%, 3.99% and 2.2% relative to the simple U-net, ConvLSTM-based U-net, and ConvLSTM-based U-net with skip connections, respectively. Finally, the novel preprocessing technique had a positive effect on the proposed network, resulting in a 3.3% increase in the segmentation outcomes. |
| format | Article |
| id | doaj-art-4b084cc06f08450a8b24ee7f3748ea2f |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-4b084cc06f08450a8b24ee7f3748ea2f2024-11-29T00:01:11ZengIEEEIEEE Access2169-35362024-01-011215734615735810.1109/ACCESS.2024.348356210721476A Novel ConvLSTM-Based U-net for Improved Brain Tumor SegmentationOsama Majeed Hilal Almiahi0https://orcid.org/0000-0001-6740-6089Alaa Taima Albu-Salih1https://orcid.org/0000-0001-5006-5898Dhafer Alhajim2https://orcid.org/0000-0002-0381-2886College of Computer Science and Information Technology, University of Al-Qadisiyah, Al Diwaniyah, IraqCollege of Computer Science and Information Technology, University of Al-Qadisiyah, Al Diwaniyah, IraqComputer Center, University of Al-Qadisiyah, Al Diwaniyah, IraqUsing 2D scans or simple 3D convolutions are two limitations of previous works on segmentation of brain tumors by deep learning, which lead to ignoring the temporal distribution of the scans. This study proposes a novel extension to the well-known U-net model for brain tumor segmentation, utilizing 3D Magnetic Resonance Imaging (MRI) volumes as inputs. The method, called ConvLSTM-based U-net + up skip connections, incorporates the ConvLSTM blocks to capture spatio-temporal dependencies in the 3D MRI volumes, and up skip connections to capture low-level feature maps extracted from the encoding path, enhancing the information flow through the network to the standard U-net architecture. A novel intensity normalization technique is used to improve the comparability of scans. This technique normalizes image intensity by subtracting the grey-value of the most frequent bin from the image. The novel method is tested on the Multimodal Brain Tumor Segmentation (BRATS) 2015 dataset, showing that the use of ConvLSTM blocks improved segmentation quality by 1.6% on the test subset. The addition of skip connections further improved performance by 3.3% and 1.7% relative to the U-net and ConvLSTM-based U-net models, respectively. Moreover, the inclusion of up skip connections could enhance the performance by 5.7%, 3.99% and 2.2% relative to the simple U-net, ConvLSTM-based U-net, and ConvLSTM-based U-net with skip connections, respectively. Finally, the novel preprocessing technique had a positive effect on the proposed network, resulting in a 3.3% increase in the segmentation outcomes.https://ieeexplore.ieee.org/document/10721476/Brain tumordeep learningConvLSTMup skip connectionU-net |
| spellingShingle | Osama Majeed Hilal Almiahi Alaa Taima Albu-Salih Dhafer Alhajim A Novel ConvLSTM-Based U-net for Improved Brain Tumor Segmentation IEEE Access Brain tumor deep learning ConvLSTM up skip connection U-net |
| title | A Novel ConvLSTM-Based U-net for Improved Brain Tumor Segmentation |
| title_full | A Novel ConvLSTM-Based U-net for Improved Brain Tumor Segmentation |
| title_fullStr | A Novel ConvLSTM-Based U-net for Improved Brain Tumor Segmentation |
| title_full_unstemmed | A Novel ConvLSTM-Based U-net for Improved Brain Tumor Segmentation |
| title_short | A Novel ConvLSTM-Based U-net for Improved Brain Tumor Segmentation |
| title_sort | novel convlstm based u net for improved brain tumor segmentation |
| topic | Brain tumor deep learning ConvLSTM up skip connection U-net |
| url | https://ieeexplore.ieee.org/document/10721476/ |
| work_keys_str_mv | AT osamamajeedhilalalmiahi anovelconvlstmbasedunetforimprovedbraintumorsegmentation AT alaataimaalbusalih anovelconvlstmbasedunetforimprovedbraintumorsegmentation AT dhaferalhajim anovelconvlstmbasedunetforimprovedbraintumorsegmentation AT osamamajeedhilalalmiahi novelconvlstmbasedunetforimprovedbraintumorsegmentation AT alaataimaalbusalih novelconvlstmbasedunetforimprovedbraintumorsegmentation AT dhaferalhajim novelconvlstmbasedunetforimprovedbraintumorsegmentation |