Image Generation and Lesion Segmentation of Brain Tumors and Stroke Based on GAN and 3D ResU-Net
In recent years, with the development of medical image analysis, the image processing of brain tumor and stroke has been deeply studied. However, when processing clinical medical imaging data with different characteristics or information collected from different sensors or modalities, that is, multi...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10487941/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849304304515547136 |
|---|---|
| author | Mingkang Sun Xiang Li Weiye Sun |
| author_facet | Mingkang Sun Xiang Li Weiye Sun |
| author_sort | Mingkang Sun |
| collection | DOAJ |
| description | In recent years, with the development of medical image analysis, the image processing of brain tumor and stroke has been deeply studied. However, when processing clinical medical imaging data with different characteristics or information collected from different sensors or modalities, that is, multi-modal imaging data, the segmentation accuracy is low. Therefore, the research is based on generative adversarial networks and three-dimensional residual U-shaped networks to study brain tumor and stroke image generation and lesion segmentation. Experimental results showed the three models performed best in various conversions. For example, in T1<inline-formula> <tex-math notation="LaTeX">$\to $ </tex-math></inline-formula> Flair conversion, the generative multi-modal image analysis model based on perceptual loop consistency had an average peak signal-to-noise ratio of <inline-formula> <tex-math notation="LaTeX">$23.951~\pm ~2.735$ </tex-math></inline-formula>, an average structural similarity of <inline-formula> <tex-math notation="LaTeX">$0.873~\pm ~0.046$ </tex-math></inline-formula>, and an average root mean square error of <inline-formula> <tex-math notation="LaTeX">$16.998~\pm ~6.184$ </tex-math></inline-formula>. All three models significantly raised the segmentation effectiveness of lesions, such as the combination of dual-scale perceptual loop generation adversarial network and three-dimensional residual U-shaped network for generative multi-modal image generation and lesion segmentation algorithm. Using three real input modalities, its HD index value of 75.082 and precision index value of 0.696 were better than the HD index value of 84.776 and precision index value of 0.686. In addition, the study also conducted ablation experiments on a generative multi-modal image analysis model based on dual-scale perceptual loop consistency, indicating that the cavity residual module is hoped to have a good influence on lesion segmentation. Overall, the algorithm model proposed in the study has high effectiveness in the generation and segmentation of brain tumors and stroke images, and is of great significance for the development of medicine. |
| format | Article |
| id | doaj-art-1e626992b51d4eabb63649977a1ac032 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-1e626992b51d4eabb63649977a1ac0322025-08-20T03:55:48ZengIEEEIEEE Access2169-35362025-01-011312562912564410.1109/ACCESS.2024.338388010487941Image Generation and Lesion Segmentation of Brain Tumors and Stroke Based on GAN and 3D ResU-NetMingkang Sun0https://orcid.org/0009-0000-4611-938XXiang Li1Weiye Sun2https://orcid.org/0009-0003-7074-3096Glasgow College, University of Electronic Science and Technology of China, Chengdu, ChinaSiemens Industrial Automation Products Ltd. Chengdu, Chengdu, ChinaThe First People’s Hospital of Lianyungang, Lianyungang, ChinaIn recent years, with the development of medical image analysis, the image processing of brain tumor and stroke has been deeply studied. However, when processing clinical medical imaging data with different characteristics or information collected from different sensors or modalities, that is, multi-modal imaging data, the segmentation accuracy is low. Therefore, the research is based on generative adversarial networks and three-dimensional residual U-shaped networks to study brain tumor and stroke image generation and lesion segmentation. Experimental results showed the three models performed best in various conversions. For example, in T1<inline-formula> <tex-math notation="LaTeX">$\to $ </tex-math></inline-formula> Flair conversion, the generative multi-modal image analysis model based on perceptual loop consistency had an average peak signal-to-noise ratio of <inline-formula> <tex-math notation="LaTeX">$23.951~\pm ~2.735$ </tex-math></inline-formula>, an average structural similarity of <inline-formula> <tex-math notation="LaTeX">$0.873~\pm ~0.046$ </tex-math></inline-formula>, and an average root mean square error of <inline-formula> <tex-math notation="LaTeX">$16.998~\pm ~6.184$ </tex-math></inline-formula>. All three models significantly raised the segmentation effectiveness of lesions, such as the combination of dual-scale perceptual loop generation adversarial network and three-dimensional residual U-shaped network for generative multi-modal image generation and lesion segmentation algorithm. Using three real input modalities, its HD index value of 75.082 and precision index value of 0.696 were better than the HD index value of 84.776 and precision index value of 0.686. In addition, the study also conducted ablation experiments on a generative multi-modal image analysis model based on dual-scale perceptual loop consistency, indicating that the cavity residual module is hoped to have a good influence on lesion segmentation. Overall, the algorithm model proposed in the study has high effectiveness in the generation and segmentation of brain tumors and stroke images, and is of great significance for the development of medicine.https://ieeexplore.ieee.org/document/10487941/Brain tumorsstrokegenerate adversarial networks3D ResU-Netimage generationlesion segmentation |
| spellingShingle | Mingkang Sun Xiang Li Weiye Sun Image Generation and Lesion Segmentation of Brain Tumors and Stroke Based on GAN and 3D ResU-Net IEEE Access Brain tumors stroke generate adversarial networks 3D ResU-Net image generation lesion segmentation |
| title | Image Generation and Lesion Segmentation of Brain Tumors and Stroke Based on GAN and 3D ResU-Net |
| title_full | Image Generation and Lesion Segmentation of Brain Tumors and Stroke Based on GAN and 3D ResU-Net |
| title_fullStr | Image Generation and Lesion Segmentation of Brain Tumors and Stroke Based on GAN and 3D ResU-Net |
| title_full_unstemmed | Image Generation and Lesion Segmentation of Brain Tumors and Stroke Based on GAN and 3D ResU-Net |
| title_short | Image Generation and Lesion Segmentation of Brain Tumors and Stroke Based on GAN and 3D ResU-Net |
| title_sort | image generation and lesion segmentation of brain tumors and stroke based on gan and 3d resu net |
| topic | Brain tumors stroke generate adversarial networks 3D ResU-Net image generation lesion segmentation |
| url | https://ieeexplore.ieee.org/document/10487941/ |
| work_keys_str_mv | AT mingkangsun imagegenerationandlesionsegmentationofbraintumorsandstrokebasedonganand3dresunet AT xiangli imagegenerationandlesionsegmentationofbraintumorsandstrokebasedonganand3dresunet AT weiyesun imagegenerationandlesionsegmentationofbraintumorsandstrokebasedonganand3dresunet |