Research on 2D/3D multimodal medical image registration algorithm
2D/3D multimodal alignment plays an important role in medical image navigation surgery, which is mainly used to provide real-time information of preoperative 3D images and intraoperative 2D images to help doctors accurately locate the lesions and plan the surgical paths, so as to improve the safety...
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Beijing Xintong Media Co., Ltd
2024-03-01
|
| Series: | Dianxin kexue |
| Subjects: | |
| Online Access: | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024070/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841533946146324480 |
|---|---|
| author | XU Mi ZHUGE Bin YUAN Feiniu YIN Zhenghu DONG Ligang JIANG Xian SUN Yingqi SONG Jiaqi SHI Xiaotong SU Lei ZHOU Yibo LIN Shifan |
| author_facet | XU Mi ZHUGE Bin YUAN Feiniu YIN Zhenghu DONG Ligang JIANG Xian SUN Yingqi SONG Jiaqi SHI Xiaotong SU Lei ZHOU Yibo LIN Shifan |
| author_sort | XU Mi |
| collection | DOAJ |
| description | 2D/3D multimodal alignment plays an important role in medical image navigation surgery, which is mainly used to provide real-time information of preoperative 3D images and intraoperative 2D images to help doctors accurately locate the lesions and plan the surgical paths, so as to improve the safety and efficiency of surgery. A 2D/3D multimodal medical image alignment algorithm was proposed, which firstly utilized the excellent feature extraction capability of Swin Transformer to construct an initial pose estimation model to realize the fast prediction of pose parameters. Then, in order to improve the robustness of the whole alignment method, a coarse alignment method based on the Grangeat relation was introduced. Finally,a fine alignment module based on gradient descent was designed. A fine alignment module based on gradient descent was designed to improve the accuracy of the whole alignment process, and the Sobel differential operator was combined with normalized correlation in this module to improve the sensitivity of the parameter optimization process. The experimental results show that the proposed alignment method meets the alignment requirements in the orthogonal and lateral alignment errors, and the alignment success rate is significantly improved. |
| format | Article |
| id | doaj-art-f1e9ee51a439438ba138c2ec7628e871 |
| institution | Kabale University |
| issn | 1000-0801 |
| language | zho |
| publishDate | 2024-03-01 |
| publisher | Beijing Xintong Media Co., Ltd |
| record_format | Article |
| series | Dianxin kexue |
| spelling | doaj-art-f1e9ee51a439438ba138c2ec7628e8712025-01-15T02:48:19ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012024-03-0140758855075181Research on 2D/3D multimodal medical image registration algorithmXU MiZHUGE BinYUAN FeiniuYIN ZhenghuDONG LigangJIANG XianSUN YingqiSONG JiaqiSHI XiaotongSU LeiZHOU YiboLIN Shifan2D/3D multimodal alignment plays an important role in medical image navigation surgery, which is mainly used to provide real-time information of preoperative 3D images and intraoperative 2D images to help doctors accurately locate the lesions and plan the surgical paths, so as to improve the safety and efficiency of surgery. A 2D/3D multimodal medical image alignment algorithm was proposed, which firstly utilized the excellent feature extraction capability of Swin Transformer to construct an initial pose estimation model to realize the fast prediction of pose parameters. Then, in order to improve the robustness of the whole alignment method, a coarse alignment method based on the Grangeat relation was introduced. Finally,a fine alignment module based on gradient descent was designed. A fine alignment module based on gradient descent was designed to improve the accuracy of the whole alignment process, and the Sobel differential operator was combined with normalized correlation in this module to improve the sensitivity of the parameter optimization process. The experimental results show that the proposed alignment method meets the alignment requirements in the orthogonal and lateral alignment errors, and the alignment success rate is significantly improved.http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024070/2D/3D image registrationmultimodalityinitial pose estimationcoarse registrationfine registrationsimilarity measurement |
| spellingShingle | XU Mi ZHUGE Bin YUAN Feiniu YIN Zhenghu DONG Ligang JIANG Xian SUN Yingqi SONG Jiaqi SHI Xiaotong SU Lei ZHOU Yibo LIN Shifan Research on 2D/3D multimodal medical image registration algorithm Dianxin kexue 2D/3D image registration multimodality initial pose estimation coarse registration fine registration similarity measurement |
| title | Research on 2D/3D multimodal medical image registration algorithm |
| title_full | Research on 2D/3D multimodal medical image registration algorithm |
| title_fullStr | Research on 2D/3D multimodal medical image registration algorithm |
| title_full_unstemmed | Research on 2D/3D multimodal medical image registration algorithm |
| title_short | Research on 2D/3D multimodal medical image registration algorithm |
| title_sort | research on 2d 3d multimodal medical image registration algorithm |
| topic | 2D/3D image registration multimodality initial pose estimation coarse registration fine registration similarity measurement |
| url | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024070/ |
| work_keys_str_mv | AT xumi researchon2d3dmultimodalmedicalimageregistrationalgorithm AT zhugebin researchon2d3dmultimodalmedicalimageregistrationalgorithm AT yuanfeiniu researchon2d3dmultimodalmedicalimageregistrationalgorithm AT yinzhenghu researchon2d3dmultimodalmedicalimageregistrationalgorithm AT dongligang researchon2d3dmultimodalmedicalimageregistrationalgorithm AT jiangxian researchon2d3dmultimodalmedicalimageregistrationalgorithm AT sunyingqi researchon2d3dmultimodalmedicalimageregistrationalgorithm AT songjiaqi researchon2d3dmultimodalmedicalimageregistrationalgorithm AT shixiaotong researchon2d3dmultimodalmedicalimageregistrationalgorithm AT sulei researchon2d3dmultimodalmedicalimageregistrationalgorithm AT zhouyibo researchon2d3dmultimodalmedicalimageregistrationalgorithm AT linshifan researchon2d3dmultimodalmedicalimageregistrationalgorithm |