VP-SFDA: Visual Prompt Source-Free Domain Adaptation for Cross-Modal Medical Image
Background: Source-free unsupervised domain adaptation (SFUDA) methods aim to address the challenge of domain shift while preserving data privacy. Existing SFUDA approaches construct reliable and confident pseudo-labels for target-domain data through denoising methods, thereby guiding the training o...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Association for the Advancement of Science (AAAS)
2025-01-01
|
| Series: | Health Data Science |
| Online Access: | https://spj.science.org/doi/10.34133/hds.0143 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841526486858727424 |
|---|---|
| author | Yixin Chen Yan Wang Zhaoheng Xie |
| author_facet | Yixin Chen Yan Wang Zhaoheng Xie |
| author_sort | Yixin Chen |
| collection | DOAJ |
| description | Background: Source-free unsupervised domain adaptation (SFUDA) methods aim to address the challenge of domain shift while preserving data privacy. Existing SFUDA approaches construct reliable and confident pseudo-labels for target-domain data through denoising methods, thereby guiding the training of the target-domain model. The effectiveness of denoising approaches is influenced by the degree of domain gap between the source and target domains. A marked shift can cause the pseudo-labels to be unreliable, even after applying denoising. Methods: We propose a novel 2-stage framework for SFUDA called visual prompt source-free domain adaptation (VP-SFDA). We propose input-specific visual prompt in the first stage, prompting process, which bridges the target-domain data to source-domain distribution. Our method utilizes visual prompts and batch normalization constraint to enable the alignment model to learn domain-specific knowledge and align the target-domain data with the source-domain contribution. The second stage is the adaptation process, which aims at optimizing the segmentation model from the source domain to the target domain. This is accomplished through the denoising techniques, ultimately enhancing the performance. Results: Our study presents a comparative analysis of several SFUDA techniques in the VP-SFDA framework across 4 tasks: abdominal magnetic resonance imaging (MRI) to computed tomography (CT), abdominal CT to MRI, cardiac MRI to CT, and cardiac CT to MRI. Notably, in the abdominal MRI to CT adaptation task, the VP-OS method achieved a remarkable improvement, increasing the average DICE score from 0.658 to 0.773 (P [Formula: see text] 0.01) and reducing the average surface distance (ASD) from 3.489 to 2.961 (P [Formula: see text] 0.01). Similarly, the VP-LD and VP-DPL methods also showed significant improvements over their base algorithms in both abdominal and cardiac MRI to CT tasks. Conclusions: This paper proposes VP-SFDA, a novel 2-stage framework for SFUDA in medical imaging, which achieves superior performance through input-specific visual prompts and batch normalization constraint for domain adaptation, coupled with denoising methods for enhanced results. Comparative experiments on 4 medical SFUDA tasks demonstrate that VO-SFDA surpasses existing methods, with ablation studies confirming the benefits of domain-specific patterns. |
| format | Article |
| id | doaj-art-3e5ce6a8a67d4f2e872d1dedb7d77cc6 |
| institution | Kabale University |
| issn | 2765-8783 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | American Association for the Advancement of Science (AAAS) |
| record_format | Article |
| series | Health Data Science |
| spelling | doaj-art-3e5ce6a8a67d4f2e872d1dedb7d77cc62025-01-16T19:42:27ZengAmerican Association for the Advancement of Science (AAAS)Health Data Science2765-87832025-01-01510.34133/hds.0143VP-SFDA: Visual Prompt Source-Free Domain Adaptation for Cross-Modal Medical ImageYixin Chen0Yan Wang1Zhaoheng Xie2Institute of Medical Technology and National Biomedical Imaging Center, Peking University, Beijing 100191, China.School of Instrumentation and Optoelectronic Engineering, and State Key Laboratory of Software Development Environment, Beihang University, Beijing 100191, China.Institute of Medical Technology and National Biomedical Imaging Center, Peking University, Beijing 100191, China.Background: Source-free unsupervised domain adaptation (SFUDA) methods aim to address the challenge of domain shift while preserving data privacy. Existing SFUDA approaches construct reliable and confident pseudo-labels for target-domain data through denoising methods, thereby guiding the training of the target-domain model. The effectiveness of denoising approaches is influenced by the degree of domain gap between the source and target domains. A marked shift can cause the pseudo-labels to be unreliable, even after applying denoising. Methods: We propose a novel 2-stage framework for SFUDA called visual prompt source-free domain adaptation (VP-SFDA). We propose input-specific visual prompt in the first stage, prompting process, which bridges the target-domain data to source-domain distribution. Our method utilizes visual prompts and batch normalization constraint to enable the alignment model to learn domain-specific knowledge and align the target-domain data with the source-domain contribution. The second stage is the adaptation process, which aims at optimizing the segmentation model from the source domain to the target domain. This is accomplished through the denoising techniques, ultimately enhancing the performance. Results: Our study presents a comparative analysis of several SFUDA techniques in the VP-SFDA framework across 4 tasks: abdominal magnetic resonance imaging (MRI) to computed tomography (CT), abdominal CT to MRI, cardiac MRI to CT, and cardiac CT to MRI. Notably, in the abdominal MRI to CT adaptation task, the VP-OS method achieved a remarkable improvement, increasing the average DICE score from 0.658 to 0.773 (P [Formula: see text] 0.01) and reducing the average surface distance (ASD) from 3.489 to 2.961 (P [Formula: see text] 0.01). Similarly, the VP-LD and VP-DPL methods also showed significant improvements over their base algorithms in both abdominal and cardiac MRI to CT tasks. Conclusions: This paper proposes VP-SFDA, a novel 2-stage framework for SFUDA in medical imaging, which achieves superior performance through input-specific visual prompts and batch normalization constraint for domain adaptation, coupled with denoising methods for enhanced results. Comparative experiments on 4 medical SFUDA tasks demonstrate that VO-SFDA surpasses existing methods, with ablation studies confirming the benefits of domain-specific patterns.https://spj.science.org/doi/10.34133/hds.0143 |
| spellingShingle | Yixin Chen Yan Wang Zhaoheng Xie VP-SFDA: Visual Prompt Source-Free Domain Adaptation for Cross-Modal Medical Image Health Data Science |
| title | VP-SFDA: Visual Prompt Source-Free Domain Adaptation for Cross-Modal Medical Image |
| title_full | VP-SFDA: Visual Prompt Source-Free Domain Adaptation for Cross-Modal Medical Image |
| title_fullStr | VP-SFDA: Visual Prompt Source-Free Domain Adaptation for Cross-Modal Medical Image |
| title_full_unstemmed | VP-SFDA: Visual Prompt Source-Free Domain Adaptation for Cross-Modal Medical Image |
| title_short | VP-SFDA: Visual Prompt Source-Free Domain Adaptation for Cross-Modal Medical Image |
| title_sort | vp sfda visual prompt source free domain adaptation for cross modal medical image |
| url | https://spj.science.org/doi/10.34133/hds.0143 |
| work_keys_str_mv | AT yixinchen vpsfdavisualpromptsourcefreedomainadaptationforcrossmodalmedicalimage AT yanwang vpsfdavisualpromptsourcefreedomainadaptationforcrossmodalmedicalimage AT zhaohengxie vpsfdavisualpromptsourcefreedomainadaptationforcrossmodalmedicalimage |