Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object Detection
Unsupervised Domain Adaptation for Object Detection (UDA-OD) aims to adapt a model trained on a labeled source domain to an unlabeled target domain, addressing challenges posed by domain shifts. However, existing methods often face significant challenges, particularly in detecting small objects and...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/25/1/230 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841548937883811840 |
|---|---|
| author | Lunfeng Guo Yizhe Zhang Jiayin Liu Huajie Liu Yunwang Li |
| author_facet | Lunfeng Guo Yizhe Zhang Jiayin Liu Huajie Liu Yunwang Li |
| author_sort | Lunfeng Guo |
| collection | DOAJ |
| description | Unsupervised Domain Adaptation for Object Detection (UDA-OD) aims to adapt a model trained on a labeled source domain to an unlabeled target domain, addressing challenges posed by domain shifts. However, existing methods often face significant challenges, particularly in detecting small objects and over-relying on classification confidence for pseudo-label selection, which often leads to inaccurate bounding box localization. To address these issues, we propose a novel UDA-OD framework that leverages scale consistency (SC) and Temporal Ensemble Pseudo-Label Selection (TEPLS) to enhance cross-domain robustness and detection performance. Specifically, we introduce Cross-Scale Prediction Consistency (CSPC) to enforce consistent detection across multiple resolutions, improving detection robustness for objects of varying scales. Additionally, we integrate Intra-Class Feature Consistency (ICFC), which employs contrastive learning to align feature representations within each class, further enhancing adaptation. To ensure high-quality pseudo-labels, TEPLS combines temporal localization stability with classification confidence, mitigating the impact of noisy predictions and improving both classification and localization accuracy. Extensive experiments on challenging benchmarks, including Cityscapes to Foggy Cityscapes, Sim10k to Cityscapes, and Virtual Mine to Actual Mine, demonstrate that our method achieves state-of-the-art performance, with notable improvements in small object detection and overall cross-domain robustness. These results highlight the effectiveness of our framework in addressing key limitations of existing UDA-OD approaches. |
| format | Article |
| id | doaj-art-9d9bb3b4a5724a7bbcab44998b6c0447 |
| institution | Kabale University |
| issn | 1424-8220 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj-art-9d9bb3b4a5724a7bbcab44998b6c04472025-01-10T13:21:18ZengMDPI AGSensors1424-82202025-01-0125123010.3390/s25010230Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object DetectionLunfeng Guo0Yizhe Zhang1Jiayin Liu2Huajie Liu3Yunwang Li4School of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaSchool of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaSchool of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaSuzhou Automotive Research Institute (Wujiang), Tsinghua University, Suzhou 215200, ChinaSchool of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaUnsupervised Domain Adaptation for Object Detection (UDA-OD) aims to adapt a model trained on a labeled source domain to an unlabeled target domain, addressing challenges posed by domain shifts. However, existing methods often face significant challenges, particularly in detecting small objects and over-relying on classification confidence for pseudo-label selection, which often leads to inaccurate bounding box localization. To address these issues, we propose a novel UDA-OD framework that leverages scale consistency (SC) and Temporal Ensemble Pseudo-Label Selection (TEPLS) to enhance cross-domain robustness and detection performance. Specifically, we introduce Cross-Scale Prediction Consistency (CSPC) to enforce consistent detection across multiple resolutions, improving detection robustness for objects of varying scales. Additionally, we integrate Intra-Class Feature Consistency (ICFC), which employs contrastive learning to align feature representations within each class, further enhancing adaptation. To ensure high-quality pseudo-labels, TEPLS combines temporal localization stability with classification confidence, mitigating the impact of noisy predictions and improving both classification and localization accuracy. Extensive experiments on challenging benchmarks, including Cityscapes to Foggy Cityscapes, Sim10k to Cityscapes, and Virtual Mine to Actual Mine, demonstrate that our method achieves state-of-the-art performance, with notable improvements in small object detection and overall cross-domain robustness. These results highlight the effectiveness of our framework in addressing key limitations of existing UDA-OD approaches.https://www.mdpi.com/1424-8220/25/1/230object detectionautonomous drivingunsupervised domain adaption |
| spellingShingle | Lunfeng Guo Yizhe Zhang Jiayin Liu Huajie Liu Yunwang Li Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object Detection Sensors object detection autonomous driving unsupervised domain adaption |
| title | Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object Detection |
| title_full | Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object Detection |
| title_fullStr | Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object Detection |
| title_full_unstemmed | Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object Detection |
| title_short | Scale-Consistent and Temporally Ensembled Unsupervised Domain Adaptation for Object Detection |
| title_sort | scale consistent and temporally ensembled unsupervised domain adaptation for object detection |
| topic | object detection autonomous driving unsupervised domain adaption |
| url | https://www.mdpi.com/1424-8220/25/1/230 |
| work_keys_str_mv | AT lunfengguo scaleconsistentandtemporallyensembledunsuperviseddomainadaptationforobjectdetection AT yizhezhang scaleconsistentandtemporallyensembledunsuperviseddomainadaptationforobjectdetection AT jiayinliu scaleconsistentandtemporallyensembledunsuperviseddomainadaptationforobjectdetection AT huajieliu scaleconsistentandtemporallyensembledunsuperviseddomainadaptationforobjectdetection AT yunwangli scaleconsistentandtemporallyensembledunsuperviseddomainadaptationforobjectdetection |