Joint image restoration for object detection in snowy weather
Abstract Although existing object detectors achieve encouraging performance of object detection and localisation under real ideal conditions, the detection performance in adverse weather conditions (snowy) is very poor and not enough to cope with the detection task in adverse weather conditions. Exi...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-09-01
|
| Series: | IET Computer Vision |
| Subjects: | |
| Online Access: | https://doi.org/10.1049/cvi2.12274 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846164015345041408 |
|---|---|
| author | Jing Wang Meimei Xu Huazhu Xue Zhanqiang Huo Fen Luo |
| author_facet | Jing Wang Meimei Xu Huazhu Xue Zhanqiang Huo Fen Luo |
| author_sort | Jing Wang |
| collection | DOAJ |
| description | Abstract Although existing object detectors achieve encouraging performance of object detection and localisation under real ideal conditions, the detection performance in adverse weather conditions (snowy) is very poor and not enough to cope with the detection task in adverse weather conditions. Existing methods do not deal well with the effect of snow on the identity of object features or usually ignore or even discard potential information that can help improve the detection performance. To this end, the authors propose a novel and improved end‐to‐end object detection network joint image restoration. Specifically, in order to address the problem of identity degradation of object detection due to snow, an ingenious restoration‐detection dual branch network structure combined with a Multi‐Integrated Attention module is proposed, which can well mitigate the effect of snow on the identity of object features, thus improving the detection performance of the detector. In order to make more effective use of the features that are beneficial to the detection task, a Self‐Adaptive Feature Fusion module is introduced, which can help the network better learn the potential features that are beneficial to the detection and eliminate the effect of heavy or large local snow in the object area on detection by a special feature fusion, thus improving the network's detection capability in snowy. In addition, the authors construct a large‐scale, multi‐size snowy dataset called Synthetic and Real Snowy Dataset (SRSD), and it is a good and necessary complement and improvement to the existing snowy‐related tasks. Extensive experiments on a public snowy dataset (Snowy‐weather Datasets) and SRSD indicate that our method outperforms the existing state‐of‐the‐art object detectors. |
| format | Article |
| id | doaj-art-d16a1a8cf2214af9bc90cb8e6a7744b3 |
| institution | Kabale University |
| issn | 1751-9632 1751-9640 |
| language | English |
| publishDate | 2024-09-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Computer Vision |
| spelling | doaj-art-d16a1a8cf2214af9bc90cb8e6a7744b32024-11-18T16:52:09ZengWileyIET Computer Vision1751-96321751-96402024-09-0118675977110.1049/cvi2.12274Joint image restoration for object detection in snowy weatherJing Wang0Meimei Xu1Huazhu Xue2Zhanqiang Huo3Fen Luo4School of Software Henan Polytechnic University Jiaozuo ChinaSchool of Software Henan Polytechnic University Jiaozuo ChinaSchool of Surveying and Land Information Engineering Henan Polytechnic University Jiaozuo ChinaSchool of Software Henan Polytechnic University Jiaozuo ChinaSchool of Software Henan Polytechnic University Jiaozuo ChinaAbstract Although existing object detectors achieve encouraging performance of object detection and localisation under real ideal conditions, the detection performance in adverse weather conditions (snowy) is very poor and not enough to cope with the detection task in adverse weather conditions. Existing methods do not deal well with the effect of snow on the identity of object features or usually ignore or even discard potential information that can help improve the detection performance. To this end, the authors propose a novel and improved end‐to‐end object detection network joint image restoration. Specifically, in order to address the problem of identity degradation of object detection due to snow, an ingenious restoration‐detection dual branch network structure combined with a Multi‐Integrated Attention module is proposed, which can well mitigate the effect of snow on the identity of object features, thus improving the detection performance of the detector. In order to make more effective use of the features that are beneficial to the detection task, a Self‐Adaptive Feature Fusion module is introduced, which can help the network better learn the potential features that are beneficial to the detection and eliminate the effect of heavy or large local snow in the object area on detection by a special feature fusion, thus improving the network's detection capability in snowy. In addition, the authors construct a large‐scale, multi‐size snowy dataset called Synthetic and Real Snowy Dataset (SRSD), and it is a good and necessary complement and improvement to the existing snowy‐related tasks. Extensive experiments on a public snowy dataset (Snowy‐weather Datasets) and SRSD indicate that our method outperforms the existing state‐of‐the‐art object detectors.https://doi.org/10.1049/cvi2.12274image restorationobject detection |
| spellingShingle | Jing Wang Meimei Xu Huazhu Xue Zhanqiang Huo Fen Luo Joint image restoration for object detection in snowy weather IET Computer Vision image restoration object detection |
| title | Joint image restoration for object detection in snowy weather |
| title_full | Joint image restoration for object detection in snowy weather |
| title_fullStr | Joint image restoration for object detection in snowy weather |
| title_full_unstemmed | Joint image restoration for object detection in snowy weather |
| title_short | Joint image restoration for object detection in snowy weather |
| title_sort | joint image restoration for object detection in snowy weather |
| topic | image restoration object detection |
| url | https://doi.org/10.1049/cvi2.12274 |
| work_keys_str_mv | AT jingwang jointimagerestorationforobjectdetectioninsnowyweather AT meimeixu jointimagerestorationforobjectdetectioninsnowyweather AT huazhuxue jointimagerestorationforobjectdetectioninsnowyweather AT zhanqianghuo jointimagerestorationforobjectdetectioninsnowyweather AT fenluo jointimagerestorationforobjectdetectioninsnowyweather |