Cross-View Multi-Scale Re-Identification Network in the Perspective of Ground Rotorcraft Unmanned Aerial Vehicle
Traditional Re-Identification (Re-ID) schemes often rely on multiple cameras from the same perspective to search for targets. However, the collaboration between fixed cameras and unmanned aerial vehicles (UAVs) is gradually becoming a new trend in the surveillance field. Facing the significant persp...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-11-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/12/23/3739 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846124153400197120 |
|---|---|
| author | Wenji Yin Yueping Peng Hexiang Hao Baixuan Han Zecong Ye Wenchao Liu |
| author_facet | Wenji Yin Yueping Peng Hexiang Hao Baixuan Han Zecong Ye Wenchao Liu |
| author_sort | Wenji Yin |
| collection | DOAJ |
| description | Traditional Re-Identification (Re-ID) schemes often rely on multiple cameras from the same perspective to search for targets. However, the collaboration between fixed cameras and unmanned aerial vehicles (UAVs) is gradually becoming a new trend in the surveillance field. Facing the significant perspective differences between fixed cameras and UAV cameras, the task of Re-ID is facing unprecedented challenges. In the setting of a single perspective, although significant advancements have been made in person Re-ID models, their performance markedly deteriorates when confronted with drastic viewpoint changes, such as transitions from aerial to ground-level perspectives. This degradation in performance is primarily attributed to the stark variations between viewpoints and the significant differences in subject posture and background across various perspectives. Existing methods focusing on learning local features have proven to be suboptimal in cross-perspective Re-ID tasks. The reason lies in the perspective distortion caused by the top-down viewpoint of drones, and the richer and more detailed texture information observed from a ground-level perspective, which leads to notable discrepancies in local features. To address this issue, the present study introduces a Multi-scale Across View Model (MAVM) that extracts features at various scales to generate a richer and more robust feature representation. Furthermore, we incorporate a Cross-View Alignment Module (AVAM) that fine-tunes the attention weights, optimizing the model’s response to critical areas such as the silhouette, attire textures, and other key features. This enhancement ensures high recognition accuracy even when subjects change posture and lighting conditions. Extensive experiments conducted on the public dataset AG-ReID have demonstrated the superiority of our proposed method, which significantly outperforms existing state-of-the-art techniques. |
| format | Article |
| id | doaj-art-a3889cd1f7674f69918911f39cd932dd |
| institution | Kabale University |
| issn | 2227-7390 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj-art-a3889cd1f7674f69918911f39cd932dd2024-12-13T16:27:36ZengMDPI AGMathematics2227-73902024-11-011223373910.3390/math12233739Cross-View Multi-Scale Re-Identification Network in the Perspective of Ground Rotorcraft Unmanned Aerial VehicleWenji Yin0Yueping Peng1Hexiang Hao2Baixuan Han3Zecong Ye4Wenchao Liu5PAP Engineering University, Xi’an 710086, ChinaPAP Engineering University, Xi’an 710086, ChinaPAP Engineering University, Xi’an 710086, ChinaPAP Engineering University, Xi’an 710086, ChinaPAP Engineering University, Xi’an 710086, ChinaPAP Engineering University, Xi’an 710086, ChinaTraditional Re-Identification (Re-ID) schemes often rely on multiple cameras from the same perspective to search for targets. However, the collaboration between fixed cameras and unmanned aerial vehicles (UAVs) is gradually becoming a new trend in the surveillance field. Facing the significant perspective differences between fixed cameras and UAV cameras, the task of Re-ID is facing unprecedented challenges. In the setting of a single perspective, although significant advancements have been made in person Re-ID models, their performance markedly deteriorates when confronted with drastic viewpoint changes, such as transitions from aerial to ground-level perspectives. This degradation in performance is primarily attributed to the stark variations between viewpoints and the significant differences in subject posture and background across various perspectives. Existing methods focusing on learning local features have proven to be suboptimal in cross-perspective Re-ID tasks. The reason lies in the perspective distortion caused by the top-down viewpoint of drones, and the richer and more detailed texture information observed from a ground-level perspective, which leads to notable discrepancies in local features. To address this issue, the present study introduces a Multi-scale Across View Model (MAVM) that extracts features at various scales to generate a richer and more robust feature representation. Furthermore, we incorporate a Cross-View Alignment Module (AVAM) that fine-tunes the attention weights, optimizing the model’s response to critical areas such as the silhouette, attire textures, and other key features. This enhancement ensures high recognition accuracy even when subjects change posture and lighting conditions. Extensive experiments conducted on the public dataset AG-ReID have demonstrated the superiority of our proposed method, which significantly outperforms existing state-of-the-art techniques.https://www.mdpi.com/2227-7390/12/23/3739re-identificationAcross Viewsmulti-scale network |
| spellingShingle | Wenji Yin Yueping Peng Hexiang Hao Baixuan Han Zecong Ye Wenchao Liu Cross-View Multi-Scale Re-Identification Network in the Perspective of Ground Rotorcraft Unmanned Aerial Vehicle Mathematics re-identification Across Views multi-scale network |
| title | Cross-View Multi-Scale Re-Identification Network in the Perspective of Ground Rotorcraft Unmanned Aerial Vehicle |
| title_full | Cross-View Multi-Scale Re-Identification Network in the Perspective of Ground Rotorcraft Unmanned Aerial Vehicle |
| title_fullStr | Cross-View Multi-Scale Re-Identification Network in the Perspective of Ground Rotorcraft Unmanned Aerial Vehicle |
| title_full_unstemmed | Cross-View Multi-Scale Re-Identification Network in the Perspective of Ground Rotorcraft Unmanned Aerial Vehicle |
| title_short | Cross-View Multi-Scale Re-Identification Network in the Perspective of Ground Rotorcraft Unmanned Aerial Vehicle |
| title_sort | cross view multi scale re identification network in the perspective of ground rotorcraft unmanned aerial vehicle |
| topic | re-identification Across Views multi-scale network |
| url | https://www.mdpi.com/2227-7390/12/23/3739 |
| work_keys_str_mv | AT wenjiyin crossviewmultiscalereidentificationnetworkintheperspectiveofgroundrotorcraftunmannedaerialvehicle AT yuepingpeng crossviewmultiscalereidentificationnetworkintheperspectiveofgroundrotorcraftunmannedaerialvehicle AT hexianghao crossviewmultiscalereidentificationnetworkintheperspectiveofgroundrotorcraftunmannedaerialvehicle AT baixuanhan crossviewmultiscalereidentificationnetworkintheperspectiveofgroundrotorcraftunmannedaerialvehicle AT zecongye crossviewmultiscalereidentificationnetworkintheperspectiveofgroundrotorcraftunmannedaerialvehicle AT wenchaoliu crossviewmultiscalereidentificationnetworkintheperspectiveofgroundrotorcraftunmannedaerialvehicle |