Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning
This study mainly addresses the issues of an excessive model parameter count and computational complexity in Detection Transformer (DETR) for remote sensing object detection and similar neural networks. We propose an innovative neural network pruning method called “ant colony evolutionary pruning (A...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-12-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/15/1/200 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841549422840774656 |
|---|---|
| author | Hailin Su Haijiang Sun Yongxian Zhao |
| author_facet | Hailin Su Haijiang Sun Yongxian Zhao |
| author_sort | Hailin Su |
| collection | DOAJ |
| description | This study mainly addresses the issues of an excessive model parameter count and computational complexity in Detection Transformer (DETR) for remote sensing object detection and similar neural networks. We propose an innovative neural network pruning method called “ant colony evolutionary pruning (ACEP)” which reduces the number of parameters in the neural network to improve the performance and efficiency of DETR-based neural networks in the remote sensing field. To retain the original network’s performance as much as possible, we combine population evolution and ant colony algorithms for dynamic search processes to automatically find efficient sparse sub-networks. Additionally, we design three different sparse operators based on the structural characteristics of DETR-like neural networks. Furthermore, considering the characteristics of remote sensing objects, we introduce sparsity constraints to each network layer to achieve efficient network pruning. The experimental results demonstrate that ACEP is effective on various DETR-like models. After removing a significant number of redundant parameters, it greatly improves the inference speed of these networks when performing remote sensing object detection tasks. |
| format | Article |
| id | doaj-art-06a7a24a8d0b407a91b76e6d5451945e |
| institution | Kabale University |
| issn | 2076-3417 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-06a7a24a8d0b407a91b76e6d5451945e2025-01-10T13:14:46ZengMDPI AGApplied Sciences2076-34172024-12-0115120010.3390/app15010200Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary PruningHailin Su0Haijiang Sun1Yongxian Zhao2Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaThis study mainly addresses the issues of an excessive model parameter count and computational complexity in Detection Transformer (DETR) for remote sensing object detection and similar neural networks. We propose an innovative neural network pruning method called “ant colony evolutionary pruning (ACEP)” which reduces the number of parameters in the neural network to improve the performance and efficiency of DETR-based neural networks in the remote sensing field. To retain the original network’s performance as much as possible, we combine population evolution and ant colony algorithms for dynamic search processes to automatically find efficient sparse sub-networks. Additionally, we design three different sparse operators based on the structural characteristics of DETR-like neural networks. Furthermore, considering the characteristics of remote sensing objects, we introduce sparsity constraints to each network layer to achieve efficient network pruning. The experimental results demonstrate that ACEP is effective on various DETR-like models. After removing a significant number of redundant parameters, it greatly improves the inference speed of these networks when performing remote sensing object detection tasks.https://www.mdpi.com/2076-3417/15/1/200structured pruningdetection transformerremote sensingobject detectiondeep convolutional neural networktransformer |
| spellingShingle | Hailin Su Haijiang Sun Yongxian Zhao Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning Applied Sciences structured pruning detection transformer remote sensing object detection deep convolutional neural network transformer |
| title | Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning |
| title_full | Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning |
| title_fullStr | Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning |
| title_full_unstemmed | Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning |
| title_short | Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning |
| title_sort | efficient pruning of detection transformer in remote sensing using ant colony evolutionary pruning |
| topic | structured pruning detection transformer remote sensing object detection deep convolutional neural network transformer |
| url | https://www.mdpi.com/2076-3417/15/1/200 |
| work_keys_str_mv | AT hailinsu efficientpruningofdetectiontransformerinremotesensingusingantcolonyevolutionarypruning AT haijiangsun efficientpruningofdetectiontransformerinremotesensingusingantcolonyevolutionarypruning AT yongxianzhao efficientpruningofdetectiontransformerinremotesensingusingantcolonyevolutionarypruning |