Swin Transformer lightweight: an efficient strategy that combines weight sharing, distillation and pruning
Swin Transformer, as a layered visual transformer with shifted windows, has attracted extensive attention in the field of computer vision due to its exceptional modeling capabilities. However, its high computational complexity limits its applicability on devices with constrained computational resour...
Saved in:
Main Authors: | HAN Bo, ZHOU Shun, FAN Jianhua, WEI Xianglin, HU Yongyang, ZHU Yanping |
---|---|
Format: | Article |
Language: | zho |
Published: |
Beijing Xintong Media Co., Ltd
2024-09-01
|
Series: | Dianxin kexue |
Subjects: | |
Online Access: | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024209/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
-
Lightweight defense mechanism against adversarial attacks via adaptive pruning and robust distillation
by: Bin WANG, et al.
Published: (2022-12-01) -
Research on temperature detection method of liquor distilling pot feeding operation based on a compressed algorithm
by: Xiaolian LIU, et al.
Published: (2024-06-01) -
ILN-YOLOv8: A Lightweight Image Recognition Model for Crimped Wire Connectors
by: Xiaojian Zhou, et al.
Published: (2025-01-01) -
Assessment-Based Optimization of Distillation Parameters
by: Ludmila N. Krikunova, et al.
Published: (2023-06-01) -
Lightweight and secure search scheme for medical data sharing
by: XIE Qingqing, et al.
Published: (2024-11-01)