Swin Transformer lightweight: an efficient strategy that combines weight sharing, distillation and pruning

Swin Transformer, as a layered visual transformer with shifted windows, has attracted extensive attention in the field of computer vision due to its exceptional modeling capabilities. However, its high computational complexity limits its applicability on devices with constrained computational resour...

Full description

Saved in:
Bibliographic Details
Main Authors: HAN Bo, ZHOU Shun, FAN Jianhua, WEI Xianglin, HU Yongyang, ZHU Yanping
Format: Article
Language:zho
Published: Beijing Xintong Media Co., Ltd 2024-09-01
Series:Dianxin kexue
Subjects:
Online Access:http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024209/
Tags: Add Tag
No Tags, Be the first to tag this record!