Light weighted privacy protection ViT inference framework based on secret sharing
The ViT (vision transformer) inference framework, which was widely used in image processing, was found to have a risk of leaking user privacy data. However, existing privacy protection inference frameworks had problems such as low computational efficiency and high online communication volume. To add...
Saved in:
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | zho |
Published: |
Editorial Department of Journal on Communications
2024-04-01
|
Series: | Tongxin xuebao |
Subjects: | |
Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024025/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1841539174720602112 |
---|---|
author | MA Min FU Yu HUANG Kai JIA Xiaofeng |
author_facet | MA Min FU Yu HUANG Kai JIA Xiaofeng |
author_sort | MA Min |
collection | DOAJ |
description | The ViT (vision transformer) inference framework, which was widely used in image processing, was found to have a risk of leaking user privacy data. However, existing privacy protection inference frameworks had problems such as low computational efficiency and high online communication volume. To address this issue, a highly efficient privacy protection inference framework SViT was proposed. Two edge servers collaborated to execute secure computing protocols based on secret sharing design, such as SSoftmax, SLayerNorm, SGeLU, etc. While maintaining the original framework structure of ViT-B/16, the problem of large inference overhead in privacy protection framework was solved. Theoretical analysis and experiments show that compared to Crypton, SViT has improved computational efficiency by 2~6 times and online communication overhead by 4~14 times, respectively. |
format | Article |
id | doaj-art-1a23f3564de643069a09c1eb8766cc13 |
institution | Kabale University |
issn | 1000-436X |
language | zho |
publishDate | 2024-04-01 |
publisher | Editorial Department of Journal on Communications |
record_format | Article |
series | Tongxin xuebao |
spelling | doaj-art-1a23f3564de643069a09c1eb8766cc132025-01-14T07:24:18ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2024-04-0145273859255262Light weighted privacy protection ViT inference framework based on secret sharingMA MinFU YuHUANG KaiJIA XiaofengThe ViT (vision transformer) inference framework, which was widely used in image processing, was found to have a risk of leaking user privacy data. However, existing privacy protection inference frameworks had problems such as low computational efficiency and high online communication volume. To address this issue, a highly efficient privacy protection inference framework SViT was proposed. Two edge servers collaborated to execute secure computing protocols based on secret sharing design, such as SSoftmax, SLayerNorm, SGeLU, etc. While maintaining the original framework structure of ViT-B/16, the problem of large inference overhead in privacy protection framework was solved. Theoretical analysis and experiments show that compared to Crypton, SViT has improved computational efficiency by 2~6 times and online communication overhead by 4~14 times, respectively.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024025/privacy protectionsecret sharingimage classificationsecure computing protocol |
spellingShingle | MA Min FU Yu HUANG Kai JIA Xiaofeng Light weighted privacy protection ViT inference framework based on secret sharing Tongxin xuebao privacy protection secret sharing image classification secure computing protocol |
title | Light weighted privacy protection ViT inference framework based on secret sharing |
title_full | Light weighted privacy protection ViT inference framework based on secret sharing |
title_fullStr | Light weighted privacy protection ViT inference framework based on secret sharing |
title_full_unstemmed | Light weighted privacy protection ViT inference framework based on secret sharing |
title_short | Light weighted privacy protection ViT inference framework based on secret sharing |
title_sort | light weighted privacy protection vit inference framework based on secret sharing |
topic | privacy protection secret sharing image classification secure computing protocol |
url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024025/ |
work_keys_str_mv | AT mamin lightweightedprivacyprotectionvitinferenceframeworkbasedonsecretsharing AT fuyu lightweightedprivacyprotectionvitinferenceframeworkbasedonsecretsharing AT huangkai lightweightedprivacyprotectionvitinferenceframeworkbasedonsecretsharing AT jiaxiaofeng lightweightedprivacyprotectionvitinferenceframeworkbasedonsecretsharing |