Region inpainting algorithm of mouth-muffles for facial recognition

Facial recognition under occlusion is a well-known difficult problem in real scenes.Especially after the outbreak of COVID-19, in airports, stations and other places that need to verify the identity of visitors, the mouth-muffle occlusion greatly reduces the facial features that can be important for...

Full description

Saved in:
Bibliographic Details
Main Authors: Yue LI, Yaguan QIAN, Xiaohui GUAN, Wei LI, Bin WANG, Zhaoquan GU
Format: Article
Language:zho
Published: Beijing Xintong Media Co., Ltd 2021-08-01
Series:Dianxin kexue
Subjects:
Online Access:http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2021193/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841528930050244608
author Yue LI
Yaguan QIAN
Xiaohui GUAN
Wei LI
Bin WANG
Zhaoquan GU
author_facet Yue LI
Yaguan QIAN
Xiaohui GUAN
Wei LI
Bin WANG
Zhaoquan GU
author_sort Yue LI
collection DOAJ
description Facial recognition under occlusion is a well-known difficult problem in real scenes.Especially after the outbreak of COVID-19, in airports, stations and other places that need to verify the identity of visitors, the mouth-muffle occlusion greatly reduces the facial features that can be important for identification, and the accuracy of face recognition algorithm decreases.Face de-occlusion was studied, and a novel framework was proposed to restore face, which used the edge generation network to generate edge maps.On this basis, the occluded region was restored by the region completion network while preserving identity information.In order to improve the performance, the spatial weighted adversarial loss and identity-preserving loss were introduced to train the above two networks.Then two face datasets with mouth-muffles were constructed by face landmarks.The experimental results show that the accuracy of facial recognition algorithm ArcFace on the face dataset restored by the proposed model was 98.39%, which was 4.13% higher than that of directly using ArcFace.
format Article
id doaj-art-3dfd9fe4abf6492c9b6c3a2bfb342372
institution Kabale University
issn 1000-0801
language zho
publishDate 2021-08-01
publisher Beijing Xintong Media Co., Ltd
record_format Article
series Dianxin kexue
spelling doaj-art-3dfd9fe4abf6492c9b6c3a2bfb3423722025-01-15T03:32:33ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012021-08-0137667659814544Region inpainting algorithm of mouth-muffles for facial recognitionYue LIYaguan QIANXiaohui GUANWei LIBin WANGZhaoquan GUFacial recognition under occlusion is a well-known difficult problem in real scenes.Especially after the outbreak of COVID-19, in airports, stations and other places that need to verify the identity of visitors, the mouth-muffle occlusion greatly reduces the facial features that can be important for identification, and the accuracy of face recognition algorithm decreases.Face de-occlusion was studied, and a novel framework was proposed to restore face, which used the edge generation network to generate edge maps.On this basis, the occluded region was restored by the region completion network while preserving identity information.In order to improve the performance, the spatial weighted adversarial loss and identity-preserving loss were introduced to train the above two networks.Then two face datasets with mouth-muffles were constructed by face landmarks.The experimental results show that the accuracy of facial recognition algorithm ArcFace on the face dataset restored by the proposed model was 98.39%, which was 4.13% higher than that of directly using ArcFace.http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2021193/mouth-muffle occlusionsfacial recognitionedge generation networkregion completion network
spellingShingle Yue LI
Yaguan QIAN
Xiaohui GUAN
Wei LI
Bin WANG
Zhaoquan GU
Region inpainting algorithm of mouth-muffles for facial recognition
Dianxin kexue
mouth-muffle occlusions
facial recognition
edge generation network
region completion network
title Region inpainting algorithm of mouth-muffles for facial recognition
title_full Region inpainting algorithm of mouth-muffles for facial recognition
title_fullStr Region inpainting algorithm of mouth-muffles for facial recognition
title_full_unstemmed Region inpainting algorithm of mouth-muffles for facial recognition
title_short Region inpainting algorithm of mouth-muffles for facial recognition
title_sort region inpainting algorithm of mouth muffles for facial recognition
topic mouth-muffle occlusions
facial recognition
edge generation network
region completion network
url http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2021193/
work_keys_str_mv AT yueli regioninpaintingalgorithmofmouthmufflesforfacialrecognition
AT yaguanqian regioninpaintingalgorithmofmouthmufflesforfacialrecognition
AT xiaohuiguan regioninpaintingalgorithmofmouthmufflesforfacialrecognition
AT weili regioninpaintingalgorithmofmouthmufflesforfacialrecognition
AT binwang regioninpaintingalgorithmofmouthmufflesforfacialrecognition
AT zhaoquangu regioninpaintingalgorithmofmouthmufflesforfacialrecognition