Leveraging Lightweight Hybrid Ensemble Distillation (HED) for Suspect Identification With Face Recognition

Face recognition biometric systems focus on identifying individuals by extracting their facial characteristics. However, these systems often fail or are misclassified because of external factors, obstructions, and varying environmental conditions. Traditional models cannot effectively handle these v...

Full description

Saved in:
Bibliographic Details
Main Authors: Vaishnavi Munusamy, Sudha Senthilkumar
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10816325/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841557063894827008
author Vaishnavi Munusamy
Sudha Senthilkumar
author_facet Vaishnavi Munusamy
Sudha Senthilkumar
author_sort Vaishnavi Munusamy
collection DOAJ
description Face recognition biometric systems focus on identifying individuals by extracting their facial characteristics. However, these systems often fail or are misclassified because of external factors, obstructions, and varying environmental conditions. Traditional models cannot effectively handle these variations, leading to inaccuracies. Moreover, the complexity and computational demands of advanced models can hinder their real-time application. In this study, the Hybrid Ensemble Distillation (HED) model addresses these issues by leveraging both knowledge distillation and an ensemble of pre-trained models (VGG16, ResNet50, and DenseNet121) to enhance the precision and proficiency of categorization. The model combines the strengths of these architectures while utilizing data augmentation techniques such as GANs to enhance the training dataset. The proposed model demonstrated high efficiency and accuracy, with the teacher model achieving 98.42% accuracy and the student model reaching 96.78% validation accuracy, thereby highlighting the efficacy of knowledge distillation. It also showed progressive improvements in the validation accuracy and loss reduction over 350 epochs, emphasizing the robustness of the training process. This lightweight method helps identify suspects or individuals because the model was trained using 360-degree images in the dataset, ensuring comprehensive feature extraction from multiple angles. The reduced computational requirements and high accuracy make this approach suitable for real-time applications, thereby enhancing its practicality for various human identification tasks.
format Article
id doaj-art-feb525b595b347b48a52f07e139965ca
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-feb525b595b347b48a52f07e139965ca2025-01-07T00:01:46ZengIEEEIEEE Access2169-35362025-01-01132112212610.1109/ACCESS.2024.352310110816325Leveraging Lightweight Hybrid Ensemble Distillation (HED) for Suspect Identification With Face RecognitionVaishnavi Munusamy0https://orcid.org/0009-0009-8756-2586Sudha Senthilkumar1https://orcid.org/0000-0003-3132-000XSchool of Computer Science and Engineering, Vellore Institute of Technology, Vellore, IndiaSchool of Computer Science and Engineering, Vellore Institute of Technology, Vellore, IndiaFace recognition biometric systems focus on identifying individuals by extracting their facial characteristics. However, these systems often fail or are misclassified because of external factors, obstructions, and varying environmental conditions. Traditional models cannot effectively handle these variations, leading to inaccuracies. Moreover, the complexity and computational demands of advanced models can hinder their real-time application. In this study, the Hybrid Ensemble Distillation (HED) model addresses these issues by leveraging both knowledge distillation and an ensemble of pre-trained models (VGG16, ResNet50, and DenseNet121) to enhance the precision and proficiency of categorization. The model combines the strengths of these architectures while utilizing data augmentation techniques such as GANs to enhance the training dataset. The proposed model demonstrated high efficiency and accuracy, with the teacher model achieving 98.42% accuracy and the student model reaching 96.78% validation accuracy, thereby highlighting the efficacy of knowledge distillation. It also showed progressive improvements in the validation accuracy and loss reduction over 350 epochs, emphasizing the robustness of the training process. This lightweight method helps identify suspects or individuals because the model was trained using 360-degree images in the dataset, ensuring comprehensive feature extraction from multiple angles. The reduced computational requirements and high accuracy make this approach suitable for real-time applications, thereby enhancing its practicality for various human identification tasks.https://ieeexplore.ieee.org/document/10816325/Person identificationsuspects/criminal identificationface recognitionknowledge distillationensemble method
spellingShingle Vaishnavi Munusamy
Sudha Senthilkumar
Leveraging Lightweight Hybrid Ensemble Distillation (HED) for Suspect Identification With Face Recognition
IEEE Access
Person identification
suspects/criminal identification
face recognition
knowledge distillation
ensemble method
title Leveraging Lightweight Hybrid Ensemble Distillation (HED) for Suspect Identification With Face Recognition
title_full Leveraging Lightweight Hybrid Ensemble Distillation (HED) for Suspect Identification With Face Recognition
title_fullStr Leveraging Lightweight Hybrid Ensemble Distillation (HED) for Suspect Identification With Face Recognition
title_full_unstemmed Leveraging Lightweight Hybrid Ensemble Distillation (HED) for Suspect Identification With Face Recognition
title_short Leveraging Lightweight Hybrid Ensemble Distillation (HED) for Suspect Identification With Face Recognition
title_sort leveraging lightweight hybrid ensemble distillation hed for suspect identification with face recognition
topic Person identification
suspects/criminal identification
face recognition
knowledge distillation
ensemble method
url https://ieeexplore.ieee.org/document/10816325/
work_keys_str_mv AT vaishnavimunusamy leveraginglightweighthybridensembledistillationhedforsuspectidentificationwithfacerecognition
AT sudhasenthilkumar leveraginglightweighthybridensembledistillationhedforsuspectidentificationwithfacerecognition