Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3

The application of an electronic violation detection system has begun to be implemented in many countries using CCTV cameras installed at highway and toll road points. However, the development of a violation detection system using data in the form of images that have a high level of accuracy is stil...

Full description

Saved in:
Bibliographic Details
Main Authors: Erika Udayanti, Etika Kartikadarma, Fahri Firdausillah
Format: Article
Language:English
Published: Ikatan Ahli Informatika Indonesia 2024-06-01
Series:Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
Subjects:
Online Access:https://jurnal.iaii.or.id/index.php/RESTI/article/view/5784
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841544049731829760
author Erika Udayanti
Etika Kartikadarma
Fahri Firdausillah
author_facet Erika Udayanti
Etika Kartikadarma
Fahri Firdausillah
author_sort Erika Udayanti
collection DOAJ
description The application of an electronic violation detection system has begun to be implemented in many countries using CCTV cameras installed at highway and toll road points. However, the development of a violation detection system using data in the form of images that have a high level of accuracy is still a challenge for researchers. Several types of violations detected include the use of seat belts, the use of cell phones while driving, which is influenced by the number of vehicles, vehicle speed and lighting, which can increase the difficulty in the detection process. This research developed a traffic violation detection system using a hybrid model, namely the CNN and LSTM algorithms for the application of discipline using seat belts. The dataset was obtained from RoboFlow Universe with a total of 199 front view car images consists of 82 using seatbelts and 78 not using seatbelts for the training process. The CNN algorithm plays a role in the feature extraction process from input image data, while the LSTM algorithm plays a role in the prediction process. Additionally, the performance evaluation of the CNN+LSTM algorithm will be measured using the accuracy value to measure the performance of the training process and testing process. When measuring the performance of the training process, it will be compared with several basic detection models used, such as CNN, VGG16, ResNet50, MobileNetV2, Yolo3, Yolo3+LSTM. The test results show that Yolo3+LSTM has a higher accuracy compared to the others, at 89%. Next, in the testing process, the CNN+LSTM model will be compared with the basic method, namely CNN. The test results show that the CNN+LSTM models have a higher accuracy of 89%. Meanwhile, in the basic CNN model, the resulting accuracy was 85%.
format Article
id doaj-art-a49b164ffb2e4b71bae55ad5713ea5e8
institution Kabale University
issn 2580-0760
language English
publishDate 2024-06-01
publisher Ikatan Ahli Informatika Indonesia
record_format Article
series Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
spelling doaj-art-a49b164ffb2e4b71bae55ad5713ea5e82025-01-13T03:33:46ZengIkatan Ahli Informatika IndonesiaJurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)2580-07602024-06-018335536010.29207/resti.v8i3.57845784Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3Erika Udayanti0Etika Kartikadarma1Fahri Firdausillah2Universitas Dian NuswantoroUniversitas Dian NuswantoroUniversitas Dian NuswantoroThe application of an electronic violation detection system has begun to be implemented in many countries using CCTV cameras installed at highway and toll road points. However, the development of a violation detection system using data in the form of images that have a high level of accuracy is still a challenge for researchers. Several types of violations detected include the use of seat belts, the use of cell phones while driving, which is influenced by the number of vehicles, vehicle speed and lighting, which can increase the difficulty in the detection process. This research developed a traffic violation detection system using a hybrid model, namely the CNN and LSTM algorithms for the application of discipline using seat belts. The dataset was obtained from RoboFlow Universe with a total of 199 front view car images consists of 82 using seatbelts and 78 not using seatbelts for the training process. The CNN algorithm plays a role in the feature extraction process from input image data, while the LSTM algorithm plays a role in the prediction process. Additionally, the performance evaluation of the CNN+LSTM algorithm will be measured using the accuracy value to measure the performance of the training process and testing process. When measuring the performance of the training process, it will be compared with several basic detection models used, such as CNN, VGG16, ResNet50, MobileNetV2, Yolo3, Yolo3+LSTM. The test results show that Yolo3+LSTM has a higher accuracy compared to the others, at 89%. Next, in the testing process, the CNN+LSTM model will be compared with the basic method, namely CNN. The test results show that the CNN+LSTM models have a higher accuracy of 89%. Meanwhile, in the basic CNN model, the resulting accuracy was 85%.https://jurnal.iaii.or.id/index.php/RESTI/article/view/5784intelligent systemseat belt violation detectionyoloconvolutional neural networkslstm
spellingShingle Erika Udayanti
Etika Kartikadarma
Fahri Firdausillah
Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3
Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
intelligent system
seat belt violation detection
yolo
convolutional neural networks
lstm
title Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3
title_full Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3
title_fullStr Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3
title_full_unstemmed Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3
title_short Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3
title_sort convolutional neural network and lstm for seat belt detection in vehicles using yolo3
topic intelligent system
seat belt violation detection
yolo
convolutional neural networks
lstm
url https://jurnal.iaii.or.id/index.php/RESTI/article/view/5784
work_keys_str_mv AT erikaudayanti convolutionalneuralnetworkandlstmforseatbeltdetectioninvehiclesusingyolo3
AT etikakartikadarma convolutionalneuralnetworkandlstmforseatbeltdetectioninvehiclesusingyolo3
AT fahrifirdausillah convolutionalneuralnetworkandlstmforseatbeltdetectioninvehiclesusingyolo3