EDGE DETECTION TECHNIQUE BASED ON BILATERAL FILTERING AND ITERATIVE THRESHOLD SELECTION ALGORITHM AND TRANSFER LEARNING FOR TRAFFIC SIGN RECOGNITION

The traffic sign identification and recognition system (TSIRS) is an essential component for autonomous vehicles to succeed. The TSIRS helps to collect and provide helpful information for autonomous driving systems. The information may include limits on speed, directions for driving, signs to stop o...

Full description

Saved in:
Bibliographic Details
Main Authors: Milind PARSE, Dhanya PRAMOD
Format: Article
Language:English
Published: Silesian University of Technology 2023-06-01
Series:Scientific Journal of Silesian University of Technology. Series Transport
Subjects:
Online Access:https://sjsutst.polsl.pl/archives/2023/vol119/199_SJSUTST119_2023_Parse_Pramod.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841562909074784256
author Milind PARSE
Dhanya PRAMOD
author_facet Milind PARSE
Dhanya PRAMOD
author_sort Milind PARSE
collection DOAJ
description The traffic sign identification and recognition system (TSIRS) is an essential component for autonomous vehicles to succeed. The TSIRS helps to collect and provide helpful information for autonomous driving systems. The information may include limits on speed, directions for driving, signs to stop or lower the speed, and many more essential things for safe driving. Recently, incidents have been reported regarding autonomous vehicle crashes due to traffic sign identification and recognition system failures. The TSIRS fails to recognize the traffic signs in challenging conditions such as skewed signboards, scratches on traffic symbols, discontinuous or damaged traffic symbols, etc. These challenging conditions are presented for various reasons, such as accidents, storms, artificial damage, etc. Such traffic signs contain an ample amount of noise, because of which traffic sign identification and recognition become a challenging task for automated TSIRS systems. The proposed method in this paper addresses these challenges. The sign edge is a helpful feature for the recognition of traffic signs. A novel traffic sign edge detection algorithm is introduced based on bilateral filtering with adaptive thresholding and varying aperture size that effectively detects the edges from such noisy images. The proposed edge detection algorithm and transfer learning is used to train the Convolutional Neural Network (CNN) models and recognize the traffic signs. The performance of the proposed method is evaluated and compared with existing edge detection methods. The results show that the proposed algorithm achieves optimal Mean Square Error (MSE) and Root Mean Square Error (RMSE) error rates and has a better Signal to Noise Ratio (SNR) and Peak Signal to Noise Ratio (PSNR) ratio than the traditional edge detection algorithms. Furthermore, the precision rate, recall rate, and F1 scores are evaluated for the CNN models. With the German Traffic Sign Benchmark database (GTSRB), the proposed algorithm and Inception V3 CNN model gives promising results when it receives the edge-detected images for training and testing.
format Article
id doaj-art-34fd6422736548c8afd93a68b22a9e82
institution Kabale University
issn 0209-3324
2450-1549
language English
publishDate 2023-06-01
publisher Silesian University of Technology
record_format Article
series Scientific Journal of Silesian University of Technology. Series Transport
spelling doaj-art-34fd6422736548c8afd93a68b22a9e822025-01-03T00:36:53ZengSilesian University of TechnologyScientific Journal of Silesian University of Technology. Series Transport0209-33242450-15492023-06-0111919922210.20858/sjsutst.2023.119.12EDGE DETECTION TECHNIQUE BASED ON BILATERAL FILTERING AND ITERATIVE THRESHOLD SELECTION ALGORITHM AND TRANSFER LEARNING FOR TRAFFIC SIGN RECOGNITIONMilind PARSEDhanya PRAMODThe traffic sign identification and recognition system (TSIRS) is an essential component for autonomous vehicles to succeed. The TSIRS helps to collect and provide helpful information for autonomous driving systems. The information may include limits on speed, directions for driving, signs to stop or lower the speed, and many more essential things for safe driving. Recently, incidents have been reported regarding autonomous vehicle crashes due to traffic sign identification and recognition system failures. The TSIRS fails to recognize the traffic signs in challenging conditions such as skewed signboards, scratches on traffic symbols, discontinuous or damaged traffic symbols, etc. These challenging conditions are presented for various reasons, such as accidents, storms, artificial damage, etc. Such traffic signs contain an ample amount of noise, because of which traffic sign identification and recognition become a challenging task for automated TSIRS systems. The proposed method in this paper addresses these challenges. The sign edge is a helpful feature for the recognition of traffic signs. A novel traffic sign edge detection algorithm is introduced based on bilateral filtering with adaptive thresholding and varying aperture size that effectively detects the edges from such noisy images. The proposed edge detection algorithm and transfer learning is used to train the Convolutional Neural Network (CNN) models and recognize the traffic signs. The performance of the proposed method is evaluated and compared with existing edge detection methods. The results show that the proposed algorithm achieves optimal Mean Square Error (MSE) and Root Mean Square Error (RMSE) error rates and has a better Signal to Noise Ratio (SNR) and Peak Signal to Noise Ratio (PSNR) ratio than the traditional edge detection algorithms. Furthermore, the precision rate, recall rate, and F1 scores are evaluated for the CNN models. With the German Traffic Sign Benchmark database (GTSRB), the proposed algorithm and Inception V3 CNN model gives promising results when it receives the edge-detected images for training and testing.https://sjsutst.polsl.pl/archives/2023/vol119/199_SJSUTST119_2023_Parse_Pramod.pdfbilateral filteringedge detectiontransfer learningtraffic sign identification and recognition
spellingShingle Milind PARSE
Dhanya PRAMOD
EDGE DETECTION TECHNIQUE BASED ON BILATERAL FILTERING AND ITERATIVE THRESHOLD SELECTION ALGORITHM AND TRANSFER LEARNING FOR TRAFFIC SIGN RECOGNITION
Scientific Journal of Silesian University of Technology. Series Transport
bilateral filtering
edge detection
transfer learning
traffic sign identification and recognition
title EDGE DETECTION TECHNIQUE BASED ON BILATERAL FILTERING AND ITERATIVE THRESHOLD SELECTION ALGORITHM AND TRANSFER LEARNING FOR TRAFFIC SIGN RECOGNITION
title_full EDGE DETECTION TECHNIQUE BASED ON BILATERAL FILTERING AND ITERATIVE THRESHOLD SELECTION ALGORITHM AND TRANSFER LEARNING FOR TRAFFIC SIGN RECOGNITION
title_fullStr EDGE DETECTION TECHNIQUE BASED ON BILATERAL FILTERING AND ITERATIVE THRESHOLD SELECTION ALGORITHM AND TRANSFER LEARNING FOR TRAFFIC SIGN RECOGNITION
title_full_unstemmed EDGE DETECTION TECHNIQUE BASED ON BILATERAL FILTERING AND ITERATIVE THRESHOLD SELECTION ALGORITHM AND TRANSFER LEARNING FOR TRAFFIC SIGN RECOGNITION
title_short EDGE DETECTION TECHNIQUE BASED ON BILATERAL FILTERING AND ITERATIVE THRESHOLD SELECTION ALGORITHM AND TRANSFER LEARNING FOR TRAFFIC SIGN RECOGNITION
title_sort edge detection technique based on bilateral filtering and iterative threshold selection algorithm and transfer learning for traffic sign recognition
topic bilateral filtering
edge detection
transfer learning
traffic sign identification and recognition
url https://sjsutst.polsl.pl/archives/2023/vol119/199_SJSUTST119_2023_Parse_Pramod.pdf
work_keys_str_mv AT milindparse edgedetectiontechniquebasedonbilateralfilteringanditerativethresholdselectionalgorithmandtransferlearningfortrafficsignrecognition
AT dhanyapramod edgedetectiontechniquebasedonbilateralfilteringanditerativethresholdselectionalgorithmandtransferlearningfortrafficsignrecognition