Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase Correlation

Aiming at the problem that the camera field of view is too small to obtain the complete side image of the vehicle in the traffic management scene, a real-time stitching algorithm of vehicle side view image based on Multi-Region Fast Phase Correlation (MFPC) is proposed. Firstly, the background subtr...

Full description

Saved in:
Bibliographic Details
Main Authors: Mubin Xu, Xiaoyong Liu, Chuanhai Wan
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10820337/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841536222484234240
author Mubin Xu
Xiaoyong Liu
Chuanhai Wan
author_facet Mubin Xu
Xiaoyong Liu
Chuanhai Wan
author_sort Mubin Xu
collection DOAJ
description Aiming at the problem that the camera field of view is too small to obtain the complete side image of the vehicle in the traffic management scene, a real-time stitching algorithm of vehicle side view image based on Multi-Region Fast Phase Correlation (MFPC) is proposed. Firstly, the background subtraction method based on Gaussian mixture model is used to obtain vehicle foreground image sequence, and the image is downsampled by Gaussian pyramid to reduce the running time of the program. Subsequently, multi-region phase correlation and registration check based on normalized cross-correlation are used to improve the accuracy of registration, and a local inverse discrete Fourier transform method is proposed to improve the computational efficiency. To mitigate background interference in registration, a peak filtering algorithm is proposed, combined with a sub-pixel refinement algorithm to enhance accuracy. Experimental results indicate that the proposed algorithm has better registration performance than the traditional phase correlation and methods based on feature point detection. It requires only 26% of the time taken by the traditional phase correlation, with an average processing time per frame of 3.81 ms, which meets the real-time requirements. In practical applications, the stitching accuracy reached 99.33%, demonstrating high precision and robustness.
format Article
id doaj-art-fe2cbe78fda94c6a9dcbc56eeda3d1bd
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-fe2cbe78fda94c6a9dcbc56eeda3d1bd2025-01-15T00:01:21ZengIEEEIEEE Access2169-35362025-01-01135076509110.1109/ACCESS.2024.352518110820337Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase CorrelationMubin Xu0https://orcid.org/0009-0009-0505-2727Xiaoyong Liu1https://orcid.org/0009-0003-1422-9447Chuanhai Wan2https://orcid.org/0009-0000-9046-1449School of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an, ChinaSchool of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an, ChinaSchool of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an, ChinaAiming at the problem that the camera field of view is too small to obtain the complete side image of the vehicle in the traffic management scene, a real-time stitching algorithm of vehicle side view image based on Multi-Region Fast Phase Correlation (MFPC) is proposed. Firstly, the background subtraction method based on Gaussian mixture model is used to obtain vehicle foreground image sequence, and the image is downsampled by Gaussian pyramid to reduce the running time of the program. Subsequently, multi-region phase correlation and registration check based on normalized cross-correlation are used to improve the accuracy of registration, and a local inverse discrete Fourier transform method is proposed to improve the computational efficiency. To mitigate background interference in registration, a peak filtering algorithm is proposed, combined with a sub-pixel refinement algorithm to enhance accuracy. Experimental results indicate that the proposed algorithm has better registration performance than the traditional phase correlation and methods based on feature point detection. It requires only 26% of the time taken by the traditional phase correlation, with an average processing time per frame of 3.81 ms, which meets the real-time requirements. In practical applications, the stitching accuracy reached 99.33%, demonstrating high precision and robustness.https://ieeexplore.ieee.org/document/10820337/Image registrationimage stitchingphase correlationroad vehiclesvehicle detection
spellingShingle Mubin Xu
Xiaoyong Liu
Chuanhai Wan
Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase Correlation
IEEE Access
Image registration
image stitching
phase correlation
road vehicles
vehicle detection
title Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase Correlation
title_full Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase Correlation
title_fullStr Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase Correlation
title_full_unstemmed Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase Correlation
title_short Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase Correlation
title_sort real time stitching algorithm of vehicle side view image based on multi region fast phase correlation
topic Image registration
image stitching
phase correlation
road vehicles
vehicle detection
url https://ieeexplore.ieee.org/document/10820337/
work_keys_str_mv AT mubinxu realtimestitchingalgorithmofvehiclesideviewimagebasedonmultiregionfastphasecorrelation
AT xiaoyongliu realtimestitchingalgorithmofvehiclesideviewimagebasedonmultiregionfastphasecorrelation
AT chuanhaiwan realtimestitchingalgorithmofvehiclesideviewimagebasedonmultiregionfastphasecorrelation