Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications, and Challenges

Multispectral imaging and deep learning have emerged as powerful tools supporting diverse use cases from autonomous vehicles to agriculture, infrastructure monitoring and environmental assessment. The combination of these technologies has led to significant advancements in object detection, classifi...

Full description

Saved in:
Bibliographic Details
Main Authors: James E. Gallagher, Edward J. Oughton
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10829595/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841536210552487936
author James E. Gallagher
Edward J. Oughton
author_facet James E. Gallagher
Edward J. Oughton
author_sort James E. Gallagher
collection DOAJ
description Multispectral imaging and deep learning have emerged as powerful tools supporting diverse use cases from autonomous vehicles to agriculture, infrastructure monitoring and environmental assessment. The combination of these technologies has led to significant advancements in object detection, classification, and segmentation tasks in the non-visible light spectrum. This paper considers 400 total papers, reviewing 200 in detail to provide an authoritative meta-review of multispectral imaging technologies, deep learning models, and their applications, considering the evolution and adaptation of you only look once (YOLO). Ground-based collection is the most prevalent approach, totaling 63% of the papers reviewed, although uncrewed aerial systems (UAS) for YOLO-multispectral applications have doubled since 2020. The most prevalent sensor fusion is red-green-blue (RGB) with long-wave infrared (LWIR), comprising 39% of the literature. YOLOv5 remains the most used variant for adaption to multispectral applications, consisting of 33% of all modified YOLO models reviewed. Future research needs to focus on: 1) developing adaptive YOLO architectures capable of handling diverse spectral inputs that do not require extensive architectural modifications; 2) exploring methods to generate large synthetic multispectral datasets; 3) advancing multispectral YOLO transfer learning techniques to address dataset scarcity; and 4) innovating fusion research with other sensor types beyond RGB and LWIR.
format Article
id doaj-art-d7b8e8ef51e84e848b03d340ba90e13a
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-d7b8e8ef51e84e848b03d340ba90e13a2025-01-15T00:02:51ZengIEEEIEEE Access2169-35362025-01-01137366739510.1109/ACCESS.2025.352645810829595Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications, and ChallengesJames E. Gallagher0https://orcid.org/0009-0002-5380-8436Edward J. Oughton1https://orcid.org/0000-0002-2766-008XGeography and Geoinformation Science Department, George Mason University, Fairfax, VA, USAGeography and Geoinformation Science Department, George Mason University, Fairfax, VA, USAMultispectral imaging and deep learning have emerged as powerful tools supporting diverse use cases from autonomous vehicles to agriculture, infrastructure monitoring and environmental assessment. The combination of these technologies has led to significant advancements in object detection, classification, and segmentation tasks in the non-visible light spectrum. This paper considers 400 total papers, reviewing 200 in detail to provide an authoritative meta-review of multispectral imaging technologies, deep learning models, and their applications, considering the evolution and adaptation of you only look once (YOLO). Ground-based collection is the most prevalent approach, totaling 63% of the papers reviewed, although uncrewed aerial systems (UAS) for YOLO-multispectral applications have doubled since 2020. The most prevalent sensor fusion is red-green-blue (RGB) with long-wave infrared (LWIR), comprising 39% of the literature. YOLOv5 remains the most used variant for adaption to multispectral applications, consisting of 33% of all modified YOLO models reviewed. Future research needs to focus on: 1) developing adaptive YOLO architectures capable of handling diverse spectral inputs that do not require extensive architectural modifications; 2) exploring methods to generate large synthetic multispectral datasets; 3) advancing multispectral YOLO transfer learning techniques to address dataset scarcity; and 4) innovating fusion research with other sensor types beyond RGB and LWIR.https://ieeexplore.ieee.org/document/10829595/Multispectral object detectionyou only look once (YOLO)convolutional neural networks (CNN)deep learningRGBLWIR
spellingShingle James E. Gallagher
Edward J. Oughton
Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications, and Challenges
IEEE Access
Multispectral object detection
you only look once (YOLO)
convolutional neural networks (CNN)
deep learning
RGB
LWIR
title Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications, and Challenges
title_full Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications, and Challenges
title_fullStr Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications, and Challenges
title_full_unstemmed Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications, and Challenges
title_short Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications, and Challenges
title_sort surveying you only look once yolo multispectral object detection advancements applications and challenges
topic Multispectral object detection
you only look once (YOLO)
convolutional neural networks (CNN)
deep learning
RGB
LWIR
url https://ieeexplore.ieee.org/document/10829595/
work_keys_str_mv AT jamesegallagher surveyingyouonlylookonceyolomultispectralobjectdetectionadvancementsapplicationsandchallenges
AT edwardjoughton surveyingyouonlylookonceyolomultispectralobjectdetectionadvancementsapplicationsandchallenges