Redundant Path Optimization in Smart Ship Software-Defined Networking and Time-Sensitive Networking Networks: An Improved Double-Dueling-Deep-Q-Networks-Based Approach

Traditional network architectures in smart ship communication systems struggle to efficiently manage the integration of heterogeneous sensor data. Additionally, conventional end-to-end transmission algorithms that rely on single-metric and single-path selection are inadequate in fulfilling the high...

Full description

Saved in:
Bibliographic Details
Main Authors: Yanli Xu, Songtao He, Zirui Zhou, Jingxin Xu
Format: Article
Language:English
Published: MDPI AG 2024-12-01
Series:Journal of Marine Science and Engineering
Subjects:
Online Access:https://www.mdpi.com/2077-1312/12/12/2214
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846104158900322304
author Yanli Xu
Songtao He
Zirui Zhou
Jingxin Xu
author_facet Yanli Xu
Songtao He
Zirui Zhou
Jingxin Xu
author_sort Yanli Xu
collection DOAJ
description Traditional network architectures in smart ship communication systems struggle to efficiently manage the integration of heterogeneous sensor data. Additionally, conventional end-to-end transmission algorithms that rely on single-metric and single-path selection are inadequate in fulfilling the high reliability and real-time transmission requirements essential for high-priority service data. This inadequacy results in increased latency and packet loss for critical control information. To address these challenges, this study proposes an innovative ship network framework that synergistically integrates Software-Defined Networking (SDN) and Time-Sensitive Networking (TSN) technologies. Central to this framework is the introduction of a redundant multipath selection algorithm, which leverages Double Dueling Deep Q-Networks (D3QNs) in conjunction with Graph Convolutional Networks (GCNs). Initially, an optimization function encompassing transmission latency, bandwidth utilization, and packet loss rate is formulated within a software-defined time-sensitive network transmission framework tailored for smart ships. The proposed D3QN-GCN-based algorithm effectively identifies optimal working and redundant paths for TSN switches. These dual-path configurations are then disseminated by the SDN controller to the TSN switches, enabling the TSN’s inherent reliability redundancy mechanisms to facilitate the simultaneous transmission of critical service flows across multiple paths. Experimental evaluations demonstrate that the proposed algorithm exhibits robust convergence characteristics and significantly outperforms existing algorithms in terms of reducing network latency and packet loss rates. Furthermore, the algorithm enhances bandwidth utilization and promotes balanced network load distribution. This research offers a novel and effective solution for shipboard switch path selection, thereby advancing the reliability and efficiency of smart ship communication systems.
format Article
id doaj-art-9b9e9b9b97e5481db4fc340f14e16651
institution Kabale University
issn 2077-1312
language English
publishDate 2024-12-01
publisher MDPI AG
record_format Article
series Journal of Marine Science and Engineering
spelling doaj-art-9b9e9b9b97e5481db4fc340f14e166512024-12-27T14:33:16ZengMDPI AGJournal of Marine Science and Engineering2077-13122024-12-011212221410.3390/jmse12122214Redundant Path Optimization in Smart Ship Software-Defined Networking and Time-Sensitive Networking Networks: An Improved Double-Dueling-Deep-Q-Networks-Based ApproachYanli Xu0Songtao He1Zirui Zhou2Jingxin Xu3College of Information Engineering, Shanghai Maritime University, Shanghai 201306, ChinaCollege of Information Engineering, Shanghai Maritime University, Shanghai 201306, ChinaCollege of Information Engineering, Shanghai Maritime University, Shanghai 201306, ChinaCollege of Information Engineering, Shanghai Maritime University, Shanghai 201306, ChinaTraditional network architectures in smart ship communication systems struggle to efficiently manage the integration of heterogeneous sensor data. Additionally, conventional end-to-end transmission algorithms that rely on single-metric and single-path selection are inadequate in fulfilling the high reliability and real-time transmission requirements essential for high-priority service data. This inadequacy results in increased latency and packet loss for critical control information. To address these challenges, this study proposes an innovative ship network framework that synergistically integrates Software-Defined Networking (SDN) and Time-Sensitive Networking (TSN) technologies. Central to this framework is the introduction of a redundant multipath selection algorithm, which leverages Double Dueling Deep Q-Networks (D3QNs) in conjunction with Graph Convolutional Networks (GCNs). Initially, an optimization function encompassing transmission latency, bandwidth utilization, and packet loss rate is formulated within a software-defined time-sensitive network transmission framework tailored for smart ships. The proposed D3QN-GCN-based algorithm effectively identifies optimal working and redundant paths for TSN switches. These dual-path configurations are then disseminated by the SDN controller to the TSN switches, enabling the TSN’s inherent reliability redundancy mechanisms to facilitate the simultaneous transmission of critical service flows across multiple paths. Experimental evaluations demonstrate that the proposed algorithm exhibits robust convergence characteristics and significantly outperforms existing algorithms in terms of reducing network latency and packet loss rates. Furthermore, the algorithm enhances bandwidth utilization and promotes balanced network load distribution. This research offers a novel and effective solution for shipboard switch path selection, thereby advancing the reliability and efficiency of smart ship communication systems.https://www.mdpi.com/2077-1312/12/12/2214smart shipsoftware-defined networkingtime-sensitive networkingdouble dueling deep Q-networksredundant path selection
spellingShingle Yanli Xu
Songtao He
Zirui Zhou
Jingxin Xu
Redundant Path Optimization in Smart Ship Software-Defined Networking and Time-Sensitive Networking Networks: An Improved Double-Dueling-Deep-Q-Networks-Based Approach
Journal of Marine Science and Engineering
smart ship
software-defined networking
time-sensitive networking
double dueling deep Q-networks
redundant path selection
title Redundant Path Optimization in Smart Ship Software-Defined Networking and Time-Sensitive Networking Networks: An Improved Double-Dueling-Deep-Q-Networks-Based Approach
title_full Redundant Path Optimization in Smart Ship Software-Defined Networking and Time-Sensitive Networking Networks: An Improved Double-Dueling-Deep-Q-Networks-Based Approach
title_fullStr Redundant Path Optimization in Smart Ship Software-Defined Networking and Time-Sensitive Networking Networks: An Improved Double-Dueling-Deep-Q-Networks-Based Approach
title_full_unstemmed Redundant Path Optimization in Smart Ship Software-Defined Networking and Time-Sensitive Networking Networks: An Improved Double-Dueling-Deep-Q-Networks-Based Approach
title_short Redundant Path Optimization in Smart Ship Software-Defined Networking and Time-Sensitive Networking Networks: An Improved Double-Dueling-Deep-Q-Networks-Based Approach
title_sort redundant path optimization in smart ship software defined networking and time sensitive networking networks an improved double dueling deep q networks based approach
topic smart ship
software-defined networking
time-sensitive networking
double dueling deep Q-networks
redundant path selection
url https://www.mdpi.com/2077-1312/12/12/2214
work_keys_str_mv AT yanlixu redundantpathoptimizationinsmartshipsoftwaredefinednetworkingandtimesensitivenetworkingnetworksanimproveddoubleduelingdeepqnetworksbasedapproach
AT songtaohe redundantpathoptimizationinsmartshipsoftwaredefinednetworkingandtimesensitivenetworkingnetworksanimproveddoubleduelingdeepqnetworksbasedapproach
AT ziruizhou redundantpathoptimizationinsmartshipsoftwaredefinednetworkingandtimesensitivenetworkingnetworksanimproveddoubleduelingdeepqnetworksbasedapproach
AT jingxinxu redundantpathoptimizationinsmartshipsoftwaredefinednetworkingandtimesensitivenetworkingnetworksanimproveddoubleduelingdeepqnetworksbasedapproach