Deep reinforcement learning-based mechanism to improve the throughput of EH-WSNs

Abstract Energy Harvesting Wireless Sensor Networks (EH-WSNs) are widely adopted for their ability to harvest ambient energy. However, these networks face significant challenges due to the limited and continuously varying energy availability at individual nodes, which depends on unpredictable enviro...

Full description

Saved in:
Bibliographic Details
Main Authors: Zahra Hasani, Maryam Mahdavimoghadam, Razieh Mohammadi, Zahra Shirmohammadi, Amirhossein Nikoofard, Eesa Nikahd, Kasra Davoodi
Format: Article
Language:English
Published: Nature Portfolio 2025-08-01
Series:Scientific Reports
Subjects:
Online Access:https://doi.org/10.1038/s41598-025-14111-y
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849235557280907264
author Zahra Hasani
Maryam Mahdavimoghadam
Razieh Mohammadi
Zahra Shirmohammadi
Amirhossein Nikoofard
Eesa Nikahd
Kasra Davoodi
author_facet Zahra Hasani
Maryam Mahdavimoghadam
Razieh Mohammadi
Zahra Shirmohammadi
Amirhossein Nikoofard
Eesa Nikahd
Kasra Davoodi
author_sort Zahra Hasani
collection DOAJ
description Abstract Energy Harvesting Wireless Sensor Networks (EH-WSNs) are widely adopted for their ability to harvest ambient energy. However, these networks face significant challenges due to the limited and continuously varying energy availability at individual nodes, which depends on unpredictable environmental sources. To operate effectively in such conditions, energy fluctuations need to be regulated. This requires continuous monitoring of each node’s energy level over time and adaptively adjusting operations. State-of-the-art mechanisms often categorize nodes or discretize energy levels, leading to issues such as the inability to select appropriate actions based on the actual energy states of the nodes. This discretization simplifies the representation of energy states and reduces complexity, making it easier to design and implement. However, it overlooks subtle variations in energy levels, leading to inaccurate assessments and suboptimal performance. To overcome this limitation, this paper proposes an energy-aware transmission method based on the Deep Reinforcement Learning (DRL) algorithm that integrates Q-learning with Deep Neural Networks (DNNs). This method enables each node to adaptively select transmission actions based on its real-time energy state, improving responsiveness to dynamic network conditions. Simulation results show that the proposed method improves throughput by 11.79% compared to traditional methods. These findings demonstrate the effectiveness of DRL-based control in enhancing performance and energy efficiency in EH-WSNs.
format Article
id doaj-art-7e50a2e788f04dcc9c21cdf3bc1cdd6d
institution Kabale University
issn 2045-2322
language English
publishDate 2025-08-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj-art-7e50a2e788f04dcc9c21cdf3bc1cdd6d2025-08-20T04:02:45ZengNature PortfolioScientific Reports2045-23222025-08-0115111210.1038/s41598-025-14111-yDeep reinforcement learning-based mechanism to improve the throughput of EH-WSNsZahra Hasani0Maryam Mahdavimoghadam1Razieh Mohammadi2Zahra Shirmohammadi3Amirhossein Nikoofard4Eesa Nikahd5Kasra Davoodi6Department of Electrical Engineering, Shahid Rajaee Teacher Training UniversityDepartment of Electrical Engineering, Shahid Rajaee Teacher Training UniversityDepartment of Computer Engineering, Shahid Rajaee Teacher Training UniversityDepartment of Computer Engineering, Shahid Rajaee Teacher Training UniversityDepartment of Electrical Engineering, K. N. Toosi University of Technology EngineeringDepartment of Computer Engineering, Shahid Rajaee Teacher Training UniversityDepartment of Electrical Engineering, K. N. Toosi University of Technology EngineeringAbstract Energy Harvesting Wireless Sensor Networks (EH-WSNs) are widely adopted for their ability to harvest ambient energy. However, these networks face significant challenges due to the limited and continuously varying energy availability at individual nodes, which depends on unpredictable environmental sources. To operate effectively in such conditions, energy fluctuations need to be regulated. This requires continuous monitoring of each node’s energy level over time and adaptively adjusting operations. State-of-the-art mechanisms often categorize nodes or discretize energy levels, leading to issues such as the inability to select appropriate actions based on the actual energy states of the nodes. This discretization simplifies the representation of energy states and reduces complexity, making it easier to design and implement. However, it overlooks subtle variations in energy levels, leading to inaccurate assessments and suboptimal performance. To overcome this limitation, this paper proposes an energy-aware transmission method based on the Deep Reinforcement Learning (DRL) algorithm that integrates Q-learning with Deep Neural Networks (DNNs). This method enables each node to adaptively select transmission actions based on its real-time energy state, improving responsiveness to dynamic network conditions. Simulation results show that the proposed method improves throughput by 11.79% compared to traditional methods. These findings demonstrate the effectiveness of DRL-based control in enhancing performance and energy efficiency in EH-WSNs.https://doi.org/10.1038/s41598-025-14111-yEnergy harvester wireless sensor networksDeep reinforcement learningDeep learningThroughput
spellingShingle Zahra Hasani
Maryam Mahdavimoghadam
Razieh Mohammadi
Zahra Shirmohammadi
Amirhossein Nikoofard
Eesa Nikahd
Kasra Davoodi
Deep reinforcement learning-based mechanism to improve the throughput of EH-WSNs
Scientific Reports
Energy harvester wireless sensor networks
Deep reinforcement learning
Deep learning
Throughput
title Deep reinforcement learning-based mechanism to improve the throughput of EH-WSNs
title_full Deep reinforcement learning-based mechanism to improve the throughput of EH-WSNs
title_fullStr Deep reinforcement learning-based mechanism to improve the throughput of EH-WSNs
title_full_unstemmed Deep reinforcement learning-based mechanism to improve the throughput of EH-WSNs
title_short Deep reinforcement learning-based mechanism to improve the throughput of EH-WSNs
title_sort deep reinforcement learning based mechanism to improve the throughput of eh wsns
topic Energy harvester wireless sensor networks
Deep reinforcement learning
Deep learning
Throughput
url https://doi.org/10.1038/s41598-025-14111-y
work_keys_str_mv AT zahrahasani deepreinforcementlearningbasedmechanismtoimprovethethroughputofehwsns
AT maryammahdavimoghadam deepreinforcementlearningbasedmechanismtoimprovethethroughputofehwsns
AT raziehmohammadi deepreinforcementlearningbasedmechanismtoimprovethethroughputofehwsns
AT zahrashirmohammadi deepreinforcementlearningbasedmechanismtoimprovethethroughputofehwsns
AT amirhosseinnikoofard deepreinforcementlearningbasedmechanismtoimprovethethroughputofehwsns
AT eesanikahd deepreinforcementlearningbasedmechanismtoimprovethethroughputofehwsns
AT kasradavoodi deepreinforcementlearningbasedmechanismtoimprovethethroughputofehwsns