Leveraging Social Media Data for Forest Fires Sentiment Classification: A Data-Driven Method

Background: The rise in forest fires over the last two years, which is due to rise in dry weather conditions and human activities, have greatly impacted an area of 1.6 million hectares, leading to significant ecological, economic, and health issues, hence the need to improve disaster response strate...

Full description

Saved in:
Bibliographic Details
Main Authors: Warih Maharani, Hanita Daud, Noryanti Muhammad, Evizal Abdul Kadir
Format: Article
Language:English
Published: Universitas Airlangga 2024-10-01
Series:Journal of Information Systems Engineering and Business Intelligence
Online Access:https://e-journal.unair.ac.id/JISEBI/article/view/54548
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841553556998455296
author Warih Maharani
Hanita Daud
Noryanti Muhammad
Evizal Abdul Kadir
author_facet Warih Maharani
Hanita Daud
Noryanti Muhammad
Evizal Abdul Kadir
author_sort Warih Maharani
collection DOAJ
description Background: The rise in forest fires over the last two years, which is due to rise in dry weather conditions and human activities, have greatly impacted an area of 1.6 million hectares, leading to significant ecological, economic, and health issues, hence the need to improve disaster response strategies. Previous research determined the lack of coverage regarding public response during forest fires with conventional methods such as satellite images and sensor data. However, social media platforms provide real-time information generated by users, along with location information of disaster events. Sentiment analysis helps in understanding the public reactions and responses to natural disasters, thereby increasing awareness about forest fires. Objective: The purpose of this research is to assess the efficiency of Long Short-Term Memory (LSTM) method in classifying sentiment for social networks in regard to forest fires. This research aims to examine the effect of TF-IDF, unigram, and the FastText features on the effectiveness of the classification of sentiment. Methods: The precision, recall, and F1 score of 2, 3, and 4 determined in the LSTM models with commonly available sentiment analysis tools, such as the Vader Sentiment Analysis and SentiWordNet was used to evaluate the performance of the model. Results: With an improvement of roughly 10%, the four layers of the LSTM model generated the best performance for the evaluation of sentiments about forest fires. The LSTM model with FastText achieved F1, recall and precision scores of 0.649, 0.641, and 0.659, which exceeds lexicon-based method including SentiWordNet and Vader. Conclusion: The experimental results showed that the LSTM model outperformed lexicon-based methods when used to analyse the tweets related to forest fire. Additional research is required to integrate rule-based models and LSTM models to develop a more robust model for dynamic data.   Keywords: Forest Fire, Disaster, Long Short-Term Memory, LSTM, Vader, SentiWordnet
format Article
id doaj-art-d6a17018d61f442bb800b72ae4e4919f
institution Kabale University
issn 2598-6333
2443-2555
language English
publishDate 2024-10-01
publisher Universitas Airlangga
record_format Article
series Journal of Information Systems Engineering and Business Intelligence
spelling doaj-art-d6a17018d61f442bb800b72ae4e4919f2025-01-09T07:57:33ZengUniversitas AirlanggaJournal of Information Systems Engineering and Business Intelligence2598-63332443-25552024-10-0110339240710.20473/jisebi.10.3.392-40752710Leveraging Social Media Data for Forest Fires Sentiment Classification: A Data-Driven MethodWarih Maharani0https://orcid.org/0000-0003-1574-921XHanita Daud1Noryanti Muhammad2https://orcid.org/0000-0002-6112-3720Evizal Abdul Kadir3Telkom University, Bandung, IndonesiaUniversiti Teknologi PETRONAS, 32610 Seri Iskandar, Perak Darul Ridzuan, MalaysiaUniversiti Malaysia Pahang, Lebuh Persiaran Tun Khalil Yaakob, Kuantan, Pahang, MalaysiaUniversitas Islam Riau, Pekanbaru, Riau, IndonesiaBackground: The rise in forest fires over the last two years, which is due to rise in dry weather conditions and human activities, have greatly impacted an area of 1.6 million hectares, leading to significant ecological, economic, and health issues, hence the need to improve disaster response strategies. Previous research determined the lack of coverage regarding public response during forest fires with conventional methods such as satellite images and sensor data. However, social media platforms provide real-time information generated by users, along with location information of disaster events. Sentiment analysis helps in understanding the public reactions and responses to natural disasters, thereby increasing awareness about forest fires. Objective: The purpose of this research is to assess the efficiency of Long Short-Term Memory (LSTM) method in classifying sentiment for social networks in regard to forest fires. This research aims to examine the effect of TF-IDF, unigram, and the FastText features on the effectiveness of the classification of sentiment. Methods: The precision, recall, and F1 score of 2, 3, and 4 determined in the LSTM models with commonly available sentiment analysis tools, such as the Vader Sentiment Analysis and SentiWordNet was used to evaluate the performance of the model. Results: With an improvement of roughly 10%, the four layers of the LSTM model generated the best performance for the evaluation of sentiments about forest fires. The LSTM model with FastText achieved F1, recall and precision scores of 0.649, 0.641, and 0.659, which exceeds lexicon-based method including SentiWordNet and Vader. Conclusion: The experimental results showed that the LSTM model outperformed lexicon-based methods when used to analyse the tweets related to forest fire. Additional research is required to integrate rule-based models and LSTM models to develop a more robust model for dynamic data.   Keywords: Forest Fire, Disaster, Long Short-Term Memory, LSTM, Vader, SentiWordnethttps://e-journal.unair.ac.id/JISEBI/article/view/54548
spellingShingle Warih Maharani
Hanita Daud
Noryanti Muhammad
Evizal Abdul Kadir
Leveraging Social Media Data for Forest Fires Sentiment Classification: A Data-Driven Method
Journal of Information Systems Engineering and Business Intelligence
title Leveraging Social Media Data for Forest Fires Sentiment Classification: A Data-Driven Method
title_full Leveraging Social Media Data for Forest Fires Sentiment Classification: A Data-Driven Method
title_fullStr Leveraging Social Media Data for Forest Fires Sentiment Classification: A Data-Driven Method
title_full_unstemmed Leveraging Social Media Data for Forest Fires Sentiment Classification: A Data-Driven Method
title_short Leveraging Social Media Data for Forest Fires Sentiment Classification: A Data-Driven Method
title_sort leveraging social media data for forest fires sentiment classification a data driven method
url https://e-journal.unair.ac.id/JISEBI/article/view/54548
work_keys_str_mv AT warihmaharani leveragingsocialmediadataforforestfiressentimentclassificationadatadrivenmethod
AT hanitadaud leveragingsocialmediadataforforestfiressentimentclassificationadatadrivenmethod
AT noryantimuhammad leveragingsocialmediadataforforestfiressentimentclassificationadatadrivenmethod
AT evizalabdulkadir leveragingsocialmediadataforforestfiressentimentclassificationadatadrivenmethod