Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full‐Disk Solar Images
Abstract Deep learning is successful in many fields due to its ability to learn strong feature representations without the need for hand‐crafted features, resulting in models with high representational power. However, many of these models are based on supervised learning and therefore depend on the...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-02-01
|
| Series: | Space Weather |
| Subjects: | |
| Online Access: | https://doi.org/10.1029/2023SW003516 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841536390953697280 |
|---|---|
| author | Marius Giger André Csillaghy |
| author_facet | Marius Giger André Csillaghy |
| author_sort | Marius Giger |
| collection | DOAJ |
| description | Abstract Deep learning is successful in many fields due to its ability to learn strong feature representations without the need for hand‐crafted features, resulting in models with high representational power. However, many of these models are based on supervised learning and therefore depend on the availability of large annotated data sets. These are often difficult to obtain because they require human input. A common challenge for researchers in space weather is the sparsity of annotations in many of the available data sets, which are either unlabeled or have ambiguous labels. To alleviate the data bottleneck of loosely annotated data sets, unsupervised deep learning has become an important strategy, with anomaly detection being one of the most prominent applications. Unsupervised models have been successfully applied in various domains, such as medical imaging or video surveillance, to distinguish normal from abnormal data. In this work, we investigate how a purely unsupervised approach can be used to detect and extract solar phenomena in extreme ultraviolet images from the NASA SDO spacecraft. We show how a model based on variational autoencoders can be used to detect out‐of‐distribution samples and to localize regions of interest for solar activity. By using an unsupervised approach, we hope to contribute to space weather monitoring tools and further improve the understanding of space weather drivers. |
| format | Article |
| id | doaj-art-29dccadc49114fd4ad72d3538fe6a56c |
| institution | Kabale University |
| issn | 1542-7390 |
| language | English |
| publishDate | 2024-02-01 |
| publisher | Wiley |
| record_format | Article |
| series | Space Weather |
| spelling | doaj-art-29dccadc49114fd4ad72d3538fe6a56c2025-01-14T16:30:41ZengWileySpace Weather1542-73902024-02-01222n/an/a10.1029/2023SW003516Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full‐Disk Solar ImagesMarius Giger0André Csillaghy1University of Applied Sciences and Arts North Western Switzerland (FHNW) Institute for Data Science Windisch SwitzerlandUniversity of Applied Sciences and Arts North Western Switzerland (FHNW) Institute for Data Science Windisch SwitzerlandAbstract Deep learning is successful in many fields due to its ability to learn strong feature representations without the need for hand‐crafted features, resulting in models with high representational power. However, many of these models are based on supervised learning and therefore depend on the availability of large annotated data sets. These are often difficult to obtain because they require human input. A common challenge for researchers in space weather is the sparsity of annotations in many of the available data sets, which are either unlabeled or have ambiguous labels. To alleviate the data bottleneck of loosely annotated data sets, unsupervised deep learning has become an important strategy, with anomaly detection being one of the most prominent applications. Unsupervised models have been successfully applied in various domains, such as medical imaging or video surveillance, to distinguish normal from abnormal data. In this work, we investigate how a purely unsupervised approach can be used to detect and extract solar phenomena in extreme ultraviolet images from the NASA SDO spacecraft. We show how a model based on variational autoencoders can be used to detect out‐of‐distribution samples and to localize regions of interest for solar activity. By using an unsupervised approach, we hope to contribute to space weather monitoring tools and further improve the understanding of space weather drivers.https://doi.org/10.1029/2023SW003516machine learningsolar flaresvariational autoencodersanomaly detectionunsupervised deep learningout‐of‐distribution detection |
| spellingShingle | Marius Giger André Csillaghy Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full‐Disk Solar Images Space Weather machine learning solar flares variational autoencoders anomaly detection unsupervised deep learning out‐of‐distribution detection |
| title | Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full‐Disk Solar Images |
| title_full | Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full‐Disk Solar Images |
| title_fullStr | Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full‐Disk Solar Images |
| title_full_unstemmed | Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full‐Disk Solar Images |
| title_short | Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full‐Disk Solar Images |
| title_sort | unsupervised anomaly detection with variational autoencoders applied to full disk solar images |
| topic | machine learning solar flares variational autoencoders anomaly detection unsupervised deep learning out‐of‐distribution detection |
| url | https://doi.org/10.1029/2023SW003516 |
| work_keys_str_mv | AT mariusgiger unsupervisedanomalydetectionwithvariationalautoencodersappliedtofulldisksolarimages AT andrecsillaghy unsupervisedanomalydetectionwithvariationalautoencodersappliedtofulldisksolarimages |