A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications

Deep learning (DL) has become a core component of modern artificial intelligence (AI), driving significant advancements across diverse fields by facilitating the analysis of complex systems, from protein folding in biology to molecular discovery in chemistry and particle interactions in physics. How...

Full description

Saved in:
Bibliographic Details
Main Authors: Ibomoiye Domor Mienye, Theo G. Swart
Format: Article
Language:English
Published: MDPI AG 2024-11-01
Series:Information
Subjects:
Online Access:https://www.mdpi.com/2078-2489/15/12/755
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846104305769119744
author Ibomoiye Domor Mienye
Theo G. Swart
author_facet Ibomoiye Domor Mienye
Theo G. Swart
author_sort Ibomoiye Domor Mienye
collection DOAJ
description Deep learning (DL) has become a core component of modern artificial intelligence (AI), driving significant advancements across diverse fields by facilitating the analysis of complex systems, from protein folding in biology to molecular discovery in chemistry and particle interactions in physics. However, the field of deep learning is constantly evolving, with recent innovations in both architectures and applications. Therefore, this paper provides a comprehensive review of recent DL advances, covering the evolution and applications of foundational models like convolutional neural networks (CNNs) and Recurrent Neural Networks (RNNs), as well as recent architectures such as transformers, generative adversarial networks (GANs), capsule networks, and graph neural networks (GNNs). Additionally, the paper discusses novel training techniques, including self-supervised learning, federated learning, and deep reinforcement learning, which further enhance the capabilities of deep learning models. By synthesizing recent developments and identifying current challenges, this paper provides insights into the state of the art and future directions of DL research, offering valuable guidance for both researchers and industry experts.
format Article
id doaj-art-a4fdd9dd772b44d08550bcf1a2e3d0a3
institution Kabale University
issn 2078-2489
language English
publishDate 2024-11-01
publisher MDPI AG
record_format Article
series Information
spelling doaj-art-a4fdd9dd772b44d08550bcf1a2e3d0a32024-12-27T14:30:44ZengMDPI AGInformation2078-24892024-11-01151275510.3390/info15120755A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and ApplicationsIbomoiye Domor Mienye0Theo G. Swart1Institute for Intelligent Systems, University of Johannesburg, Johannesburg 2006, South AfricaInstitute for Intelligent Systems, University of Johannesburg, Johannesburg 2006, South AfricaDeep learning (DL) has become a core component of modern artificial intelligence (AI), driving significant advancements across diverse fields by facilitating the analysis of complex systems, from protein folding in biology to molecular discovery in chemistry and particle interactions in physics. However, the field of deep learning is constantly evolving, with recent innovations in both architectures and applications. Therefore, this paper provides a comprehensive review of recent DL advances, covering the evolution and applications of foundational models like convolutional neural networks (CNNs) and Recurrent Neural Networks (RNNs), as well as recent architectures such as transformers, generative adversarial networks (GANs), capsule networks, and graph neural networks (GNNs). Additionally, the paper discusses novel training techniques, including self-supervised learning, federated learning, and deep reinforcement learning, which further enhance the capabilities of deep learning models. By synthesizing recent developments and identifying current challenges, this paper provides insights into the state of the art and future directions of DL research, offering valuable guidance for both researchers and industry experts.https://www.mdpi.com/2078-2489/15/12/755deep learningGANGRULLMLSTMmachine learning
spellingShingle Ibomoiye Domor Mienye
Theo G. Swart
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Information
deep learning
GAN
GRU
LLM
LSTM
machine learning
title A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
title_full A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
title_fullStr A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
title_full_unstemmed A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
title_short A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
title_sort comprehensive review of deep learning architectures recent advances and applications
topic deep learning
GAN
GRU
LLM
LSTM
machine learning
url https://www.mdpi.com/2078-2489/15/12/755
work_keys_str_mv AT ibomoiyedomormienye acomprehensivereviewofdeeplearningarchitecturesrecentadvancesandapplications
AT theogswart acomprehensivereviewofdeeplearningarchitecturesrecentadvancesandapplications
AT ibomoiyedomormienye comprehensivereviewofdeeplearningarchitecturesrecentadvancesandapplications
AT theogswart comprehensivereviewofdeeplearningarchitecturesrecentadvancesandapplications