Single Infrared Super-Resolution via a Shifted Full-Scale Non-Local Network

Image super-resolution technology can reduce the cost and complexity of acquiring high-resolution infrared thermal images. In this study, we propose a novel end-to-end single infrared super-resolution network based on shifted full-scale non-local residual block. A full-scale non-local mechanism is f...

Full description

Saved in:
Bibliographic Details
Main Authors: Honghong Lu, Zhenhua Li
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10713218/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841533418296311808
author Honghong Lu
Zhenhua Li
author_facet Honghong Lu
Zhenhua Li
author_sort Honghong Lu
collection DOAJ
description Image super-resolution technology can reduce the cost and complexity of acquiring high-resolution infrared thermal images. In this study, we propose a novel end-to-end single infrared super-resolution network based on shifted full-scale non-local residual block. A full-scale non-local mechanism is first proposed to enhance the channel and spatial dependencies of the intra-frame feature map. Based on this mechanism, a shifted full-scale non-local residual block is constructed. By confining full-scale non-local to local windows while allowing for shifted-window connectivity, full-scale non-local residual block solves the problem that existed non-local structures are difficult to be reused and serves as backbone for super-resolution network. Qualitative and quantitative evaluation results show that our method has better performance on benchmark datasets of Set5, Set14, BSD100, and the self-built infrared dataset under the up-sample factor of <inline-formula> <tex-math notation="LaTeX">$\times 2$ </tex-math></inline-formula>, <inline-formula> <tex-math notation="LaTeX">$\times 3$ </tex-math></inline-formula>, and <inline-formula> <tex-math notation="LaTeX">$\times 4$ </tex-math></inline-formula>.
format Article
id doaj-art-7fe2953ce1994bb8bd4d3e49406b7028
institution Kabale University
issn 2169-3536
language English
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-7fe2953ce1994bb8bd4d3e49406b70282025-01-16T00:01:35ZengIEEEIEEE Access2169-35362024-01-011217852317853510.1109/ACCESS.2024.346474710713218Single Infrared Super-Resolution via a Shifted Full-Scale Non-Local NetworkHonghong Lu0Zhenhua Li1Faculty of Science, Nanjing University of Science and Technology, Nanjing, Jiangsu, ChinaFaculty of Science, Nanjing University of Science and Technology, Nanjing, Jiangsu, ChinaImage super-resolution technology can reduce the cost and complexity of acquiring high-resolution infrared thermal images. In this study, we propose a novel end-to-end single infrared super-resolution network based on shifted full-scale non-local residual block. A full-scale non-local mechanism is first proposed to enhance the channel and spatial dependencies of the intra-frame feature map. Based on this mechanism, a shifted full-scale non-local residual block is constructed. By confining full-scale non-local to local windows while allowing for shifted-window connectivity, full-scale non-local residual block solves the problem that existed non-local structures are difficult to be reused and serves as backbone for super-resolution network. Qualitative and quantitative evaluation results show that our method has better performance on benchmark datasets of Set5, Set14, BSD100, and the self-built infrared dataset under the up-sample factor of <inline-formula> <tex-math notation="LaTeX">$\times 2$ </tex-math></inline-formula>, <inline-formula> <tex-math notation="LaTeX">$\times 3$ </tex-math></inline-formula>, and <inline-formula> <tex-math notation="LaTeX">$\times 4$ </tex-math></inline-formula>.https://ieeexplore.ieee.org/document/10713218/Convolution neural networkfull-scale non-localself-attention mechanismshifted full-scale non-local residual blocksingle infrared super-solution
spellingShingle Honghong Lu
Zhenhua Li
Single Infrared Super-Resolution via a Shifted Full-Scale Non-Local Network
IEEE Access
Convolution neural network
full-scale non-local
self-attention mechanism
shifted full-scale non-local residual block
single infrared super-solution
title Single Infrared Super-Resolution via a Shifted Full-Scale Non-Local Network
title_full Single Infrared Super-Resolution via a Shifted Full-Scale Non-Local Network
title_fullStr Single Infrared Super-Resolution via a Shifted Full-Scale Non-Local Network
title_full_unstemmed Single Infrared Super-Resolution via a Shifted Full-Scale Non-Local Network
title_short Single Infrared Super-Resolution via a Shifted Full-Scale Non-Local Network
title_sort single infrared super resolution via a shifted full scale non local network
topic Convolution neural network
full-scale non-local
self-attention mechanism
shifted full-scale non-local residual block
single infrared super-solution
url https://ieeexplore.ieee.org/document/10713218/
work_keys_str_mv AT honghonglu singleinfraredsuperresolutionviaashiftedfullscalenonlocalnetwork
AT zhenhuali singleinfraredsuperresolutionviaashiftedfullscalenonlocalnetwork