Virtual restoration of ancient tomb murals based on hyperspectral imaging
Abstract The virtual restoration of historic murals holds immense importance in the realm of cultural heritage preservation. Currently, there are three primary technical issues. First and foremost, it is imperative to delineate the precise location where the mural necessitates restoration. Second, t...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2024-11-01
|
| Series: | Heritage Science |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40494-024-01501-0 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846158316166709248 |
|---|---|
| author | Zimu Zeng Shi Qiu Pengchang Zhang Xingjia Tang Siyuan Li Xuebin Liu Bingliang Hu |
| author_facet | Zimu Zeng Shi Qiu Pengchang Zhang Xingjia Tang Siyuan Li Xuebin Liu Bingliang Hu |
| author_sort | Zimu Zeng |
| collection | DOAJ |
| description | Abstract The virtual restoration of historic murals holds immense importance in the realm of cultural heritage preservation. Currently, there are three primary technical issues. First and foremost, it is imperative to delineate the precise location where the mural necessitates restoration. Second, the original color of the mural has changed over time, resulting in a difference from its current appearance. Then, while the method utilizing convolutional neural networks is effective in restoring small defaced areas of murals, its effectiveness significantly diminishes when applied to larger areas. The primary objectives of this paper are as follows: (1) To determine the large and small areas to be restored, the authors employ hyperspectral super-pixel segmentation and support vector machine-Markov random field (SVM-MRF) classification. (2) The authors transform the hyperspectral mural images into more realistic and accurate red-green-blue (RGB) images using the Commission Internationale de l’Eclairage (CIE) standard colorimetric system. (3) The authors restored the images respectively using convolutional neural network and matching image block-based approaches depending on the size of the areas to be mended. The proposed method has enhanced the image quality assessment (IQA) in terms of both color quality and restoration effects. In contrast to the pseudo-color fusion method, the color optimization algorithm described in this research enhances the multi-scale image quality (MUSIQ) by 8.42%. The suggested technique enhances MUSIQ by 2.41% when compared to the convolutional neural network-based image inpainting algorithm. |
| format | Article |
| id | doaj-art-63c2d05df66a4a08b1c9e20c9c6fdda6 |
| institution | Kabale University |
| issn | 2050-7445 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Heritage Science |
| spelling | doaj-art-63c2d05df66a4a08b1c9e20c9c6fdda62024-11-24T12:38:17ZengSpringerOpenHeritage Science2050-74452024-11-0112111810.1186/s40494-024-01501-0Virtual restoration of ancient tomb murals based on hyperspectral imagingZimu Zeng0Shi Qiu1Pengchang Zhang2Xingjia Tang3Siyuan Li4Xuebin Liu5Bingliang Hu6Key Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of SciencesKey Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of SciencesKey Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of SciencesInstitute of Culture and Heritage, Northwest Polytechnic UniversityKey Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of SciencesKey Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of SciencesKey Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of SciencesAbstract The virtual restoration of historic murals holds immense importance in the realm of cultural heritage preservation. Currently, there are three primary technical issues. First and foremost, it is imperative to delineate the precise location where the mural necessitates restoration. Second, the original color of the mural has changed over time, resulting in a difference from its current appearance. Then, while the method utilizing convolutional neural networks is effective in restoring small defaced areas of murals, its effectiveness significantly diminishes when applied to larger areas. The primary objectives of this paper are as follows: (1) To determine the large and small areas to be restored, the authors employ hyperspectral super-pixel segmentation and support vector machine-Markov random field (SVM-MRF) classification. (2) The authors transform the hyperspectral mural images into more realistic and accurate red-green-blue (RGB) images using the Commission Internationale de l’Eclairage (CIE) standard colorimetric system. (3) The authors restored the images respectively using convolutional neural network and matching image block-based approaches depending on the size of the areas to be mended. The proposed method has enhanced the image quality assessment (IQA) in terms of both color quality and restoration effects. In contrast to the pseudo-color fusion method, the color optimization algorithm described in this research enhances the multi-scale image quality (MUSIQ) by 8.42%. The suggested technique enhances MUSIQ by 2.41% when compared to the convolutional neural network-based image inpainting algorithm.https://doi.org/10.1186/s40494-024-01501-0MuralsVirtual restorationHyperspectral imagingColor optimization |
| spellingShingle | Zimu Zeng Shi Qiu Pengchang Zhang Xingjia Tang Siyuan Li Xuebin Liu Bingliang Hu Virtual restoration of ancient tomb murals based on hyperspectral imaging Heritage Science Murals Virtual restoration Hyperspectral imaging Color optimization |
| title | Virtual restoration of ancient tomb murals based on hyperspectral imaging |
| title_full | Virtual restoration of ancient tomb murals based on hyperspectral imaging |
| title_fullStr | Virtual restoration of ancient tomb murals based on hyperspectral imaging |
| title_full_unstemmed | Virtual restoration of ancient tomb murals based on hyperspectral imaging |
| title_short | Virtual restoration of ancient tomb murals based on hyperspectral imaging |
| title_sort | virtual restoration of ancient tomb murals based on hyperspectral imaging |
| topic | Murals Virtual restoration Hyperspectral imaging Color optimization |
| url | https://doi.org/10.1186/s40494-024-01501-0 |
| work_keys_str_mv | AT zimuzeng virtualrestorationofancienttombmuralsbasedonhyperspectralimaging AT shiqiu virtualrestorationofancienttombmuralsbasedonhyperspectralimaging AT pengchangzhang virtualrestorationofancienttombmuralsbasedonhyperspectralimaging AT xingjiatang virtualrestorationofancienttombmuralsbasedonhyperspectralimaging AT siyuanli virtualrestorationofancienttombmuralsbasedonhyperspectralimaging AT xuebinliu virtualrestorationofancienttombmuralsbasedonhyperspectralimaging AT binglianghu virtualrestorationofancienttombmuralsbasedonhyperspectralimaging |