Animal Species Identification in Historical Parchments by Continuous Wavelet Transform–Convolutional Neural Network Classifier Applied to Ultraviolet–Visible–Near-Infrared Spectroscopic Data
Identification of animal species in medieval parchment manuscripts is highly relevant in cultural heritage studies. Usually, species identification is performed with slightly invasive methods. In this study, we propose a contactless methodology based on reflectance spectrophotometry (ultraviolet–vis...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Association for the Advancement of Science (AAAS)
2024-01-01
|
| Series: | Intelligent Computing |
| Online Access: | https://spj.science.org/doi/10.34133/icomputing.0101 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841536296428765184 |
|---|---|
| author | Nicolas Roy Henry Pièrard Julie Bouhy Alexandre Mayer Olivier Deparis David Gravis |
| author_facet | Nicolas Roy Henry Pièrard Julie Bouhy Alexandre Mayer Olivier Deparis David Gravis |
| author_sort | Nicolas Roy |
| collection | DOAJ |
| description | Identification of animal species in medieval parchment manuscripts is highly relevant in cultural heritage studies. Usually, species identification is performed with slightly invasive methods. In this study, we propose a contactless methodology based on reflectance spectrophotometry (ultraviolet–visible–near-infrared) and a machine learning approach for data analysis. Spectra were recorded from both historical and modern parchments crafted from calf, goat, and sheep skins. First, a continuous wavelet transform was performed on the spectral data as a preprocessing step. Then, a semisupervised neural network with a 2-component architecture was applied to the preprocessed data. The network architecture chosen was CWT-CNN (continuous wavelet transform–convolutional neural network), which, in this case, is composed of a convolutional autoencoder and a single-layer dense network classifier. Species classification on holdout historical parchments was attained with a mean accuracy of 79%. The analysis of Shapley additive explanations values highlighted the main spectral ranges responsible for species discrimination. Our study shows that the animal species signature is encoded in a wide band-convoluted wavelength range rather than in specific narrow bands, implying a complex phenotype expression that influences the light scattering by the material. Indeed, the overall skin composition, in both micro- and macroscopic physicochemical properties, is relevant for animal identification in parchment manuscripts. |
| format | Article |
| id | doaj-art-f0823535b03c4d47820eb686d2c40ced |
| institution | Kabale University |
| issn | 2771-5892 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | American Association for the Advancement of Science (AAAS) |
| record_format | Article |
| series | Intelligent Computing |
| spelling | doaj-art-f0823535b03c4d47820eb686d2c40ced2025-01-14T20:44:13ZengAmerican Association for the Advancement of Science (AAAS)Intelligent Computing2771-58922024-01-01310.34133/icomputing.0101Animal Species Identification in Historical Parchments by Continuous Wavelet Transform–Convolutional Neural Network Classifier Applied to Ultraviolet–Visible–Near-Infrared Spectroscopic DataNicolas Roy0Henry Pièrard1Julie Bouhy2Alexandre Mayer3Olivier Deparis4David Gravis5Namur Institute of Structured Matter (NISM), University of Namur, Namur, Belgium.Namur Institute of Structured Matter (NISM), University of Namur, Namur, Belgium.Namur Institute of Structured Matter (NISM), University of Namur, Namur, Belgium.Namur Institute of Structured Matter (NISM), University of Namur, Namur, Belgium.Namur Institute of Structured Matter (NISM), University of Namur, Namur, Belgium.Namur Institute of Structured Matter (NISM), University of Namur, Namur, Belgium.Identification of animal species in medieval parchment manuscripts is highly relevant in cultural heritage studies. Usually, species identification is performed with slightly invasive methods. In this study, we propose a contactless methodology based on reflectance spectrophotometry (ultraviolet–visible–near-infrared) and a machine learning approach for data analysis. Spectra were recorded from both historical and modern parchments crafted from calf, goat, and sheep skins. First, a continuous wavelet transform was performed on the spectral data as a preprocessing step. Then, a semisupervised neural network with a 2-component architecture was applied to the preprocessed data. The network architecture chosen was CWT-CNN (continuous wavelet transform–convolutional neural network), which, in this case, is composed of a convolutional autoencoder and a single-layer dense network classifier. Species classification on holdout historical parchments was attained with a mean accuracy of 79%. The analysis of Shapley additive explanations values highlighted the main spectral ranges responsible for species discrimination. Our study shows that the animal species signature is encoded in a wide band-convoluted wavelength range rather than in specific narrow bands, implying a complex phenotype expression that influences the light scattering by the material. Indeed, the overall skin composition, in both micro- and macroscopic physicochemical properties, is relevant for animal identification in parchment manuscripts.https://spj.science.org/doi/10.34133/icomputing.0101 |
| spellingShingle | Nicolas Roy Henry Pièrard Julie Bouhy Alexandre Mayer Olivier Deparis David Gravis Animal Species Identification in Historical Parchments by Continuous Wavelet Transform–Convolutional Neural Network Classifier Applied to Ultraviolet–Visible–Near-Infrared Spectroscopic Data Intelligent Computing |
| title | Animal Species Identification in Historical Parchments by Continuous Wavelet Transform–Convolutional Neural Network Classifier Applied to Ultraviolet–Visible–Near-Infrared Spectroscopic Data |
| title_full | Animal Species Identification in Historical Parchments by Continuous Wavelet Transform–Convolutional Neural Network Classifier Applied to Ultraviolet–Visible–Near-Infrared Spectroscopic Data |
| title_fullStr | Animal Species Identification in Historical Parchments by Continuous Wavelet Transform–Convolutional Neural Network Classifier Applied to Ultraviolet–Visible–Near-Infrared Spectroscopic Data |
| title_full_unstemmed | Animal Species Identification in Historical Parchments by Continuous Wavelet Transform–Convolutional Neural Network Classifier Applied to Ultraviolet–Visible–Near-Infrared Spectroscopic Data |
| title_short | Animal Species Identification in Historical Parchments by Continuous Wavelet Transform–Convolutional Neural Network Classifier Applied to Ultraviolet–Visible–Near-Infrared Spectroscopic Data |
| title_sort | animal species identification in historical parchments by continuous wavelet transform convolutional neural network classifier applied to ultraviolet visible near infrared spectroscopic data |
| url | https://spj.science.org/doi/10.34133/icomputing.0101 |
| work_keys_str_mv | AT nicolasroy animalspeciesidentificationinhistoricalparchmentsbycontinuouswavelettransformconvolutionalneuralnetworkclassifierappliedtoultravioletvisiblenearinfraredspectroscopicdata AT henrypierard animalspeciesidentificationinhistoricalparchmentsbycontinuouswavelettransformconvolutionalneuralnetworkclassifierappliedtoultravioletvisiblenearinfraredspectroscopicdata AT juliebouhy animalspeciesidentificationinhistoricalparchmentsbycontinuouswavelettransformconvolutionalneuralnetworkclassifierappliedtoultravioletvisiblenearinfraredspectroscopicdata AT alexandremayer animalspeciesidentificationinhistoricalparchmentsbycontinuouswavelettransformconvolutionalneuralnetworkclassifierappliedtoultravioletvisiblenearinfraredspectroscopicdata AT olivierdeparis animalspeciesidentificationinhistoricalparchmentsbycontinuouswavelettransformconvolutionalneuralnetworkclassifierappliedtoultravioletvisiblenearinfraredspectroscopicdata AT davidgravis animalspeciesidentificationinhistoricalparchmentsbycontinuouswavelettransformconvolutionalneuralnetworkclassifierappliedtoultravioletvisiblenearinfraredspectroscopicdata |