Automatic Comparative Chest Radiography Using Deep Neural Networks
Comparative medical radiography is a scientific identification method that involves directly comparing antemortem (AM) radiographs (e.g., X-rays) to postmortem (PM) radiographs taken of a deceased individual. Forensic anthropologists use chest radiographs for comparative radiography due to their ava...
Saved in:
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2025-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/10820523/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1841550741430337536 |
---|---|
author | Redwan Sony Carolyn V. Isaac Alexis Vanbaarle Clara J. Devota Todd Fenton Joseph T. Hefner Arun Ross |
author_facet | Redwan Sony Carolyn V. Isaac Alexis Vanbaarle Clara J. Devota Todd Fenton Joseph T. Hefner Arun Ross |
author_sort | Redwan Sony |
collection | DOAJ |
description | Comparative medical radiography is a scientific identification method that involves directly comparing antemortem (AM) radiographs (e.g., X-rays) to postmortem (PM) radiographs taken of a deceased individual. Forensic anthropologists use chest radiographs for comparative radiography due to their availability through health screening. In this paper, we leverage the power of deep neural networks and expert domain knowledge to create a radiographic identification system based on AM and PM chest radiographs. We compiled a dataset of 5,165 anonymized chest radiographs representing 760 individuals from two databases: NIH Chest X-Ray Database and case files from the Michigan State University Forensic Anthropology Laboratory (MSUFAL). We first manually annotated 3 different regions of interest (ROIs) on the radiographs based on expert domain knowledge, viz., thoracic vertebrae from T1-T5; clavicles; and complete vertebral column. We then explored three families of deep neural networks, each selected for its unique strengths in addressing specific challenges in deep learning for processing these ROIs as well as the entire radiograph. Our experiments reveal several compelling findings: (a) the thoracic vertebrae from T1-T5 results in better recognition performance compared to other regions; (b) Efficient Nets result in better recognition accuracy compared to ResNets and DenseNets; and (c) an ensemble of models based on different networks and different ROIs further improves recognition accuracy. We release the expert annotated MSUFAL dataset and our codebase to advance research in comparative medical radiography for deceased identification. This research marks a significant step forward in forensic radiography, being the first to systematically assess the impact of ROIs for robust human identification. |
format | Article |
id | doaj-art-18f88291c7944dd88902ee4aa0c8cda5 |
institution | Kabale University |
issn | 2169-3536 |
language | English |
publishDate | 2025-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj-art-18f88291c7944dd88902ee4aa0c8cda52025-01-10T00:01:09ZengIEEEIEEE Access2169-35362025-01-01134398441010.1109/ACCESS.2025.352557910820523Automatic Comparative Chest Radiography Using Deep Neural NetworksRedwan Sony0https://orcid.org/0000-0002-0155-1993Carolyn V. Isaac1Alexis Vanbaarle2Clara J. Devota3Todd Fenton4Joseph T. Hefner5https://orcid.org/0000-0001-5535-4410Arun Ross6Department of Computer Science and Engineering, Michigan State University, East Lansing, MI, USADepartment of Anthropology, Michigan State University, East Lansing, MI, USADepartment of Anthropology, Michigan State University, East Lansing, MI, USASchool of Medicine, Wayne State University, Detroit, MI, USADepartment of Anthropology, Michigan State University, East Lansing, MI, USADepartment of Anthropology, Michigan State University, East Lansing, MI, USADepartment of Computer Science and Engineering, Michigan State University, East Lansing, MI, USAComparative medical radiography is a scientific identification method that involves directly comparing antemortem (AM) radiographs (e.g., X-rays) to postmortem (PM) radiographs taken of a deceased individual. Forensic anthropologists use chest radiographs for comparative radiography due to their availability through health screening. In this paper, we leverage the power of deep neural networks and expert domain knowledge to create a radiographic identification system based on AM and PM chest radiographs. We compiled a dataset of 5,165 anonymized chest radiographs representing 760 individuals from two databases: NIH Chest X-Ray Database and case files from the Michigan State University Forensic Anthropology Laboratory (MSUFAL). We first manually annotated 3 different regions of interest (ROIs) on the radiographs based on expert domain knowledge, viz., thoracic vertebrae from T1-T5; clavicles; and complete vertebral column. We then explored three families of deep neural networks, each selected for its unique strengths in addressing specific challenges in deep learning for processing these ROIs as well as the entire radiograph. Our experiments reveal several compelling findings: (a) the thoracic vertebrae from T1-T5 results in better recognition performance compared to other regions; (b) Efficient Nets result in better recognition accuracy compared to ResNets and DenseNets; and (c) an ensemble of models based on different networks and different ROIs further improves recognition accuracy. We release the expert annotated MSUFAL dataset and our codebase to advance research in comparative medical radiography for deceased identification. This research marks a significant step forward in forensic radiography, being the first to systematically assess the impact of ROIs for robust human identification.https://ieeexplore.ieee.org/document/10820523/Anthropologydeep neural networksradiographic identificationregion of interest |
spellingShingle | Redwan Sony Carolyn V. Isaac Alexis Vanbaarle Clara J. Devota Todd Fenton Joseph T. Hefner Arun Ross Automatic Comparative Chest Radiography Using Deep Neural Networks IEEE Access Anthropology deep neural networks radiographic identification region of interest |
title | Automatic Comparative Chest Radiography Using Deep Neural Networks |
title_full | Automatic Comparative Chest Radiography Using Deep Neural Networks |
title_fullStr | Automatic Comparative Chest Radiography Using Deep Neural Networks |
title_full_unstemmed | Automatic Comparative Chest Radiography Using Deep Neural Networks |
title_short | Automatic Comparative Chest Radiography Using Deep Neural Networks |
title_sort | automatic comparative chest radiography using deep neural networks |
topic | Anthropology deep neural networks radiographic identification region of interest |
url | https://ieeexplore.ieee.org/document/10820523/ |
work_keys_str_mv | AT redwansony automaticcomparativechestradiographyusingdeepneuralnetworks AT carolynvisaac automaticcomparativechestradiographyusingdeepneuralnetworks AT alexisvanbaarle automaticcomparativechestradiographyusingdeepneuralnetworks AT clarajdevota automaticcomparativechestradiographyusingdeepneuralnetworks AT toddfenton automaticcomparativechestradiographyusingdeepneuralnetworks AT josephthefner automaticcomparativechestradiographyusingdeepneuralnetworks AT arunross automaticcomparativechestradiographyusingdeepneuralnetworks |