Automatic Comparative Chest Radiography Using Deep Neural Networks

Comparative medical radiography is a scientific identification method that involves directly comparing antemortem (AM) radiographs (e.g., X-rays) to postmortem (PM) radiographs taken of a deceased individual. Forensic anthropologists use chest radiographs for comparative radiography due to their ava...

Full description

Saved in:
Bibliographic Details
Main Authors: Redwan Sony, Carolyn V. Isaac, Alexis Vanbaarle, Clara J. Devota, Todd Fenton, Joseph T. Hefner, Arun Ross
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10820523/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841550741430337536
author Redwan Sony
Carolyn V. Isaac
Alexis Vanbaarle
Clara J. Devota
Todd Fenton
Joseph T. Hefner
Arun Ross
author_facet Redwan Sony
Carolyn V. Isaac
Alexis Vanbaarle
Clara J. Devota
Todd Fenton
Joseph T. Hefner
Arun Ross
author_sort Redwan Sony
collection DOAJ
description Comparative medical radiography is a scientific identification method that involves directly comparing antemortem (AM) radiographs (e.g., X-rays) to postmortem (PM) radiographs taken of a deceased individual. Forensic anthropologists use chest radiographs for comparative radiography due to their availability through health screening. In this paper, we leverage the power of deep neural networks and expert domain knowledge to create a radiographic identification system based on AM and PM chest radiographs. We compiled a dataset of 5,165 anonymized chest radiographs representing 760 individuals from two databases: NIH Chest X-Ray Database and case files from the Michigan State University Forensic Anthropology Laboratory (MSUFAL). We first manually annotated 3 different regions of interest (ROIs) on the radiographs based on expert domain knowledge, viz., thoracic vertebrae from T1-T5; clavicles; and complete vertebral column. We then explored three families of deep neural networks, each selected for its unique strengths in addressing specific challenges in deep learning for processing these ROIs as well as the entire radiograph. Our experiments reveal several compelling findings: (a) the thoracic vertebrae from T1-T5 results in better recognition performance compared to other regions; (b) Efficient Nets result in better recognition accuracy compared to ResNets and DenseNets; and (c) an ensemble of models based on different networks and different ROIs further improves recognition accuracy. We release the expert annotated MSUFAL dataset and our codebase to advance research in comparative medical radiography for deceased identification. This research marks a significant step forward in forensic radiography, being the first to systematically assess the impact of ROIs for robust human identification.
format Article
id doaj-art-18f88291c7944dd88902ee4aa0c8cda5
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-18f88291c7944dd88902ee4aa0c8cda52025-01-10T00:01:09ZengIEEEIEEE Access2169-35362025-01-01134398441010.1109/ACCESS.2025.352557910820523Automatic Comparative Chest Radiography Using Deep Neural NetworksRedwan Sony0https://orcid.org/0000-0002-0155-1993Carolyn V. Isaac1Alexis Vanbaarle2Clara J. Devota3Todd Fenton4Joseph T. Hefner5https://orcid.org/0000-0001-5535-4410Arun Ross6Department of Computer Science and Engineering, Michigan State University, East Lansing, MI, USADepartment of Anthropology, Michigan State University, East Lansing, MI, USADepartment of Anthropology, Michigan State University, East Lansing, MI, USASchool of Medicine, Wayne State University, Detroit, MI, USADepartment of Anthropology, Michigan State University, East Lansing, MI, USADepartment of Anthropology, Michigan State University, East Lansing, MI, USADepartment of Computer Science and Engineering, Michigan State University, East Lansing, MI, USAComparative medical radiography is a scientific identification method that involves directly comparing antemortem (AM) radiographs (e.g., X-rays) to postmortem (PM) radiographs taken of a deceased individual. Forensic anthropologists use chest radiographs for comparative radiography due to their availability through health screening. In this paper, we leverage the power of deep neural networks and expert domain knowledge to create a radiographic identification system based on AM and PM chest radiographs. We compiled a dataset of 5,165 anonymized chest radiographs representing 760 individuals from two databases: NIH Chest X-Ray Database and case files from the Michigan State University Forensic Anthropology Laboratory (MSUFAL). We first manually annotated 3 different regions of interest (ROIs) on the radiographs based on expert domain knowledge, viz., thoracic vertebrae from T1-T5; clavicles; and complete vertebral column. We then explored three families of deep neural networks, each selected for its unique strengths in addressing specific challenges in deep learning for processing these ROIs as well as the entire radiograph. Our experiments reveal several compelling findings: (a) the thoracic vertebrae from T1-T5 results in better recognition performance compared to other regions; (b) Efficient Nets result in better recognition accuracy compared to ResNets and DenseNets; and (c) an ensemble of models based on different networks and different ROIs further improves recognition accuracy. We release the expert annotated MSUFAL dataset and our codebase to advance research in comparative medical radiography for deceased identification. This research marks a significant step forward in forensic radiography, being the first to systematically assess the impact of ROIs for robust human identification.https://ieeexplore.ieee.org/document/10820523/Anthropologydeep neural networksradiographic identificationregion of interest
spellingShingle Redwan Sony
Carolyn V. Isaac
Alexis Vanbaarle
Clara J. Devota
Todd Fenton
Joseph T. Hefner
Arun Ross
Automatic Comparative Chest Radiography Using Deep Neural Networks
IEEE Access
Anthropology
deep neural networks
radiographic identification
region of interest
title Automatic Comparative Chest Radiography Using Deep Neural Networks
title_full Automatic Comparative Chest Radiography Using Deep Neural Networks
title_fullStr Automatic Comparative Chest Radiography Using Deep Neural Networks
title_full_unstemmed Automatic Comparative Chest Radiography Using Deep Neural Networks
title_short Automatic Comparative Chest Radiography Using Deep Neural Networks
title_sort automatic comparative chest radiography using deep neural networks
topic Anthropology
deep neural networks
radiographic identification
region of interest
url https://ieeexplore.ieee.org/document/10820523/
work_keys_str_mv AT redwansony automaticcomparativechestradiographyusingdeepneuralnetworks
AT carolynvisaac automaticcomparativechestradiographyusingdeepneuralnetworks
AT alexisvanbaarle automaticcomparativechestradiographyusingdeepneuralnetworks
AT clarajdevota automaticcomparativechestradiographyusingdeepneuralnetworks
AT toddfenton automaticcomparativechestradiographyusingdeepneuralnetworks
AT josephthefner automaticcomparativechestradiographyusingdeepneuralnetworks
AT arunross automaticcomparativechestradiographyusingdeepneuralnetworks