HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classification
Abstract Purpose To develop an end-to-end convolutional neural network model for analyzing hematoxylin and eosin(H&E)-stained histological images, enhancing the performance and efficiency of nuclear segmentation and classification within the digital pathology workflow. Methods We propose a dual-...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-01-01
|
| Series: | BMC Medical Imaging |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12880-025-01550-2 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841544200015839232 |
|---|---|
| author | Junxiao Chen Ruixue Wang Wei Dong Hua He Shiyong Wang |
| author_facet | Junxiao Chen Ruixue Wang Wei Dong Hua He Shiyong Wang |
| author_sort | Junxiao Chen |
| collection | DOAJ |
| description | Abstract Purpose To develop an end-to-end convolutional neural network model for analyzing hematoxylin and eosin(H&E)-stained histological images, enhancing the performance and efficiency of nuclear segmentation and classification within the digital pathology workflow. Methods We propose a dual-mechanism feature pyramid fusion technique that integrates nuclear segmentation and classification tasks to construct the HistoNeXt network model. HistoNeXt utilizes an encoder-decoder architecture, where the encoder, based on the advanced ConvNeXt convolutional framework, efficiently and accurately extracts multi-level abstract features from tissue images. These features are subsequently shared with the decoder. The decoder employs a dual-mechanism architecture: The first branch of the mechanism splits into two parallel paths for nuclear segmentation, producing nuclear pixel (NP) and horizontal and vertical distance (HV) predictions, while the second mechanism branch focuses on type prediction (TP). The NP and HV branches leverage densely connected blocks to facilitate layer-by-layer feature transmission and reuse, while the TP branch employs channel attention to adaptively focus on critical features. Comprehensive data augmentation including morphology-preserving geometric transformations and adaptive H&E channel adjustments was applied. To address class imbalance, type-aware sampling was applied. The model was evaluated on public tissue image datasets including CONSEP, PanNuke, CPM17, and KUMAR. The performance in nuclear segmentation was evaluated using the Dice Similarity Coefficient (DICE), the Aggregated Jaccard Index (AJI) and Panoptic Quality (PQ), and the classification performance was evaluated using F1 scores and category-specific F1 scores. In addition, computational complexity, measured in Giga Floating Point Operations Per Second (GFLOPS), was used as an indicator of resource consumption. Results HistoNeXt demonstrated competitive performance across multiple datasets: achieving a DICE score of 0.874, an AJI of 0.722, and a PQ of 0.689 on the CPM17 dataset; a DICE score of 0.826, an AJI of 0.625, and a PQ of 0.565 on KUMAR; and performance comparable to Transformer-based models, such as CellViT-SAM-H, on PanNuke, with a binary PQ of 0.6794, a multi-class PQ of 0.4940, and an overall F1 score of 0.82. On the CONSEP dataset, it achieved a DICE score of 0.843, an AJI of 0.592, a PQ of 0.532, and an overall classification F1 score of 0.773. Specific F1 scores for various cell types were as follows: 0.653 for malignant or dysplastic epithelial cells, 0.516 for normal epithelial cells, 0.659 for inflammatory cells, and 0.587 for spindle cells. The tiny model’s complexity was 33.7 GFLOPS. Conclusion By integrating novel convolutional technology and employing a pyramid fusion of dual-mechanism characteristics, HistoNeXt enhances both the precision and efficiency of nuclear segmentation and classification. Its low computational complexity makes the model well suited for local deployment in resource-constrained environments, thereby supporting a broad spectrum of clinical and research applications. This represents a significant advance in the application of convolutional neural networks in digital pathology analysis. |
| format | Article |
| id | doaj-art-77b489d760b74254b4d0399e9604855a |
| institution | Kabale University |
| issn | 1471-2342 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Imaging |
| spelling | doaj-art-77b489d760b74254b4d0399e9604855a2025-01-12T12:44:48ZengBMCBMC Medical Imaging1471-23422025-01-0125111610.1186/s12880-025-01550-2HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classificationJunxiao Chen0Ruixue Wang1Wei Dong2Hua He3Shiyong Wang4Department of Information, Third Affiliated Hospital of Naval Medical UniversityDepartment of Neurosurgery, Third Affiliated Hospital of Naval Medical UniversityDepartment of Pathology, Third Affiliated Hospital of Naval Medical UniversityDepartment of Neurosurgery, Third Affiliated Hospital of Naval Medical UniversityDepartment of Information, Third Affiliated Hospital of Naval Medical UniversityAbstract Purpose To develop an end-to-end convolutional neural network model for analyzing hematoxylin and eosin(H&E)-stained histological images, enhancing the performance and efficiency of nuclear segmentation and classification within the digital pathology workflow. Methods We propose a dual-mechanism feature pyramid fusion technique that integrates nuclear segmentation and classification tasks to construct the HistoNeXt network model. HistoNeXt utilizes an encoder-decoder architecture, where the encoder, based on the advanced ConvNeXt convolutional framework, efficiently and accurately extracts multi-level abstract features from tissue images. These features are subsequently shared with the decoder. The decoder employs a dual-mechanism architecture: The first branch of the mechanism splits into two parallel paths for nuclear segmentation, producing nuclear pixel (NP) and horizontal and vertical distance (HV) predictions, while the second mechanism branch focuses on type prediction (TP). The NP and HV branches leverage densely connected blocks to facilitate layer-by-layer feature transmission and reuse, while the TP branch employs channel attention to adaptively focus on critical features. Comprehensive data augmentation including morphology-preserving geometric transformations and adaptive H&E channel adjustments was applied. To address class imbalance, type-aware sampling was applied. The model was evaluated on public tissue image datasets including CONSEP, PanNuke, CPM17, and KUMAR. The performance in nuclear segmentation was evaluated using the Dice Similarity Coefficient (DICE), the Aggregated Jaccard Index (AJI) and Panoptic Quality (PQ), and the classification performance was evaluated using F1 scores and category-specific F1 scores. In addition, computational complexity, measured in Giga Floating Point Operations Per Second (GFLOPS), was used as an indicator of resource consumption. Results HistoNeXt demonstrated competitive performance across multiple datasets: achieving a DICE score of 0.874, an AJI of 0.722, and a PQ of 0.689 on the CPM17 dataset; a DICE score of 0.826, an AJI of 0.625, and a PQ of 0.565 on KUMAR; and performance comparable to Transformer-based models, such as CellViT-SAM-H, on PanNuke, with a binary PQ of 0.6794, a multi-class PQ of 0.4940, and an overall F1 score of 0.82. On the CONSEP dataset, it achieved a DICE score of 0.843, an AJI of 0.592, a PQ of 0.532, and an overall classification F1 score of 0.773. Specific F1 scores for various cell types were as follows: 0.653 for malignant or dysplastic epithelial cells, 0.516 for normal epithelial cells, 0.659 for inflammatory cells, and 0.587 for spindle cells. The tiny model’s complexity was 33.7 GFLOPS. Conclusion By integrating novel convolutional technology and employing a pyramid fusion of dual-mechanism characteristics, HistoNeXt enhances both the precision and efficiency of nuclear segmentation and classification. Its low computational complexity makes the model well suited for local deployment in resource-constrained environments, thereby supporting a broad spectrum of clinical and research applications. This represents a significant advance in the application of convolutional neural networks in digital pathology analysis.https://doi.org/10.1186/s12880-025-01550-2Nuclear segmentationNuclear classificationFeature pyramidConvolutional neural networkDigital pathology |
| spellingShingle | Junxiao Chen Ruixue Wang Wei Dong Hua He Shiyong Wang HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classification BMC Medical Imaging Nuclear segmentation Nuclear classification Feature pyramid Convolutional neural network Digital pathology |
| title | HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classification |
| title_full | HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classification |
| title_fullStr | HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classification |
| title_full_unstemmed | HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classification |
| title_short | HistoNeXt: dual-mechanism feature pyramid network for cell nuclear segmentation and classification |
| title_sort | histonext dual mechanism feature pyramid network for cell nuclear segmentation and classification |
| topic | Nuclear segmentation Nuclear classification Feature pyramid Convolutional neural network Digital pathology |
| url | https://doi.org/10.1186/s12880-025-01550-2 |
| work_keys_str_mv | AT junxiaochen histonextdualmechanismfeaturepyramidnetworkforcellnuclearsegmentationandclassification AT ruixuewang histonextdualmechanismfeaturepyramidnetworkforcellnuclearsegmentationandclassification AT weidong histonextdualmechanismfeaturepyramidnetworkforcellnuclearsegmentationandclassification AT huahe histonextdualmechanismfeaturepyramidnetworkforcellnuclearsegmentationandclassification AT shiyongwang histonextdualmechanismfeaturepyramidnetworkforcellnuclearsegmentationandclassification |