Clinical XLNet-based End-to-End Knowledge Discovery on Clinical Text Data using Natural Language Processing
A modern framework for assessing patient histories and conducting clinical research has been developed as the number of clinical narratives evolves. To discover the knowledge from such clinical narratives, clinical entity recognition and relation extraction tasks were performed subsequently in exist...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wolters Kluwer Medknow Publications
2024-12-01
|
Series: | Journal of the Scientific Society |
Subjects: | |
Online Access: | https://journals.lww.com/10.4103/jss.jss_73_23 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1841556597121220608 |
---|---|
author | Naveen S. Pagad Pradeep Nijalingappa Tulika Chakrabarti Prasun Chakrabarti Pugazhenthan Thangaraju |
author_facet | Naveen S. Pagad Pradeep Nijalingappa Tulika Chakrabarti Prasun Chakrabarti Pugazhenthan Thangaraju |
author_sort | Naveen S. Pagad |
collection | DOAJ |
description | A modern framework for assessing patient histories and conducting clinical research has been developed as the number of clinical narratives evolves. To discover the knowledge from such clinical narratives, clinical entity recognition and relation extraction tasks were performed subsequently in existing approaches, which resulted in error propagation. Therefore, a novel end-to-end clinical knowledge discovery strategy has been proposed in this paper. The clinical XLNet was used as a base model for handling the discrepancy issue. To predict the dependent clinical relation association, the multinomial Naïve Bayes probability function has been incorporated. In order to improve the performance of the proposed strategy, it takes into account entity pairs presented consecutively through the multi-head attention layer. Tests have been conducted using the N2C2 corpus, and the proposed methodology achieves a greater than 20% improvement in accuracy over existing neural network-based and transformer-based methods. |
format | Article |
id | doaj-art-bd79a71447d14458af3f36402ae94c11 |
institution | Kabale University |
issn | 0974-5009 2278-7127 |
language | English |
publishDate | 2024-12-01 |
publisher | Wolters Kluwer Medknow Publications |
record_format | Article |
series | Journal of the Scientific Society |
spelling | doaj-art-bd79a71447d14458af3f36402ae94c112025-01-07T07:23:01ZengWolters Kluwer Medknow PublicationsJournal of the Scientific Society0974-50092278-71272024-12-0151451152110.4103/jss.jss_73_23Clinical XLNet-based End-to-End Knowledge Discovery on Clinical Text Data using Natural Language ProcessingNaveen S. PagadPradeep NijalingappaTulika ChakrabartiPrasun ChakrabartiPugazhenthan ThangarajuA modern framework for assessing patient histories and conducting clinical research has been developed as the number of clinical narratives evolves. To discover the knowledge from such clinical narratives, clinical entity recognition and relation extraction tasks were performed subsequently in existing approaches, which resulted in error propagation. Therefore, a novel end-to-end clinical knowledge discovery strategy has been proposed in this paper. The clinical XLNet was used as a base model for handling the discrepancy issue. To predict the dependent clinical relation association, the multinomial Naïve Bayes probability function has been incorporated. In order to improve the performance of the proposed strategy, it takes into account entity pairs presented consecutively through the multi-head attention layer. Tests have been conducted using the N2C2 corpus, and the proposed methodology achieves a greater than 20% improvement in accuracy over existing neural network-based and transformer-based methods.https://journals.lww.com/10.4103/jss.jss_73_23clinical xlnetelectronic health recordentity recognitionknowledge discoverynatural language processingrelation extraction |
spellingShingle | Naveen S. Pagad Pradeep Nijalingappa Tulika Chakrabarti Prasun Chakrabarti Pugazhenthan Thangaraju Clinical XLNet-based End-to-End Knowledge Discovery on Clinical Text Data using Natural Language Processing Journal of the Scientific Society clinical xlnet electronic health record entity recognition knowledge discovery natural language processing relation extraction |
title | Clinical XLNet-based End-to-End Knowledge Discovery on Clinical Text Data using Natural Language Processing |
title_full | Clinical XLNet-based End-to-End Knowledge Discovery on Clinical Text Data using Natural Language Processing |
title_fullStr | Clinical XLNet-based End-to-End Knowledge Discovery on Clinical Text Data using Natural Language Processing |
title_full_unstemmed | Clinical XLNet-based End-to-End Knowledge Discovery on Clinical Text Data using Natural Language Processing |
title_short | Clinical XLNet-based End-to-End Knowledge Discovery on Clinical Text Data using Natural Language Processing |
title_sort | clinical xlnet based end to end knowledge discovery on clinical text data using natural language processing |
topic | clinical xlnet electronic health record entity recognition knowledge discovery natural language processing relation extraction |
url | https://journals.lww.com/10.4103/jss.jss_73_23 |
work_keys_str_mv | AT naveenspagad clinicalxlnetbasedendtoendknowledgediscoveryonclinicaltextdatausingnaturallanguageprocessing AT pradeepnijalingappa clinicalxlnetbasedendtoendknowledgediscoveryonclinicaltextdatausingnaturallanguageprocessing AT tulikachakrabarti clinicalxlnetbasedendtoendknowledgediscoveryonclinicaltextdatausingnaturallanguageprocessing AT prasunchakrabarti clinicalxlnetbasedendtoendknowledgediscoveryonclinicaltextdatausingnaturallanguageprocessing AT pugazhenthanthangaraju clinicalxlnetbasedendtoendknowledgediscoveryonclinicaltextdatausingnaturallanguageprocessing |