Abstract
As health care has become more data-driven in recent years, the amount of data produced has increased. Digital data can take the form of audio, pictures, videos, transcripts, clinical records, electronic medical records, and free text. More records are being generated in health care and these records need to be processed and examined. Examining and interpreting medical data can be a challenging task that takes a significant amount of time, resources, and human effort. It takes a medical expert to complete the laborious work of assessing a large volume of data. Therefore, artificial intelligence technologies are being used to analyze data in health care. The main aim is to build a multi-label classification system that predicts the morbidities that may occur in the future by taking clinical notes as input. The BERT model utilizing the transformer structure is used to cope with the restrictions of the smaller datasets and enhance the overall performance of the model.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Dessì D, Reforgiato Recupero D, Fenu G, Consoli S (2019) A recommender system of medical reports leveraging cognitive computing and frame semantics. In: Tsihrintzis G, Sotiropoulos D, Jain L (eds) Machine learning paradigms. Intelligent systems reference library, vol 149. Springer, Cham. https://doi.org/10.1007/978-3-319-94030-4_2
Rajput K, Chetty G, Davey R (2018) Obesity and co-morbidity detection in clinicaltext using deep learning and machine learning techniques. In: 2018 5th Asia-Pacific World congress on computer science and engineering (APWC on CSE), pp 51–56. https://doi.org/10.1109/APWConCSE.2018.00017
Consoli S, Reforgiato Recupero D, Petkovic M (2019) Data science for healthcare: methodologies and applications. https://doi.org/10.1007/978-3-030-05249-2
Wyber R et al (2015) Big data in global health: improving health in low- and middle-income countries. Bull World Health Organ 93(3):203–208. https://doi.org/10.2471/BLT.14.139022
Gu J, Feng W, Zeng J, Mamitsuka H, Zhu S (2013) Efficient semi-supervised MEDLINE document clustering with MeSH-semantic and global-content constraints. IEEE Trans Cybern 43(4):1265–1276. https://doi.org/10.1109/TSMCB.2012.2227998
Thorsen-Meyer HC, Nielsen AB, Nielsen AP, Kaas- Hansen BS, Toft P, Schierbeck J, Strøm T,Chmura PJ, Heimann M, Dybdahl L, Spangsege L, Hulsen P, Belling K, Brunak S, Perner A (2020) Dynamic and explainable machine learning prediction of mortality in patients in the intensive care unit: a retrospective study of high- frequency data in electronic patient records. Lancet Digit Health
Wei Q, Ji Z, Si Y, Du J, Wang J, Tiryaki F, Wu S, Tao C, Roberts K, Xu H (2020) Relation extraction from clinical narratives using pre-trained language models. AMIA Annu Symp Proc 2019:1236–1245. PMID: 32308921; PMCID: PMC7153059
Uijen AA, van de Lisdonk EH (2008) Multimorbidity in primary care: prevalence and trend over the last 20 years. Eur J Gen Pract 14(Suppl 1):28–32. https://doi.org/10.1080/13814780802436093. PMID: 18949641
Waheeb S, Khan N (2020) Machine learning based sentiment text classification for evaluating treatment quality of discharge summary. Information (Switzerland) 11:17. https://doi.org/10.3390/info11050281
Jain D, Singh V (2018) Feature selection and classification systems for chronic disease prediction: a review. Egyptian Inf J 19(3)
Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributedrepresentations of words and phrases and their compositionality. In Advance in neural information processing systems, pp 3111–3119
Pennington J, Socher R, Manning C (2014) GloVe: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Doha, Qatar. Association for Computational Linguistics, pp 1532–1543
Joulin A, Grave E, Bojanowski P, Mikolov T (2017) Bag of tricks for efficient text classification. In: Proceedings of the 15th conference of the european chapter of the association for computational linguistics: Vol 2, Short Papers. Valencia, Spain. Association for Computational Linguistics, pp 427–431
Kumar V, Recupero DR, Riboni D, Helaoui R (2021) Ensembling classical machine learning and deep learning approaches for morbidity identification from clinical notes. IEEE Access 9:7107–7126. https://doi.org/10.1109/ACCESS.2020.3043221
Hossin M, Sulaiman MN (2015) A review on evaluation metrics for data classification evaluations. Int J Data Mining Knowl Manage Process (IJDKP) 5(2)
Blum RW, Bastos FIPM, Kabiru C, Le LC et al (2012) Adolescent health in the 21st century. The Lancet
Sawyer SM, Drew S, Yeo MS, Britto MT (2007) Adolescents with a chronic condition: challenges living, challenges treating. The Lancet 369(9571):1481–1489
Mercer S, Furler J, Moffat K, Fischbacher- Smith D, Sanci L (2016) Multimorbidity:technical series on safer primary care. World Health Organ
Bromuri S, Zufferey D, Hennebert J, Schumacher M (2014) Multi-label classification of chronically ill patients with bag of words and supervised dimensionality reduction algorithms. J Biomed Inform 51:165–175
Ambert KH, Cohen AM (2009) A system for classifying disease comorbidity status from medical discharge summaries using automated hotspot and negated concept detection. J Ams Med Inf Assoc: JAMIA 16(4):590–5. https://doi.org/10.1197/jamia.M3095
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Bhavyashree, H.L., Varaprasad, G. (2023). Morbidity Detection from Clinical Text Data Using Artificial Intelligence Technique. In: Sharma, N., Goje, A., Chakrabarti, A., Bruckstein, A.M. (eds) Data Management, Analytics and Innovation. ICDMAI 2023. Lecture Notes in Networks and Systems, vol 662. Springer, Singapore. https://doi.org/10.1007/978-981-99-1414-2_29
Download citation
DOI: https://doi.org/10.1007/978-981-99-1414-2_29
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-1413-5
Online ISBN: 978-981-99-1414-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)