Abstract
Named Entity Recognition (NER) is an essential task in natural language processing, especially in the domain of scientific texts. This paper presents a study of NER for scientific texts in high-temperature steel, a type of alloy used in various applications where high temperatures prevail. We propose a NER system using Bi-LSTM with a domain-specific embedding approach and evaluate its performance on a test dataset. The study results show that the proposed NER system achieves an F1 score of 0.99, indicating that it can accurately identify and classify named entities in scientific texts about high-temperature steel with high precision and recall. The proposed approach was more effective than the classical machine learning-based approach. Our results suggest that the domain-specific embedded Bi-LSTM technique can be an effective approach for NER in scientific texts, especially in specialized domains such as high-temperature steel.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Beltagy, I., Lo, K., Cohan, A.: SciBERT: a pretrained language model for scientific text. arXiv preprint arXiv:1903.10676 (2019)
Cruse, K., et al.: Text-mined dataset of gold nanoparticle synthesis procedures, morphologies, and size entities. Sci. Data 9(1), 234 (2022)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics, Minneapolis, Minnesota (2019). https://doi.org/10.18653/v1/N19-1423. https://aclanthology.org/N19-1423
Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5–6), 602–610 (2005)
Gupta, T., Zaki, M., Krishnan, N.A.: MatSciBERT: a materials domain language model for text mining and information extraction. NPJ Comput. Mater. 8(1), 102 (2022)
Ho, T.K.: Random decision forests. In: Proceedings of 3rd International Conference on Document Analysis and Recognition. vol. 1, pp. 278–282 (1995)
Islam, S.S., Haque, M.S., Miah, M.S.U., Sarwar, T.B., Nugraha, R.: Application of machine learning algorithms to predict the thyroid disease risk: an experimental comparative study. PeerJ Comput. Sci. 8, e898 (2022)
Kim, E., et al.: Inorganic materials synthesis planning with literature-trained neural networks. J. Chem. Inf. Model. 60(3), 1194–1201 (2020)
Meetham, G.W.: High-temperature materials - a general review. J. Mater. Sci. 26(4), 853–860 (1991). https://doi.org/10.1007/BF00576759
Miah, M.S.U., Sulaiman, J., Ferdous, I.U., Sarwar, T.B.: TP-NER: a named entity recognition dataset of target and precursor named entities for high-temperature steel (2022). https://doi.org/10.17632/5ZNG6KHY9H.1. https://data.mendeley.com/datasets/5zng6khy9h/1
Miah, M.S.U., et al.: Sentence boundary extraction from scientific literature of electric double layer capacitor domain: tools and techniques. Appl. Sci. 12(3), 1352 (2022)
Rish, I., et al.: An empirical study of the Naive Bayes classifier. In: IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, vol. 3, pp. 41–46 (2001)
Rokach, L.: Decision forest: twenty years of research. Inf. Fusion 27, 111–125 (2016)
Sharma, A., Amrita, Chakraborty, S., Kumar, S.: Named entity recognition in natural language processing: a systematic review. In: Gupta, D., Khanna, A., Kansal, V., Fortino, G., Hassanien, A.E. (eds.) Proceedings of Second Doctoral Symposium on Computational Intelligence. Advances in Intelligent Systems and Computing, vol. 1374, pp. 817–828. Springer, Singapore (2022). https://doi.org/10.1007/978-981-16-3346-1_66
UMP Library: e-Resource UMP Lib (2022). https://login.ezproxy.ump.edu.my/login
Wang, W., et al.: Automated pipeline for superalloy data by text mining. NPJ Comput. Mater. 8(1), 9 (2022)
Acknowledgment
This research was supported by the Post Graduate Research Scheme of Universiti Malaysia Pahang entitled: An automated knowledge-based framework for EDLC using deep learning approach, PGRS220337.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Miah, M.S.U., Sulaiman, J., Sarwar, T.B., Ferdous, I.U., Islam, S.S., Haque, M.S. (2023). Target and Precursor Named Entities Recognition from Scientific Texts of High-Temperature Steel Using Deep Neural Network. In: Strauss, C., Amagasa, T., Kotsis, G., Tjoa, A.M., Khalil, I. (eds) Database and Expert Systems Applications. DEXA 2023. Lecture Notes in Computer Science, vol 14147. Springer, Cham. https://doi.org/10.1007/978-3-031-39821-6_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-39821-6_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-39820-9
Online ISBN: 978-3-031-39821-6
eBook Packages: Computer ScienceComputer Science (R0)