Abstract
The paper proposes a novel method called BPCNNER that enhances boundary information for Chinese nested named entity recognition using prompt learning. The method first involves populating the nested entities into a boundary prompt template based on predefined rules and combining it with the original text. The pre-trained BERT model is then used to obtain semantic features of the text, while the BiLSTM-CRF framework captures contextual information and calculates label dependencies. The experimental results demonstrate that the proposed method achieves an F1 score of 93.02% on the People's Daily dataset, outperforming other models. Therefore, the method is effective in improving Chinese nested named entity recognition, which is a challenging task due to the lack of effective boundary supervision.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Grishman, R., Sundheim, B.: Message Understanding C-onference-6: a Brief History. In: Proceedings of the 16th Conference on Computational Linguistics, pp. 466–471(1996)
Yu, S.Y., Guo, S.M., Huang, R.Y., et al.: Overview of Nested Entity Recognition. Comput. Sci. 48(S2),1–10+29 (2021)
Yu, P., Wang, X.: BERT-based named entity recognition in Chinese twenty-four histories. In: Wang, G., Lin, X., Hendler, J., Song, W., Xu, Z., Liu, G. (eds.) WISA 2020. LNCS, vol. 12432, pp. 289–301. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-60029-7_27
Ma, J., Ballesteros, M., Doss, S., et al.: Label semantics for few shot named entity recognition. In: Annual Meeting of the Association for Computational Linguistics, pp. 1956–1971 (2022)
Zhang, J., Shen, D., Zhou, G., et al.: Enhancing HMM-based biomedical named entity recognition by studying special phenomena. J. Biomed. Inform. 37(6), 411–422 (2001)
Zhou, G.D.: Recognizing names in biomedical texts using mutual information independence model and SVM plus sigmoid. Int. J. Med. Informatics 75(6), 456–467 (2006)
Zhou, J.S., Dai, X.Y., Yin, C.Y., et al.: Automatic recognition of Chinese organization name based on cascaded conditional random fields. Acta Electron. Sin. 34(05), 804–809 (2006)
Liu, F.F., Zhao, J., Xu, B.: Study on multi-scale nested entity mention recognition. J. Chinese Inform. Process. 21(2), 14–21 (2007)
Fu, C., Fu, G.: Morpheme-based Chinese nested named entity recognition. In: Proceedings of the 8th International Conference on Fuzzy Systems and Knowledge Discovery, pp. 1221–1225 (2011)
Ju, M., Miwa, M., Ananiadou S.: A Neural Layered Model for Nested Named Entity Recognition. In: North American Chapter of the Association for Computational Linguistics, pp. 1446–1459 (2018)
Zhang, R.J., Dai, L., Guo, P., et al.: Chinese nested named entity recognition algorithm based on segmentation attention and boundary-aware. Comput. Sci. 50(01), 213–220 (2023)
Jin, Y.L., Xie, J.F., Wu, D.J.: Chinese nested named entity recognition based on hierarchical tagging. J. Shanghai Univ. 28(02), 270–280 (2022)
Muis, A.O., Lu, W.: Labeling gaps between words: recognizing overlapping mentions with mention separators. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 2608–2618 (2017)
Wang, B., Wei, L.: Neural segmental hypergraphs for overlapping mention recognition. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 204–212 (2018)
Fisher, J., Vlachos, A.: Merge and label: a novel neural network architecture for nested NER. In: Annual Meeting of the Association for Computational Linguistics, pp. 5840–5850 (2019)
Luan, Y., Wadden, D., He, L., et al.: A general framework for information extraction using dynamic span graphs. In: North American Chapter of the Association for Computational Linguistics, pp. 3036–3046 (2019)
Brown, T., Mann, B., Ryder, N., et al.: Language models are few-shot learners. Adv. Neural. Inf. Process. Syst. 33, 1877–1901 (2020)
Liu, P., Yuan, W., Fu, J., et al.: Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. arXiv preprint arXiv. 2107.13586 (2021)
Chen, N., Li, X.H.: An Event Extraction Method Based on Template Prompt Learning. Data Analysis and Knowledge Discovery, pp. 1–17, 14 Jan2023
Zhang, B.X., Pu, Z., Cheng, X.: Research on Uyghur Text Classification Based on Prompt Learning. Comput. Eng. 49(06), 292–299+313 (2023)
Cui, L., Wu, Y., Liu, J., et al.: Template-based named entity recognition using BART. In: Findings of the Association for Computational Linguistics, pp. 1835–1845 (2021)
Lee, D.H., Agarwal, M., Kadakia, A., et al.: Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER. arXiv preprint arXiv: 2110.08454 (2021)
Chen, X., Zhang, N., Li, L., et al.: LightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NER. arXiv preprint arXiv: 2109.00720 (2021)
Ma, R., Zhou, X., Gui, T., et al.: Template-free Prompt Tuning for Few-shot NER. arXiv preprint arXiv: 2109.13532 (2021)
Devlin, J., Chang, M.W., Lee, K., et al.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv: 1810.04805 (2018)
Li, Y.Q., He, Y.Q., Qian, L.H., et al.: Chinese nested named entity recognition corpus construction. J. Chinese Inform. Process. 32(08), 19–26 (2018)
Xu, L., Li, S., Wang, Y., et al.: Named entity recognition of BERT-BiLSTM-CRF combined with self-attention. In: Xing, C., Fu, X., Zhang, Y., Zhang, G., Borjigin, C. (eds.) Web Information Systems and Applications: 18th International Conference, WISA 2021, Kaifeng, China, September 24–26, 2021, Proceedings, pp. 556–564. Springer International Publishing, Cham (2021). https://doi.org/10.1007/978-3-030-87571-8_48
Acknowledgement
This work was supported by the National Natural Science Foundation of China (71503108, 62077029), the Research and Practice Innovation Project of Jiangsu Normal University (2022XKT1533).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, Z., Song, M., Zhu, Y., Zhang, L. (2023). Chinese Nested Named Entity Recognition Based on Boundary Prompt. In: Yuan, L., Yang, S., Li, R., Kanoulas, E., Zhao, X. (eds) Web Information Systems and Applications. WISA 2023. Lecture Notes in Computer Science, vol 14094. Springer, Singapore. https://doi.org/10.1007/978-981-99-6222-8_28
Download citation
DOI: https://doi.org/10.1007/978-981-99-6222-8_28
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-6221-1
Online ISBN: 978-981-99-6222-8
eBook Packages: Computer ScienceComputer Science (R0)