Nothing Special   »   [go: up one dir, main page]

Skip to main content

Systematic Analysis of Joint Entity and Relation Extraction Models in Identifying Overlapping Relations

  • Conference paper
  • First Online:
Neural Computing for Advanced Applications (NCAA 2021)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1449))

Included in the following conference series:

Abstract

Named entity recognition and relation extraction are two fundamental tasks in the domain of natural language processing. Joint entity and relation extraction models have attracted more and more attention due to the performance advantage. However, there are difficulties in identifying overlapping relations among the models. To investigate the differences of structures and performances of joint extraction models, this paper implements a list of state-of-the-art joint extraction models and compares their difference in identifying overlapping relations. Experiment results show that the models by separating entity features and relation features work better than the models with feature fusion in identifying overlapping relations on three publicly available datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Liu, L., Wang, D.: A survey of named entity recognition. Inf. Sci. 37(3), 329–340 (2018)

    Google Scholar 

  2. Xu, K., Feng, Y., Huang, S., Zhao, D.: Semantic relation classification via convolutional neural networks. Comput. Sci. 71(7), 132–137 (2015)

    Google Scholar 

  3. Qi, L., Ji, H.: Incremental joint extraction of entity mentions and relations. In: The 52th Annual Meeting of the Association of Computational Linguistics, pp. 402–412 (2014)

    Google Scholar 

  4. Dai, D., Xiao, X., Lyu, Y., Dou, S., Wang, H.: Joint extraction of entities and overlapping relations using position-attentive sequence labeling. In: The AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 6300–6308 (2019)

    Google Scholar 

  5. Tan, Z., Zhao, X., Wang, W., Xiao, W.: Jointly extracting multiple triplets with multilayer translation constraints. In: The AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 7080–7087 (2019)

    Google Scholar 

  6. Miwa, M., Bansal, M.: End-to-end relation extraction using LSTMs on sequences and tree structures. In: The 54th Annual Meeting of the Association of Computational Linguistics, pp. 1105–1116 (2016)

    Google Scholar 

  7. Zheng, S., Wang, F., Bao, H., Zhou, P., Xu, B.: Joint extraction of entities and relations based on a novel tagging scheme. In: The 55th Annual Meeting of the Association of Computational Linguistics, pp. 1227–1236 (2017)

    Google Scholar 

  8. Zeng, X., Zeng, D., He, S., Kang, L., Zhao, J.: Extracting relational facts by an end-to-end neural model with copy mechanism. In: The 56th Annual Meeting of the Association of Computational Linguistics, pp. 506–514 (2018)

    Google Scholar 

  9. Giannis, B., Johannes, D., Thomas, D., Chris, D.: Joint entity recognition and relation extraction as a multi-head selection problem. Expert Syst. Appl. 114(Dec), 34–45 (2018)

    Google Scholar 

  10. Wang, J., Lu, W.: Two are better than one: Joint entity and relation extraction with table-sequence encoders. In: The 2020 Conference on Empirical Methods in Natural Language Processing, pp. 1706–1721 (2020)

    Google Scholar 

  11. Wang,Y., Yu, B., Zhang, Y., Liu, T., Sun, L.: TPLinker: single-stage joint extraction of entities and relations through token pair linking. In: The 28th International Conference on Computational Linguistics, pp. 1572–1582 (2020)

    Google Scholar 

  12. Hoffmann, R., Zhang, C., Xiao, L., Zettlemoyer, L. S., Weld, D. S.: Knowledge-based weak supervision for information extraction of overlapping relations. In: The 49th Annual Meeting of the Association of Computational Linguistics, pp. 541–550 (2011)

    Google Scholar 

  13. Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network. In: The 25th International Conference on Computational Linguistics, pp. 2335–2344 (2014)

    Google Scholar 

  14. Vu, N.T., Adel, H., Gupta, P., Schütze, H.: Combining recurrent and convolutional neural networks for relation classification. In: The 2016 Conference of the North American Chapter of the Association for Computational Linguistics, pp. 534–539 (2016)

    Google Scholar 

  15. Vashishth, S., Joshi, R., Prayaga, S.S., Bhattacharyya, C., Talukdar, P.: RESIDE: improving distantly-supervised neural relation extraction using side information. In: The 2018 Conference on Empirical Methods in Natural Language Processing, pp. 1257–1266 (2018)

    Google Scholar 

  16. Nayak, T., Ng, H.T.: Effective attention modeling for neural relation extraction. In: The 23rd Conference on Computational Natural Language Learning (CoNLL), pp. 603–612 (2019)

    Google Scholar 

  17. Zhao, T., Yan, Z., Cao, Y., Li, Z.: Entity relative position representation based multi-head selection for joint entity and relation extraction. In: Sun, M., Li, S., Zhang, Y., Liu, Y., He, S., Rao, G. (eds.) CCL 2020. LNCS (LNAI), vol. 12522, pp. 184–198. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63031-7_14

    Chapter  Google Scholar 

  18. Zhao, S., Hu, M., Cai, Z., Liu, F.: Modeling dense cross-modal interactions for joint entity-relation extraction. In: The 29th International Joint Conference on Artificial Intelligence, pp. 4032–4038 (2020)

    Google Scholar 

  19. Nayak, T., Ng, H.T.: Effective modeling of encoder-decoder architecture for joint entity and relation extraction. In: The AAAI Conference on Artificial Intelligence, vol. 34, no. 05, pp. 8528–8535 (2020)

    Google Scholar 

  20. Zhang, R.H., Liu, Q., Fan, A.X., Ji, H., Kurohashi, S.: Minimize exposure bias of seq2seq models in joint entity and relation extraction. In: The Association for Computational Linguistics: EMNLP 2020, pp. 236–246 (2020)

    Google Scholar 

  21. Sui, D., Chen, Y., Liu, K., Zhao, J., Liu, S.: Joint entity and relation extraction with set prediction networks. CoRR arXiv:2011.01675 (2020)

  22. Gupta, P., Schütze, H., Andrassy, B.: Table filling multi-task recurrent neural network for joint entity and relation extraction. In: The 26th International Conference on Computational Linguistics (COLING2016), pp. 2537–2547 (2016)

    Google Scholar 

  23. Ma, Y., Hiraoka, T., Okazaki, N.: Named entity recognition and relation extraction using enhanced table filling by Contextualized Representations. CoRR arXiv:2010.07522 (2020)

  24. Zhong, Z., Chen, D.: A frustratingly easy approach for joint entity and relation extraction. CoRR arXiv:2010.12812 (2020)

  25. Riedel, S., Yao, L., McCallum, A.: Modeling relations and their mentions without labeled text. In: Balcázar, J.L., Bonchi, F., Gionis, A., Sebag, M. (eds.) ECML PKDD 2010. LNCS (LNAI), vol. 6323, pp. 148–163. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15939-8_10

    Chapter  Google Scholar 

  26. Roth, D., Yih, W.: A linear programming formulation for global inference in natural language tasks. In: The 8th Conference on Computational Natural Language Learning (CoNLL), pp. 1–4 (2010)

    Google Scholar 

  27. Sam, H., Kevin, B., Michele, F., Amber, S., Ozlem, U.: 2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records. J. Am. Med. Inform. Assoc. 27(1), 3–12 (2020)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China (No. 61772146) and Natural Science Foundation of Guangdong Province (2021A1515011339).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kai Zheng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Luo, Y., Huang, Z., Zheng, K., Hao, T. (2021). Systematic Analysis of Joint Entity and Relation Extraction Models in Identifying Overlapping Relations. In: Zhang, H., Yang, Z., Zhang, Z., Wu, Z., Hao, T. (eds) Neural Computing for Advanced Applications. NCAA 2021. Communications in Computer and Information Science, vol 1449. Springer, Singapore. https://doi.org/10.1007/978-981-16-5188-5_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-5188-5_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-5187-8

  • Online ISBN: 978-981-16-5188-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics