Abstract
In this paper, we present an overview of the Chinese Essay Discourse Coherence Evaluation task in the NLPCC 2023 shared tasks. We give detailed descriptions of the task definition and the data for training as well as evaluation. We also summarize the approaches investigated by the participants of this task. Such approaches demonstrate the state-of-the-art of discourse coherence evaluation for Chinese essay. The data set and evaluation tool used by this task is available at https://github.com/cubenlp/NLPCC-2023-Shared-Task7.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Burstein, J., Doran, C., Solorio, T. (eds.) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2–7, 2019, Volume 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/n19-1423
Farag, Y., Yannakoudakis, H., Briscoe, T.: Neural automated essay scoring and coherence modeling for adversarially crafted input. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 263–271. Association for Computational Linguistics, New Orleans, Louisiana (2018). https://doi.org/10.18653/v1/N18-1024, aclanthology.org/N18-1024
Flansmose Mikkelsen, L., Kinch, O., Jess Pedersen, A., Lacroix, O.: DDisCo: a discourse coherence dataset for Danish. In: Proceedings of the Thirteenth Language Resources and Evaluation Conference, pp. 2440–2445. European Language Resources Association, Marseille, France (2022). http://aclanthology.org/2022.lrec-1.260
Guan, J., Mao, X., Fan, C., Liu, Z., Ding, W., Huang, M.: Long text generation by modeling sentence-level and discourse-level coherence. In: Zong, C., Xia, F., Li, W., Navigli, R. (eds.) Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1–6, 2021. pp. 6379–6393. Association for Computational Linguistics (2021). https://doi.org/10.18653/v1/2021.acl-long.499
Lai, A., Tetreault, J.: Discourse coherence in the wild: a dataset, evaluation and methods. In: Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue, pp. 214–223. Association for Computational Linguistics, Melbourne, Australia (2018). https://doi.org/10.18653/v1/W18-5023, http://aclanthology.org/W18-5023
Lin, Z., Ng, H.T., Kan, M.: Automatically evaluating text coherence using discourse relations. In: Lin, D., Matsumoto, Y., Mihalcea, R. (eds.) The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 19–24 June, 2011, Portland, Oregon, USA, pp. 997–1006. The Association for Computer Linguistics (2011), aclanthology.org/P11-1100/
Long, W., Webber, B., Xiong, D.: TED-CDB: a large-scale Chinese discourse relation dataset on TED talks. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 2793–2803. Association for Computational Linguistics, Online (2020). https://doi.org/10.18653/v1/2020.emnlp-main.223, aclanthology.org/2020.emnlp-main.223
Lu, Y., et al.: Unified structure generation for universal information extraction. In: Muresan, S., Nakov, P., Villavicencio, A. (eds.) Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22–27, 2022, pp. 5755–5772. Association for Computational Linguistics (2022). https://doi.org/10.18653/v1/2022.acl-long.395
Shrivastava, D., Mishra, A., Sankaranarayanan, K.: Modeling topical coherence in discourse without supervision. CoRR abs/1809.00410 (2018). arxiv.org/abs/1809.00410
Sileo, D., de Cruys, T.V., Pradel, C., Muller, P.: Mining discourse markers for unsupervised sentence representation learning. In: Burstein, J., Doran, C., Solorio, T. (eds.) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2–7, 2019, Volume 1 (Long and Short Papers), pp. 3477–3486. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/n19-1351
Xiong, H., He, Z., Wu, H., Wang, H.: Modeling coherence for discourse neural machine translation. In: The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, 2019, pp. 7338–7345. AAAI Press (2019). https://doi.org/10.1609/aaai.v33i01.33017338
Acknowledgements
We appreciate the support from National Natural Science Foundation of China with the Main Research Project on Machine Behavior and Human Machine Collaborated Decision Making Methodology (72192820 & 72192824), Pudong New Area Science & Technology Development Fund (PKX2021-R05), Science and Technology Commission of Shanghai Municipality (22DZ2229004) and Shanghai Trusted Industry Internet Software Collaborative Innovation Center.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wu, H. et al. (2023). Overview of the NLPCC 2023 Shared Task: Chinese Essay Discourse Coherence Evaluation. In: Liu, F., Duan, N., Xu, Q., Hong, Y. (eds) Natural Language Processing and Chinese Computing. NLPCC 2023. Lecture Notes in Computer Science(), vol 14304. Springer, Cham. https://doi.org/10.1007/978-3-031-44699-3_26
Download citation
DOI: https://doi.org/10.1007/978-3-031-44699-3_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-44698-6
Online ISBN: 978-3-031-44699-3
eBook Packages: Computer ScienceComputer Science (R0)