Improving logical flow in English-as-a-foreign-language learner essays by reordering sentences
References
[1]
K. Al-Khatib, H. Wachsmuth, M. Hagen, B. Stein, Patterns of argumentation strategies across topics, in: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Copenhagen, Denmark, 2017, pp. 1351–1357,. https://www.aclweb.org/anthology/D17-1141.
[2]
G. Aristotle Kennedy, On Rhetoric: A Theory of Civil Discourse, Oxford University Press, 1991.
[3]
N.N. Bacha, Teaching the academic argument in a university EFL environment, J. Engl. Acad. Purpos. 9 (2010) 229–241,. http://www.sciencedirect.com/science/article/pii/S1475158510000378.
[4]
B. Bamberg, What makes a text coherent, College Compos. Commun. 34 (1983) 417–429,. https://www.jstor.org/stable/357898?seq=1#metadata_info_tab_contents.
[5]
R. Barzilay, N. Elhadad, K.R. McKeown, Inferring strategies for sentence ordering in multidocument news summarization, J. Artif. Intell. Res. 17 (2002) 35–55,. https://jair.org/index.php/jair/article/view/10306.
[6]
R. Barzilay, M. Lapata, Modeling local coherence: an entity-based approach, Comput. Linguist. 34 (2008) 1–34,. https://www.aclweb.org/anthology/J08-1001.
[7]
D. Ben-Anath, The role of connectives in text comprehension, Columbia Univ. Work. Papers TESOL Appl. Linguist. 5 (2005) 1–27.
[8]
J.A. Blair, Groundwork in the Theory of Argumentation, Springer, 2012, https://www.springer.com/gp/book/9789400723627.
[9]
M.A. Britt, A.A. Larson, Constructing representations of arguments, J. Mem. Lang. 48 (2003) 794–810.
[10]
G. Carenini, J.D. Moore, Generating and evaluating evaluative arguments, Artif. Intell. 170 (2006) 925–952,. https://www.sciencedirect.com/science/article/pii/S000437020600066X.
[11]
Chen, X.; Qiu, X.; Huang, X. (2016): Neural sentence ordering. CoRR arXiv:1607.06952 [abs].
[12]
K. Cho, C. MacArthur, Student revision with peer and expert reviewing, Learn. Instr. 20 (2010) 328–338,.
[13]
E. Choi, J. Palomaki, M. Lamm, T. Kwiatkowski, D. Das, M. Collins, Decontextualization: making sentences stand-alone, Trans. Assoc. Comput. Linguist. 9 (2021) 447–461,.
[14]
U. Connor, New directions in contrastive rhetoric, TESOL Q. 36 (2002) 493–510. http://www.jstor.org/stable/3588238.
[15]
B. Cui, Y. Li, M. Chen, Z. Zhang, Deep attentive sentence ordering network, in: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Brussels, Belgium, 2018, pp. 4340–4349,. https://www.aclweb.org/anthology/D18-1465.
[16]
S. Cullen, J. Fan, E. van der Brugge, A. Elga, Improving analytical reasoning and argument understanding: a quasi-experimental field study of argument visualization, NPJ Sci. Learn. 3 (2018),.
[17]
J. Devlin, M.W. Chang, K. Lee, K. Toutanova, BERT: pre-training of deep bidirectional transformers for language understanding, in: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics, Minneapolis, Minnesota, 2019, pp. 4171–4186,. https://www.aclweb.org/anthology/N19-1423.
[18]
T.A.V. Dijk, W. Kintsch, Strategies of Discourse Comprehension, Academic Press, New York, 1983.
[19]
T. Dozat, C.D. Manning, Deep biaffine attention for neural dependency parsing, in: Proceedings of the International Conference on Learning Representations, 2017, pp. 1–8. https://openreview.net/forum?id=Hk95PK9le.
[20]
R. El Baff, H. Wachsmuth, K. Al Khatib, M. Stede, B. Stein, Computational argumentation synthesis as a language modeling task, in: Proceedings of the 12th International Conference on Natural Language Generation, Association for Computational Linguistics, Tokyo, Japan, 2019, pp. 54–64,. https://www.aclweb.org/anthology/W19-8607.
[21]
L. Ermakova, J. Mothe, A. Firsov, A metric for sentence ordering assessment based on topic-comment structure, in: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Association for Computing Machinery, 2017, pp. 1061–1064,.
[22]
V.W. Feng, Z. Lin, G. Hirst, The impact of deep hierarchical discourse structures in the evaluation of text coherence, in: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, Dublin City University and Association for Computational Linguistics, Dublin, Ireland, 2014, pp. 940–949. https://www.aclweb.org/anthology/C14-1089.
[23]
J.L. Fleiss, Measuring nominal scale agreement among many raters, Psychol. Bull. 76 (1971) 378–382.
[24]
A.G. Garing, Coherence in Argumentative Essays of First Year College of Liberal Arts Students at de la Salle University, DLSU Research Congress, 2014, https://www.semanticscholar.org/paper/Coherence-in-the-Argumentative-Essays-of-First-Year-Garing/8b6aae0afd67ad0eefbfb499a2aacf9025257afe.
[25]
Gong, J.; Chen, X.; Qiu, X.; Huang, X. (2016): End-to-end neural sentence ordering using pointer network. CoRR arXiv:1611.04953 [bs].
[26]
B.J. Grosz, C.L. Sidner, Attention, intentions, and the structure of discourse, Comput. Linguist. 12 (1986) 175–204,. https://www.aclweb.org/anthology/J86-3001.
[27]
C. Guinaudeau, M. Strube, Graph-based local coherence modeling, in: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics, Sofia, Bulgaria, 2013, pp. 93–103. https://www.aclweb.org/anthology/P13-1010.
[28]
M.A.K. Halliday, R. Hasan, Cohesion in English, Longman, London and New York, 1976.
[29]
G. Herdan, Type-Token Mathematics, The Hague, Mouton, 1960.
[30]
G. Hirst, A. Budanitsky, Correcting real-word spelling errors by restoring lexical cohesion, Nat. Lang. Eng. 11 (2005) 87–111,.
[31]
E.H. Hovy, Approaches to the Planning of Coherent Text, Springer US, Boston, MA, 1991, pp. 83–102,.
[32]
E.H. Hovy, Automated discourse generation using discourse structure relations, Artif. Intell. 63 (1993) 341–385,. https://www.sciencedirect.com/science/article/pii/0004370293900213.
[33]
R. Iida, T. Tokunaga, Building a corpus of manually revised texts from discourse perspective, in: Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), European Language Resources Association (ELRA), Reykjavik, Iceland, 2014, pp. 936–941. http://www.lrec-conf.org/proceedings/lrec2014/pdf/155_Paper.pdf.
[34]
R. Invanic, Discourses of writing and learning to write, Lang. Educ. 18 (2004) 220–245,.
[35]
S. Ishikawa, The ICNALE and sophisticated contrastive interlanguage analysis of asian learners of english, Learn. Corp. Stud. Asia World 1 (2013) 91–118. http://www.lib.kobe-u.ac.jp/repository/81006678.pdf.
[36]
S. Ishikawa, The ICNALE edited essays: a dataset for analysis of l2 english learner essays based on a new integrative viewpoint, Engl. Corpus Linguist. 25 (2018) 1–14. https://jaecs.com/jnl/ECS25/ECS25_117-130.pdf.
[37]
A.M. Johns, The esl student and the revision process: some insights from scheme theory, J. Basic Writ. 5 (1986) 70–80. https://wac.colostate.edu/docs/jbw/v5n2/johns.pdf.
[38]
R.B. Kaplan, Cultural thought patterns in inter-cultural education, Lang. Learn. 16 (1966) 1–20,.
[39]
M.G. Kendall, A new measure of rank correlation, Biometrika 30 (1938) 81–93,.
[40]
S. Kleijn, H.L.P. Maat, T.J. Sanders, Comprehension effects of connectives across texts, readers, and coherence relations, Discourse Process. 56 (2019) 447–464,.
[41]
A. Lai, J. Tetreault, Discourse coherence in the wild: a dataset, evaluation and methods, in: Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue, Association for Computational Linguistics, Melbourne, Australia, 2018, pp. 214–223,. https://aclanthology.org/W18-5023.
[42]
Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, R. Soricut, ALBERT: a lite BERT for self-supervised learning of language representations, in: Proceedings of the International Conference on Learning Representations, 2020, pp. 1–17. https://openreview.net/pdf?id=H1eA7AEtvS.
[43]
M. Lapata, Probabilistic text structuring: experiments with sentence ordering, in: Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Sapporo, Japan, 2003, pp. 545–552,. https://www.aclweb.org/anthology/P03-1069.
[44]
M. Lapata, Automatic evaluation of information ordering: Kendall's tau, Comput. Linguist. 32 (2006) 471–484,. https://www.aclweb.org/anthology/J06-4002.
[45]
J. Lawrence, C. Reed, Argument mining: a survey, Comput. Linguist. 45 (2020) 765–818,.
[46]
J. Li, D. Jurafsky, Neural net models of open-domain discourse coherence, in: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Copenhagen, Denmark, 2017, pp. 198–209,. https://www.aclweb.org/anthology/D17-1019.
[47]
E.D. Liddy, The discourse-level structure of empirical abstracts: an exploratory study, Inf. Process. Manag. 27 (1991) 55–81,. https://www.sciencedirect.com/science/article/pii/030645739190031G.
[48]
Z. Lin, H.T. Ng, M.Y. Kan, Automatically evaluating text coherence using discourse relations, in: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, Portland, Oregon, USA, 2011, pp. 997–1006. https://www.aclweb.org/anthology/P11-1100.
[49]
M. Lippi, P. Torroni, Argumentation mining: state of the art and emerging trends, ACM Trans. Internet Technol. 16 (2016),.
[50]
L. Liu, Rhetorical education through writing instruction across cultures: a comparative analysis of select online instructional materials on argumentative writing, J. Second Lang. Writ. 14 (2005) 1–18.
[51]
L. Logeswaran, H. Lee, D.R. Radev, Sentence ordering and coherence modeling using recurrent neural networks, in: AAAI, 2018, pp. 5285–5292. https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/download/17011/16079.
[52]
A. Louis, A. Nenkova, A coherence model based on syntactic patterns, in: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Association for Computational Linguistics, Jeju Island, Korea, 2012, pp. 1157–1168. https://www.aclweb.org/anthology/D12-1106.
[53]
W. Mann, S. Thompson, Rhetorical structure theory: toward a functional theory of text organization, Text 8 (1988) 243–281. https://www.sfu.ca/rst/05bibliographies/bibs/Mann_Thompson_1988.pdf.
[54]
K. Matsumura, K. Sakamoto, A structure analysis of japanese efl students' argumentative paragraph writing with a tool for annotation discourse relation, in: The Bulletin of the Writing Reserch Group, 2021, JACET Kansai Chapter 14.
[55]
Q. McNemar, Note on the sampling error of the difference between correlated proportions or percentages, Psychometrika 12 (1947) 153–157. https://link.springer.com/article/10.1007/BF02295996.
[56]
M. Mesgar, M. Strube, A neural local coherence model for text quality assessment, in: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Brussels, Belgium, 2018, pp. 4328–4339,. https://aclanthology.org/D18-1464.
[57]
National Commission on Writing in American Schools and Colleges (2003): The neglected R: the need for a writing revolution. https://archive.nwp.org/cs/public/print/resource/2523 retrieved 20 October 2021.
[58]
E.W. Noreen, Computer Intensive Methods for Testing Hypotheses: An Introduction, Wiley, New York, 1989.
[59]
A. Peldszus, M. Stede, From argument diagrams to argumentation mining in texts: a survey, Int. J. Cogn. Inf. Nat. Intell. 7 (2013) 1–31,.
[60]
I. Persing, A. Davis, V. Ng, Modeling organization in student essays, in: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Cambridge, MA, 2010, pp. 229–239. https://www.aclweb.org/anthology/D10-1023/.
[61]
I. Persing, V. Ng, Modeling argument strength in student essays, in: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Association for Computational Linguistics, Beijing, China, 2015, pp. 543–552,. https://www.aclweb.org/anthology/P15-1053.
[62]
L. Pishdad, F. Fancellu, R. Zhang, A. Fazly, How coherent are neural models of coherence?, in: Proceedings of the 28th International Conference on Computational Linguistics, International Committee on Computational Linguistics, Barcelona, Spain, 2020, pp. 6126–6138,. (Online) https://aclanthology.org/2020.coling-main.
[63]
S. Prabhumoye, R. Salakhutdinov, A.W. Black, Topological sort for sentence ordering, in: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, 2020, pp. 2783–2792,. Online https://www.aclweb.org/anthology/2020.acl-main.248.
[64]
J.W.G. Putra, S. Teufel, K. Matsumura, T. Tokunaga, TIARA: a tool for annotating discourse relations and sentence reordering, in: Proceedings of the 12th Language Resources and Evaluation Conference, European Language Resources Association, Marseille, France, 2020, pp. 6912–6920. https://www.aclweb.org/anthology/2020.lrec-1.854.
[65]
J.W.G. Putra, S. Teufel, T. Tokunaga, Parsing argumentative structure in English-as-foreign-language essays, in: Proceedings of the 16th Workshop on Innovative Use of NLP for Building Educational Applications, Association for Computational Linguistics, 2021, pp. 97–109. Online https://aclanthology.org/2021.bea-1.10.
[66]
J.W.G. Putra, S. Teufel, T. Tokunaga, Annotating argumentative structure in english-as-foreign-language learner essays, Nat. Lang. Eng. (2021) 1–37,.
[67]
J.W.G. Putra, S. Teufel, T. Tokunaga, Multi-task and multi-corpora training strategies to enhance argumentative sentence linking performance, in: Proceedings of the 8th Workshop in Argument Mining, Association for Computational Linguistics, 2021, Online arXiv:2109.13067.
[68]
J.W.G. Putra, T. Tokunaga, Evaluating text coherence based on semantic similarity graph, in: Proceedings of TextGraphs-11: the Workshop on Graph-Based Methods for Natural Language Processing, Association for Computational Linguistics, Vancouver, Canada, 2017, pp. 76–85,. https://www.aclweb.org/anthology/W17-2410.
[69]
E. Rabinovich, S. Nisioi, N. Ordan, S. Wintner, On the similarities between native, non-native and translated texts, in: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics, Berlin, Germany, 2016, pp. 1870–1881,. https://www.aclweb.org/anthology/P16-1176.
[70]
N. Reimers, I. Gurevych, Sentence-BERT: sentence embeddings using Siamese BERT-networks, in: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019, pp. 3982–3992,. https://www.aclweb.org/anthology/D19-1410.
[71]
T.J. Sanders, Coherence, causality and cognitive complexity in discourse, in: Proceedings/Actes SEM-05, First International Symposium on the Exploration and Modelling of Meaning, Toulouse, France, 2005, pp. 105–114.
[72]
E.M. Segal, J.F. Duchan, P.J. Scott, The role of interclausal connectives in narrative structuring: evidence from adults' interpretations of simple stories, Discourse Process. 14 (1991) 27–54,.
[73]
V.J. Shute, Focus on formative feedback, Rev. Educ. Res. 78 (2008) 153–189,.
[74]
T. Silva, Toward an understanding of the distinct nature of L2 writing: the esl research and its implications, TESOL Q. 27 (1993) 657–677. http://www.jstor.org/stable/3587400.
[75]
C. Stab, I. Gurevych, Parsing argumentation structures in persuasive essays, Comput. Linguist. 43 (2017) 619–659,. https://www.aclweb.org/anthology/J17-3005.
[76]
C. Strobl, E. Ailhaud, K. Benetos, A. Devitt, O. Kruse, A. Proske, C. Rapp, Digital support for academic writing: a review of technologies and pedagogies, Comput. Educ. 131 (2019) 33–48,. https://www.sciencedirect.com/science/article/pii/S036013151830318X.
[77]
R. Tarjan, Edge-disjoint spanning trees and depth-first search, Acta Inform. 6 (1976) 171–185,.
[78]
R.W. Todd, P. Thienpermpool, S. Keyuravong, Measuring the coherence of writing using topic-based analysis, Assess. Writ. 9 (2004) 85–104,. https://www.sciencedirect.com/science/article/pii/S1075293504000248.
[79]
H. Wachsmuth, K. Al-Khatib, B. Stein, Using argument mining to assess the argumentation quality of essays, in: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, The COLING 2016 Organizing Committee, Osaka, Japan, 2016, pp. 1680–1691. https://www.aclweb.org/anthology/C16-1158.
[80]
H. Wachsmuth, M. Stede, R. El Baff, K. Al-Khatib, M. Skeppstedt, B. Stein, Argumentation synthesis following rhetorical strategies, in: Proceedings of the 27th International Conference on Computational Linguistics, Association for Computational Linguistics, Santa Fe, New Mexico, USA, 2018, pp. 3753–3765. https://www.aclweb.org/anthology/C18-1318.
[81]
T. Wambsganss, A. Caines, P. Buttery, ALEN app: argumentative writing support to foster English language learning, in: Proceedings of the 17th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2022), Association for Computational Linguistics, Seattle, Washington, 2022, pp. 134–140. https://aclanthology.org/2022.bea-1.18.
[82]
B. Webber, A. Joshi, Discourse structure and computation: past, present and future, in: Proceedings of the ACL-2012 Special Workshop on Rediscovering 50 Years of Discoveries, Association for Computational Linguistics, Jeju Island, Korea, 2012, pp. 42–54. https://www.aclweb.org/anthology/W12-3205.
[83]
R.M. Weischedel, W.M. Voge, M. James, An artificial intelligence approach to language instruction, Artif. Intell. 10 (1978) 225–240,.
[84]
T. Yanase, T. Miyoshi, K. Yanai, M. Sato, M. Iwayama, Y. Niwa, P. Reisert, K. Inui, Learning sentence ordering for opinion generation of debate, in: Proceedings of the 2nd Workshop on Argumentation Mining, Association for Computational Linguistics, Denver, CO, 2015, pp. 94–103,. https://www.aclweb.org/anthology/W15-0512.
[85]
Y. Yin, L. Song, J. Su, J. Zeng, C. Zhou, J. Luo, Graph-based neural sentence ordering, in: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, 2019, pp. 5387–5393,.
[86]
Z. Yuan, T. Briscoe, Grammatical error correction using neural machine translation, in: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, San Diego, California, 2016, pp. 380–386,. https://www.aclweb.org/anthology/N16-1042.
[87]
F. Zhang, H.B. Hashemi, R. Hwa, D. Litman, A corpus of annotated revisions for studying argumentative writing, in: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics, Vancouver, Canada, 2017, pp. 1568–1578,. https://www.aclweb.org/anthology/P17-1144.
[88]
F. Zhang, D. Litman, Annotation and classification of argumentative writing revisions, in: Proceedings of the Tenth Workshop on Innovative Use of NLP for Building Educational Applications, 2015, pp. 133–143,. https://www.aclweb.org/anthology/W15-0616.
Recommendations
Chunk-level reordering of source language sentences with automatically learned rules for statistical machine translation
SSST '07: Proceedings of the NAACL-HLT 2007/AMTA Workshop on Syntax and Structure in Statistical TranslationIn this paper, we describe a source-side reordering method based on syntactic chunks for phrase-based statistical machine translation. First, we shallow parse the source language sentences. Then, reordering rules are automatically learned from source-...
Syntactic phrase reordering for English-to-Arabic statistical machine translation
EACL '09: Proceedings of the 12th Conference of the European Chapter of the Association for Computational LinguisticsSyntactic Reordering of the source language to better match the phrase structure of the target language has been shown to improve the performance of phrase-based Statistical Machine Translation. This paper applies syntactic reordering to English-to-...
Parsing long English sentences with pattern rules
COLING '90: Proceedings of the 13th conference on Computational linguistics - Volume 3In machine translation, parsing of long English sentences still causes some problems, whereas for short sentences a good machine translation system usually can generate readable translations. In this paper a practical method is presented for parsing ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
The Author(s).
Publisher
Elsevier Science Publishers Ltd.
United Kingdom
Publication History
Published: 01 July 2023
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025