Modelling speaker adaptation in second language learner dialogue
View/ Open
Date
25/06/2020Author
Sinclair, Arabella Jane
Metadata
Abstract
Understanding how tutors and students adapt to one another within Second Language (L2) learning is an important step in the development of better automated tutoring tools for L2 conversational practice. Such an understanding can not only inform conversational agent design, but can be useful for other pedagogic applications such as formative assessment, self reflection on tutoring practice, learning analytics, and conversation modelling for personalisation and adaptation.
Dialogue is a challenging domain for natural language processing, understanding, and generation. It is necessary to understand how participants adapt to their interlocutor, changing what they express and how they express it as they update their beliefs about the knowledge, preferences, and goals of the other person. While this adaptation is natural to humans, it is an open problem for dialogue systems, where managing coherence across utterances is an active area of research, even without adaptation.
This thesis extends our understanding of adaptation in human dialogue, to better implement this in agent-based conversational dialogue. This is achieved through comparison to fluent conversational dialogues and across student ability levels. Specifically, we are interested in how adaptation takes place in terms of the linguistic complexity, lexical alignment and the dialogue act usage demonstrated by the speakers within the dialogue. Finally, with the end goal of an automated tutor in mind, the student alignment levels are used to compare dialogues between student and human tutor with those where the tutor is an agent.
We argue that the lexical complexity, alignment and dialogue style adaptation we model in L2 human dialogue are signs of tutoring strategies in action, and hypothesise that creating agents which adapt to these aspects of dialogue will result in better environments for learning. We hypothesise that with a more adaptive agent, student alignment may increase, potentially resulting in improved engagement and learning.
We find that In L2 practice dialogues, both student and tutor adapt to each other, and this adaptation depends on student ability. Tutors adapt to push students of higher ability, and to encourage students of lower ability. Complexity, dialogue act usage and alignment are used differently by speakers in L2 dialogue than within other types of conversational dialogue, and changes depending on the learner proficiency. We also find different types of learner behaviours within automated L2 tutoring dialogues to those present in human ones, using alignment to measure this. This thesis contributes new findings on interlocutor adaptation within second language practice dialogue, with an emphasis on how these can be used to improve tutoring dialogue agents.