Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Designing Pedagogical Conversational Agents for Achieving Common Ground

  • Conference paper
  • First Online:
Design Science Research for a New Society: Society 5.0 (DESRIST 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13873))

Abstract

As educational organizations face difficulties in providing personalized learning material or individual learning support., pedagogical conversational agents (PCAs) promise individualized learning for students. However, the problem of conversational breakdowns of PCAs and consequently poor learning outcomes still exist. Hence, effective and grounded communication between learners and PCAs is fundamental to improving learning processes and outcomes. As understanding each other and the conversational grounding is crucial for conversations between humans and PCAs, we propose common ground theory as a foundation for designing a PCA. Conducting a design science research project, we propose theory-motivated design principles and instantiate them in a PCA. We evaluate the utility of the artifact with an experimental study in higher education to inform the subsequent design iterations. We contribute design knowledge on conversational agents in learning settings, enabling researchers and practitioners to develop PCAs based on common ground research in education and providing avenues for future research. Thereby, we can secure further understanding of learning processes based on grounding communication.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bittner, E.A.C., Oeste-Reiß, S., Leimeister, J.M.: Where is the Bot in our Team? Toward a Taxonomy of Design Option Combinations for Conversational Agents in Collaborative Work. HICSS (2019)

    Google Scholar 

  2. Vassallo, G., Pilato, G., Augello, A., et al.: Phase coherence in conceptual spaces for conversational agents. In: Sheu, P.C.-Y. (ed) Semantic computing. IEEE Press; John Wiley & Sons, Piscataway, NJ, Hoboken, N.J., pp. 357–371 (2010)

    Google Scholar 

  3. Kuhail, M.A., Alturki, N., Alramlawi, S., et al.: Interacting with educational chatbots: a systematic review. Educ. Inf. Technol. (2022)

    Google Scholar 

  4. Winkler, R., Söllner, M.: Unleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis. Proceedings 2018, 15903 (2018)

    Google Scholar 

  5. Mikic Fonte, F.A., Burguillo, J.C., Nistal, M.L.: An intelligent tutoring module controlled by BDI agents for an e-learning platform. Expert Systems with Applications (2012)

    Google Scholar 

  6. Hayashi, Y.: Gaze awareness and metacognitive suggestions by a pedagogical conversational agent: an experimental investigation on interventions to support collaborative learning process and performance. Int. J. Comput.-Support. Collab. Learn. 15(4), 469–498 (2020)

    Article  Google Scholar 

  7. Seeber, I., Bittner, E., Briggs, R.O., et al.: Machines as teammates: a research agenda on AI in team collaboration. Information & Management 57, 103174 (2020)

    Article  Google Scholar 

  8. Benner, D., Elshan, E., Schöbel, S., et al.: What do you mean? a review on recovery strategies to overcome conversational breakdowns of conversational Agents. ICIS (2021)

    Google Scholar 

  9. Luger, E., Sellen, A.: Like having a really bad PA. In: Kaye, J. (ed) Proceedings of the 2016 CHI. ACM, New York, pp. 5286–5297 (2016)

    Google Scholar 

  10. Myers, C., Furqan, A., Nebolsky, J., et al.: Patterns for how users overcome obstacles in voice user interfaces. In: Mandryk, R. (ed.) 2018 CHI, pp. 1–7. ACM, NY (2018)

    Google Scholar 

  11. Chakrabarti, C., Luger, G.F.: Artificial conversations for customer service chatter bots: architecture, algorithms, and evaluation metrics. Expert Syst. Appl., pp. 6878–6897 (2015)

    Google Scholar 

  12. Weiler, S., Matt, C., Hess, T.: Immunizing with information – inoculation messages against conversational agents’ response failures. Electron Markets (2021)

    Google Scholar 

  13. Meredith, J.: Analysing technological affordances of online interactions using conversation analysis. Journal of Pragmatics, 42–55 (2017)

    Google Scholar 

  14. Rothwell, C.D., Shalin, V.L., Romigh, G.D.: Comparison of common ground models for human--computer dialogue. ACM Trans. Comput.-Hum. Interact. 28, 1–35 (2021)

    Google Scholar 

  15. Koulouri, T., Lauria, S., Macredie, R.D.: Do (and Say) as i say: linguistic adaptation in human-computer dialogs. Human-Computer Interaction 31, 59–95 (2016)

    Article  Google Scholar 

  16. Clark, H.H.: Using language, Sixth printing. [ACLS Humanities E-Book]. Cambridge University Press, Cambridge (1996)

    Google Scholar 

  17. Diederich, S., Brendel, A.B., Morana, S., et al.: On the design of and interaction with conversational agents: an organizing and assessing review of human-computer interaction research. JAIS 23, 96–138 (2022)

    Article  Google Scholar 

  18. Montemayor, C.: Language and Intelligence. Mind. Mach. 31(4), 471–486 (2021)

    Article  Google Scholar 

  19. Khosrawi-Rad, B., Rinn, H., Schlimbach, R., et al.: Conversational agents in education – a systematic literature review. ECIS 2022 Research Papers (2022)

    Google Scholar 

  20. Hevner, A.R., March, S.T., Park, J., et al.: Design science in information systems research. MIS Q. 28, 75–105 (2004)

    Article  Google Scholar 

  21. Peffers, K., Tuunanen, T., Rothenberger, M.A., et al.: A design science research methodology for information systems research. JMIS 24, 45–77 (2007)

    Google Scholar 

  22. Gregor, S., Hevner, A.R.: Positioning and presenting design science research for maximum impact. MIS Q. 37, 337–355 (2013)

    Article  Google Scholar 

  23. Laurillard, D.: Rethinking University Teaching: A Conservational Framework for the Effective Use of Learning Technologies, 2nd edn. Taylor & Francis, London (2002)

    Book  Google Scholar 

  24. Schmitt, A., Zierau, N., Janson, A., Leimeister, J.M.: Voice as a Contemporary Frontier of Interaction Design. ECIS 2021 Research Papers (2021)

    Google Scholar 

  25. Budiu, R.: The User Experience of Chatbots. www.nngroup.com/articles/chatbots/ (2018)

  26. Song, D., Oh, E.Y., Rice, M.: Interacting with a conversational agent system for educational purposes in online courses. HSI. IEEE, pp. 78–82 (2017)

    Google Scholar 

  27. Hobert, S., Meyer von Wolff, R.: Say Hello to Your New Automated Tutor – A Structured Literature Review on Pedagogical Conversational Agents. WI (2019)

    Google Scholar 

  28. Gupta, S., Bostrom, R.: Technology-mediated learning: a comprehensive theoretical model. J. Association for Inf. Syst. pp. 686–714 (2009)

    Google Scholar 

  29. Gabriel, C., Hahne, C., Zimmermann, A., et al.: The virtual tutor: tasks for conversational agents in online collaborative learning environments. In: Bui, T. (ed): HICSS (2021)

    Google Scholar 

  30. Sinha, S., Basak, S., Dey, Y., et al.: An educational chatbot for answering queries. In: Mandal (ed) Emerging Technology in Modelling and Graphics, Singapore, pp. 55–60 (2020)

    Google Scholar 

  31. Ismail, M., Ade-Ibijola, A.: Lecturer’s apprentice: a chatbot for assisting novice programmers. IMITEC, pp. 1–8 (2019)

    Google Scholar 

  32. Cunningham-Nelson, S., Boles, W., Trouton, L., Margerison, E.: A review of chatbots in education: practical steps forward. AAEE: Educators Becoming Agents of Change: Innovate, Integrate, Motivate, pp. 299–306 (2019)

    Google Scholar 

  33. Mabunda, K., Ade-Ibijola, A.: PathBot: an intelligent chatbot for guiding visitors and locating venues. In: 2019 ISCMI, pp. 160–168 (2019)

    Google Scholar 

  34. Gulz, A., Haake, M., Silvervarg, A., et al.: Building a social conversational pedagogical agent. In: Perez-Marin, D., Pascual-Nieto, I. (eds): Conversational agents and natural language interaction: Techniques and effective practices. IGI Global, pp. 128–155 (2011)

    Google Scholar 

  35. Kerly, A., Hall, P., Bull, S.: Bringing chatbots into education: towards natural language negotiation of open learner models. Knowl.-Based Syst. 20, 177–185 (2007)

    Article  Google Scholar 

  36. Clark, H.H., Brennan, S.E.: Grounding in communication. In: Resnick, L.B., Levine, J.M., Teasley, S.D. (eds) Perspectives on socially shared cognition. APA, pp. 127–149 (1991)

    Google Scholar 

  37. Trede, F., Higgs, J., Rothwell, R.: Critical transformative dialogues: a research method beyond the fusions of horizons. forum qualitative sozialforschung: qualitative social research, (2009): Qualitative Research on Intercultural Communication (2008)

    Google Scholar 

  38. Jurafsky, D., James, M.: Dialog Systems and Chatbots. Speech and Language Processing (2017)

    Google Scholar 

  39. Richardson, D.C., Dale, R.: Grounding dialogue: eye movements reveal the coordination of attention during conversation and the effects of common ground. Proceedings of the Annual Meeting of the Cognitive Science Society (2006)

    Google Scholar 

  40. Dillenbourg, P., Traum, D.: Sharing solutions: persistence and grounding in multimodal collaborative problem solving. J. Learning Sci. 15, 121–151 (2006)

    Article  Google Scholar 

  41. Sundar, S.S., Qian, X., Bellur, S.: Designing interactivity in media interfaces: a communications perspective. CHI 2010: Perspectives on Design, pp. 2247–2256 (2010)

    Google Scholar 

  42. Brennan, S.E.: The grounding problem in conversations with and through computers. Social and Cognitive Approaches to Interpersonal Communication. Fussell, S.R., Kreuz, R.J. (Eds.), 201–225 (1998)

    Google Scholar 

  43. Briggs, R.O.: On theory-driven design and deployment of collaboration systems. International Journal of Human-Computer Studies, 573–582 (2006)

    Google Scholar 

  44. Gehlert, A., Schermann, M., Pohl, K., et al.: Towards a research method for theorydriven design research. Wirtschaftinformatik Proceedings 2009 (2009)

    Google Scholar 

  45. Dickhaut, E., Janson, A., Söllner, M., et al.: Lawfulness by Design – Development and Evaluation of Lawful Design Patterns to Consider Legal Requirements. EJIS, 1–28 (2023)

    Google Scholar 

  46. Brenner, W., Karagiannis, D., Kolbe, L., et al.: User, use & utility research. Bus. Inf. Syst. Eng. 6, 55–61 (2014)

    Article  Google Scholar 

  47. Serban, I.V., Sankar, C., Germain, M., et al.: A Deep Reinforcement Learning Chatbot. arXiv (2017)

    Google Scholar 

  48. Pickering, M.J., Garrod, S.: Toward a mechanistic psychology of dialogue. Behav. Brain. Sci. 27, 169–90; discussion 190–226 (2004)

    Google Scholar 

  49. Fusaroli, R., Rączaszek-Leonardi, J., Tylén, K.: Dialog as interpersonal synergy. New Ideas Psychol. 32, 147–157 (2014)

    Article  Google Scholar 

  50. Branigan, H.P., Pickering, M.J., Pearson, J., et al.: Linguistic alignment between people and computers. J. Pragmat. 42, 2355–2368 (2010)

    Article  Google Scholar 

  51. Cowan, B.R., Branigan, H.P., Obregón, M., et al.: Voice anthropomorphism, interlocutor modelling and alignment effects on syntactic choices in human−computer dialogue. Int. J. Hum Comput Stud. 83, 27–42 (2015)

    Article  Google Scholar 

  52. Tolzin, A., Janson, A.: Mechanisms of Common Ground in Human-Agent Interaction: A Systematic Review of Conversational Agent Research. HICSS (2023)

    Google Scholar 

  53. Corti, K., Gillespie, A.: Co-constructing intersubjectivity with artificial conversational agents: People are more likely to initiate repairs of misunderstandings with agents represented as human. Comput. Hum. Behav. 58, 431–442 (2016)

    Article  Google Scholar 

  54. Pustejovsky, J., Krishnaswamy, N.: Embodied Human Computer Interaction. Künstl Intell. 35, 307–327. https://doi.org/10.1007/s13218-021-00727-5#auth-James-Pustejovsky (2021)

  55. Maybin, J., Mercer, N., Stierer, B.: ‘Scaffolding’ learning in the classroom. In: Norman K (ed) Thinking Voices: Thework of the National Oracy Project. Hodder Arnold (1992)

    Google Scholar 

  56. Clark, L., Pantidi, N., Cooney, O., et al.: What makes a good conversation? In: Brewster, S., Fitzpatrick, G., Cox, A., et al. (eds.) 2019 CHI, pp. 1–12. ACM, New York, NY, USA (2019)

    Google Scholar 

  57. Neururer, M., Schlögl, S., Brinkschulte, L., et al.: Perceptions on authenticity in chat bots. MTI 2, 60 (2018)

    Article  Google Scholar 

  58. Cassell, J.: Negotiated collusion: modeling social language and its relationship effects in intelligent agents. User Model. User-Adap. Inter. 13, 89–132 (2003)

    Article  Google Scholar 

  59. Bernard, D., Arnold, A.: Cognitive interaction with virtual assistants: from philosophical foundations to illustrative examples in aeronautics. Comput. Ind. 107, 33–49 (2019)

    Article  Google Scholar 

  60. Pinhanez, C.S., Candello, H., Pichiliani, M.C., et al.: Different but Equal: Comparing User Collaboration with Digital Personal Assistants vs. Teams of Expert Agents (2018)

    Google Scholar 

  61. Blache, P.: Dialogue management in task-oriented dialogue systems. In: Chaminade, T., Interaction ASIGoC-H (eds) Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents. ACM, , pp. 4–8 (2017)

    Google Scholar 

  62. Frijns, H.A., Schürer, O., Koeszegi, S.T.: Communication models in human–robot interaction: an asymmetric model of alterity in human–robot interaction (AMODAL-HRI). Int J of Soc Robotics (2021)

    Google Scholar 

  63. Kiesler, S.: Fostering common ground in human-robot interaction. In: Robot and Human Interactive Communication, 2005. ROMAN 2005. IEEE International Workshop on. IEEE, pp 729–734 (2005)

    Google Scholar 

  64. Fischer, U., McDonnell, L., Orasanu, J.: Linguistic correlates of team performance: toward a tool for monitoring team functioning during space missions. Aviat Space Environ. Med. 78, B86-95 (2007)

    Google Scholar 

  65. Yu, F.-Y.: Learner-centered pedagogy + adaptable and scaffolded learning space design—online student question-generation. International Conference on Computers in Education 2012 (2012)

    Google Scholar 

  66. Venable, J., Pries-Heje, J., Baskerville, R.: FEDS: a framework for evaluation in design science research. Eur. J. Inf. Syst. 25, 77–89 (2016)

    Article  Google Scholar 

  67. Mettler, T., Eurich, M., Winter, R.: On the use of experiments in design science research: a proposition of an evaluation framework. CAIS 34 (2014)

    Google Scholar 

  68. Soderstrom, N.C., Bjork, R.A.: Learning versus performance: an integrative review. Perspect Psychol. Sci. 10, 176–199 (2015)

    Article  Google Scholar 

  69. Gupta, S., Bostrom, R.: Research note —an investigation of the appropriation of technology-mediated training methods incorporating enactive and collaborative learning. Inf. Syst. Res. 24, 454–469 (2013)

    Article  Google Scholar 

  70. Rhodes, M.G.: Judgments of learning: methods, data, and theory. In: Dunlosky, J., Tauber, S.K. (eds) The Oxford handbook of metamemory. Oxford University, New York (2016)

    Google Scholar 

  71. Agarwal, R., Prasad, J.: A conceptual and operational definition of personal innovativeness in the domain of information technology. Information Syst. Res. (1998)

    Google Scholar 

  72. Schmitt, A., Wambsganss, T., Janson, A.: Designing for Conversational System Trustworthiness: The Impact of Model Transparency on Trust and Task Performance. ECIS 2022 Research Papers (2022)

    Google Scholar 

  73. van Rensburg, J.J., Santos, C.M., de Jong, S.B., et al.: The five-factor perceived shared mental model scale: a consolidation of items across the contemporary literature. Front Psychol. 12, 784200 (2021)

    Article  Google Scholar 

Download references

Acknowledgments

The results presented in this article were developed in the research project Komp-HI funded by the German Federal Ministry of Education and Research (BMBF, grant 16DHBKI073). The fourth author acknowledges funding from the Basic Research Fund of the University of St. Gallen.

Author information

Authors and Affiliations

  1. University of Kassel, Kassel, Germany

    Antonia Tolzin, Anita Körner, Ernestine Dickhaut, Ralf Rummer & Jan Marco Leimeister

  2. University of St. Gallen, St. Gallen, Switzerland

    Andreas Janson & Jan Marco Leimeister

Authors
  1. Antonia Tolzin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anita Körner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ernestine Dickhaut
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andreas Janson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ralf Rummer
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jan Marco Leimeister
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Antonia Tolzin .

Editor information

Editors and Affiliations

  1. University of the Western Cape, Cape Town, South Africa

    Aurona Gerber

  2. Georgia State University, Atlanta, GA, USA

    Richard Baskerville

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tolzin, A., Körner, A., Dickhaut, E., Janson, A., Rummer, R., Leimeister, J.M. (2023). Designing Pedagogical Conversational Agents for Achieving Common Ground. In: Gerber, A., Baskerville, R. (eds) Design Science Research for a New Society: Society 5.0. DESRIST 2023. Lecture Notes in Computer Science, vol 13873. Springer, Cham. https://doi.org/10.1007/978-3-031-32808-4_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-32808-4_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-32807-7

  • Online ISBN: 978-3-031-32808-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation