Abstract
We present a knowledge-driven multilingual conversational agent (referred to as “MyWelcome Agent”) that acts as personal assistant for migrants in the contexts of their reception and integration. In order to also account for tasks that go beyond communication and require advanced service coordination skills, the architecture of the proposed platform separates the dialogue management service from the agent behavior including the service selection and planning. The involvement of genuine agent planning strategies in the design of personal assistants, which tend to be limited to dialogue management tasks, makes the proposed agent significantly more versatile and intelligent. To ensure high quality verbal interaction, we draw upon state-of-the-art multilingual spoken language understanding and generation technologies.
Supported by the European Commission in the framework of its Horizon 2020 R&D Program under the contract number 870930.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
We use the notion of service in order to highlight the functionality perspective on the individual software modules or components of the platform.
- 2.
The LAKRs can be also accessed via secure interface by the TCN whose data it contains and the responsible authority.
- 3.
- 4.
References
Bohnet, B., Wanner, L.: Open source graph transducer interpreter and grammar development environment. In: Proceedings of LREC, pp. 211–218 (2010)
Fér, R., Matějka, P., Grézl, F., Plchot, O., Veselý, K., Černocký, J.: Multilingually trained bottleneck features in spoken language recognition. Comput. Speech Lang. 2017(46), 252–267 (2017)
Halabi, N.: Modern standard Arabic phonetics for speech synthesis. Ph.D. Diss. (2016)
Helmert, M.: The fast downward planning system. J. Artif. Int. Res. 26(1), 191–246 (2006)
Helmert, M., Röger, G., Karpas, E.: Fast downward stone soup: a baseline for building planner portfolios. In: ICAPS 2011 Workshop on Planning and Learning, pp. 28–35 (2011)
Janowski, K., Ritschel, H., Lugrin, B., André, E.: Sozial interagierende Roboter in der Pflege, pp. 63–87. Springer Fachmedien Wiesbaden, Wiesbaden (2018). https://doi.org/10.1007/978-3-658-22698-5_4
Junczys-Dowmunt, M., et al.: Marian: Fast Neural Machine Translation in C++. In: Proceedings of ACL 2018, System Demonstrations, pp. 116–121 (2018)
Karafiat, M., Karthick, B., Szoke, I., Vydana, H., Benes, K., Černocký, J.: BUT OpenSAT 2020 speech recognition system. In: Proceedings of the InterSpeech 2021 (2021)
Klusch, M., Kapahnke, P.: The ISEM matchmaker: a flexible approach for adaptive hybrid semantic service selection. J. Web Seman. 15, 1–14 (2012)
Külebi, B., Öktem, A., Peiró-Lilja, A., Pascual, S., Farrús, M.: CATOTRON – a neural text-to-speech system in Catalan. In: Proceedings of the Interspeech, pp. 490–491 (2020)
Li, X., Chen, Y.N., Li, L., Gao, J., Celikyilmaz, A.: End-to-end task-completion neural dialogue systems. In: Proceedings of the IJCNLP, pp. 733–743 (2017)
Mencía, B.L., Pardo, D.D., Trapote, A.H., Gómez, L.A.H.: Embodied Conversational Agents in interactive applications for children with special educational needs. In: Griol Barres, D., Callejas Carrión, Z., Delgado, R.L.C. (eds.) Technologies for Inclusive Education: Beyond Traditional Integration Approaches, pp. 59–88. IGI Global, Hershey (2013)
Mille, S., Dasioupoulou, S., Wanner, L.: A portable grammar-based NLG system for verbalization of structured data. In: Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing, pp. 1054–1056 (2019)
Moro, A., Raganato, A., Navigli, R.: Entity linking meets word sense disambiguation: a unified approach. Trans. Assoc. Comput. Linguist. (TACL) 2, 231–244 (2014)
Park, K., Mulc, T.: CSS10: a collection of single speaker speech datasets for 10 languages (2019)
Plchot, O., et al.: Analysis of BUT-PT Submission for NIST LRE 2017. In: Proceedings of Odyssey 2018 the Speaker and Language Recognition WS, pp. 47–53 (2018). https://www.fit.vut.cz/research/publication/11762
Povey, D., et al.: The Kaldi speech recognition toolkit. In: IEEE 2011 Workshop on Automatic Speech Recognition and Understanding, December 2011
Shvets, A., Wanner, L.: Concept extraction using pointer–generator networks and distant supervision for data augmentation. In: Keet, C.M., Dumontier, M. (eds.) EKAW 2020. LNCS (LNAI), vol. 12387, pp. 120–135. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-61244-3_8
Straka, M.: UDPipe 2.0 prototype at CoNLL 2018 UD shared task. In: Proceedings of the CoNLL 2018, pp. 197–207 (2018)
Wang, Y., et al.: Tacotron: Towards end-to-end speech synthesis (2017)
Wanner, L., et al.: KRISTINA: a knowledge-based virtual conversation agent. In: Demazeau, Y., Davidsson, P., Bajo, J., Vale, Z. (eds.) PAAMS 2017. LNCS (LNAI), vol. 10349, pp. 284–295. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59930-4_23
Wargnier, P., Carletti, G., Laurent-Corniquet, Y., Benveniste, S., Jouvelot, P., Rigaud, A.S.: Field evaluation with cognitively-impaired older adults of attention management in the Embodied Conversational Agent Louise. In: Proceedings of the IEEE International Conference on Serious Games and Applications for Health, pp. 1–8 (2016)
Wei, W., Le, Q., Dai, A., Li, L.J.: AirDialogue: an environment for goal-oriented dialogue research. In: Proceedings of the EMNLP, pp. 3844–3854 (2018)
Weisz, G., Budzianowski, P., Su, P.H., Gašić, M.: Sample efficient deep reinforcement learning for dialogue systems with large action spaces. IEEE/ACM Trans. Audio Speech Lang. Process. 26(11), 2083–2097 (2018)
Acknowledgements
Many thanks to our colleagues from the NGOs PRAKSIS and CARITAS, Generalitat de Catalunya, Mind Refuge, KEMEA, and ISocial Foundation for their guidance and constant constructive feedback!
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Wanner, L. et al. (2021). Towards a Versatile Intelligent Conversational Agent as Personal Assistant for Migrants. In: Dignum, F., Corchado, J.M., De La Prieta, F. (eds) Advances in Practical Applications of Agents, Multi-Agent Systems, and Social Good. The PAAMS Collection. PAAMS 2021. Lecture Notes in Computer Science(), vol 12946. Springer, Cham. https://doi.org/10.1007/978-3-030-85739-4_26
Download citation
DOI: https://doi.org/10.1007/978-3-030-85739-4_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85738-7
Online ISBN: 978-3-030-85739-4
eBook Packages: Computer ScienceComputer Science (R0)