Abstract
Social robots are autonomous entities able to engage humans at the emotional and social level. They are being used in several domains, especially in those where kids are the primary users (i.e., education, games, rehabilitation). The paper presents an experience in which the social robot Pepper is used as a storyteller. A storyteller robot should engage humans by combining its verbal and non-verbal behaviors and ‘immerse’ the user into the story. Therefore, to design an engaging and effective storytelling experience we started to address a first design issue: does a human voice have an advantage over a synthesized voice of the robot in this context? To this aim, two versions of the same story for kids from 8 to 9 y.o. have been developed. The social robot Pepper was used to tell the story in two modalities. In the first modality, Pepper storyteller was designed as a kind of audiobook in which the robot had just the role of a device, but the story was narrated by a human voice; in the second modality, Pepper was designed to tell the story using its own voice combined with non-verbal behaviors. The system has been tested in a real context and results show that Pepper’s voice affected more positively the children’s emotional experience, also by giving the children the perception that they learn more easily.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Groce, R.D.: An experiential study of elementary teachers with the storytelling process: Interdisciplinary benefits associated with teacher training and classroom integration. Read. Improv. 41(2), 122–129 (2004)
Alexander, B.: The New Digital Storytelling: Creating Narratives with New Media--Revised and Updated Edition. ABC-CLIO (2017)
Syafryadin, H., Salniwati, A.R.A.P.: Digital storytelling implementation for enhancing students’ speaking ability in various text genres. Int. J. Recent Technol. Eng. (IJRTE) 8(4), 3147–3151 (2019)
Van Maas, S.: Opening the audiobook. Comp. Lit. 70(3), 337–356 (2018)
Malerba, D., et al.: Advanced programming of intelligent social robots. J. e-Learn. Knowl. Soc. 15(2), 13–26 (2019)
Westlund, J.M.K., Dickens, L., Jeong, S., Harris, P.L., DeSteno, D., Breazeal, C.L.: Children use non-verbal cues to learn new words from robots as well as people. Int. J. Child-Comput. Interact. 13, 1–9 (2017)
Castellano, G., De Carolis, B., D’Errico, F., Macchiarulo, N., Rossano, V.: PeppeRecycle: improving children’s attitude toward recycling by playing with a social robot. Int. J. Soc. Robot. 13(1), 97–111 (2021). https://doi.org/10.1007/s12369-021-00754-0
Isbell, R., Sobol, J., Lindauer, L., Lowrance, A.: The effects of storytelling and story reading on the oral language complexity and story comprehension of young children. Early Child. Educ. J. 32(3), 157–163 (2004). https://doi.org/10.1023/B:ECEJ.0000048967.94189.a3
Bruner, J.: Actual Minds, Possible Worlds. Harvard University Press, Cambridge (1986)
Robin, B.R.: Digital storytelling: a powerful technology tool for the 21st century classroom. Theory Pract. 47(3), 220–228 (2008)
Rossano, V., Roselli, T.: Game-based learning as effective learning method: an application of digital storytelling. In: 2018 22nd International Conference Information Visualisation (IV), pp. 542–546. IEEE (2018)
Barrett, H.: Researching and evaluating digital storytelling as a deep learning tool. In: Professional of Society for Information Technology & Teacher Education International Conference, pp. 647–654. AACE (2006)
Smeda, N., Dakich, E., Sharda, N.: The effectiveness of digital storytelling in the classrooms: a comprehensive study. Smart Learn. Environ. 1(1), 1–21 (2014). https://doi.org/10.1186/s40561-014-0006-3
Chan, B.S.K., Churchill, D., Chiu, T.K.F.: Digital literacy learning in higher education through digital storytelling approach. J. Int. Educ. Res. (JIER) 13(1), 1–16 (2017)
Rong, L.P., Noor, N.M.: Digital storytelling as a creative teaching method in promoting secondary school students’ writing skills. Int. J. Interact. Mob. Technol. 13(7), 10–11 (2019)
Moreau, K.A., Eady, K., Sikora, L., Horsley, T.: Digital storytelling in health professions education: a systematic review. BMC Med. Educ. 18(1), 1–9 (2018)
Hamilton, A., Rubin, D., Tarrant, M., Gleason, M.: Digital storytelling as a tool for fostering reflection. Front. Interdisc. J. Study Abroad 31(1), 59–73 (2019)
Leite, I., et al.: Emotional storytelling in the classroom: individual versus group interaction between children and robots. In: Proceedings of 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 75–82. IEEE (2015)
Conti, D., Di Nuovo, A., Cirasa, C., Di Nuovo, S.: A comparison of kindergarten storytelling by human and humanoid robot with different social behavior. In: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 97–98. ACM (2017)
Westlund, J.K., Breazeal, C.: The interplay of robot language level with children’s language learning during storytelling. In: Proceedings of the 10th ACM/IEEE International Conference on Human-Robot Interaction - Extended Abstracts. ACM, pp. 65–66. ACM (2015)
Costa, S., Brunete, A., Bae, B.-C., Mavridis, N.: Emotional storytelling using virtual and robotic agents. Int. J. Humanoid Robot. 15(3), 1850006 (2018)
Fabri, S., Pasini, M.: Tu sei la Regina delle Oasi Incantate. Giunti (1994)
Poggi, I., D’Errico, F.: Social signals: a framework in terms of goals and beliefs. Cogn. Process. 13(2), 427–445 (2012). https://doi.org/10.1007/s10339-012-0512-6
D’Errico, F., Paciello, M., De Carolis, B., Vattani, A., Palestra, G., Anzivino, G.: Cognitive emotions in e-learning processes and their potential relationship with students’ academic adjustment. J. Educ. Psychol. 10(1), 89–111 (2018)
D’Errico, F., Poggi, I.: Tracking a leader’s humility and its emotions from body, face and voice. In: Web Intelligence, vol. 17, no. 1, pp. 63–74. IOS Press (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
De Carolis, B., D’Errico, F., Rossano, V. (2021). Pepper as a Storyteller: Exploring the Effect of Human vs. Robot Voice on Children’s Emotional Experience. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12933. Springer, Cham. https://doi.org/10.1007/978-3-030-85616-8_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-85616-8_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85615-1
Online ISBN: 978-3-030-85616-8
eBook Packages: Computer ScienceComputer Science (R0)