"When He Feels Cold, He Goes to the Seahorse"—Blending Generative AI into Multimaterial Storymaking for Family Expressive Arts Therapy
Authors: 
Di Liu, Hanqing Zhou, 
Pengcheng AnAuthors Info & Claims
Article No.: 118, Pages 1 - 21
Abstract
Storymaking, as an integrative form of expressive arts therapy, is an effective means to foster family communication. Yet, the integration of generative AI as expressive materials in therapeutic storymaking remains underexplored. And there is a lack of HCI implications on how to support families and therapists in this context. Addressing this, our study involved five weeks of storymaking sessions with seven families guided by a professional therapist. In these sessions, the families used both traditional art-making materials and image-based generative AI to create and evolve their family stories. Via the rich empirical data and commentaries from four expert therapists, we contextualize how families creatively melded AI and traditional expressive materials to externalize their ideas and feelings. Through the lens of Expressive Therapies Continuum (ETC), we characterize the therapeutic implications of AI as expressive materials. Desirable interaction qualities to support children, parents, and therapists are distilled for future HCI research.
Supplemental Material
MP4 File - Video Preview
Video Preview
- Download
- 20.25 MB
- Download
- 159.95 MB
- Transcript
- Download
- 100.19 MB
- Transcript
References
[1]
Ibrahim Oluwajoba Adisa, Ian Thompson, Tolulope Famaye, Deepika Sistla, Cinamon Sunrise Bailey, Katherine Mulholland, Alison Fecher, Caitlin Marie Lancaster, and Golnaz Arastoopour Irgens. 2023. S.P.O.T: A Game-Based Application for Fostering Critical Machine Learning Literacy Among Children. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (Chicago, IL, USA) (IDC ’23). Association for Computing Machinery, New York, NY, USA, 507–511. https://doi.org/10.1145/3585088.3593884
[2]
Naseem Ahmadpour, Lian Loke, Carl Gray, Yidan Cao, Chloe Macdonald, and Rebecca Hart. 2023. Understanding how technology can support social-emotional learning of children: a dyadic trauma-informed participatory design with proxies. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (, Hamburg, Germany,) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 299, 17 pages. https://doi.org/10.1145/3544548.3581032
[3]
Isabel Machado Alexandre, David Jardim, and Pedro Faria Lopes. 2010. Maths4Kids: telling stories with Maths. In Proceedings of the Intelligent Narrative Technologies III Workshop (Monterey, California) (INT3 ’10). Association for Computing Machinery, New York, NY, USA, Article 4, 6 pages. https://doi.org/10.1145/1822309.1822313
[4]
Safinah Ali, Hae Won Park, and Cynthia Breazeal. 2020. Can Children Emulate a Robotic Non-Player Character’s Figural Creativity?. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Virtual Event, Canada) (CHI PLAY ’20). Association for Computing Machinery, New York, NY, USA, 499–509. https://doi.org/10.1145/3410404.3414251
[5]
Safinah Ali, Hae Won Park, and Cynthia Breazeal. 2021. A social robot’s influence on children’s figural creativity during gameplay. International Journal of Child-Computer Interaction 28 (2021), 100234.
[6]
Aika Patricia Baldovino, Frances Neele Vergonio, and John Paul Tomas. 2019. Child Attention Detection through Facial Expression Recognition using SVM Algorithm. In Proceedings of the 2019 International Conference on Information Technology and Computer Communications (Singapore, Singapore) (ITCC ’19). Association for Computing Machinery, New York, NY, USA, 52–58. https://doi.org/10.1145/3355402.3355411
[7]
V Barclay Goldstein. 1999. The magic of mess painting: the creativity mobilization technique.Sausalito, California, Trans-Hyborean Institute of Science, New York, NY, USA.
[8]
Paula M Barrett, Amanda L Duffy, Mark R Dadds, and Ronald M Rapee. 2001. Cognitive–behavioral treatment of anxiety disorders in children: Long-term (6-year) follow-up.Journal of consulting and clinical psychology 69, 1 (2001), 135.
[9]
Erin Beneteau, Ashley Boone, Yuxing Wu, Julie A. Kientz, Jason Yip, and Alexis Hiniker. 2020. Parenting with Alexa: Exploring the Introduction of Smart Speakers on Family Dynamics. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376344
[10]
Erin Beneteau, Olivia K. Richards, Mingrui Zhang, Julie A. Kientz, Jason Yip, and Alexis Hiniker. 2019. Communication Breakdowns Between Families and Alexa. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300473
[11]
Dawn O Braithwaite, Elizabeth A Suter, and Kory Floyd. 2017. Engaging theories in family communication: Multiple perspectives. Routledge, New York, NY, USA.
[12]
Franziska Brändle, Lena J Stocks, Joshua B Tenenbaum, Samuel J Gershman, and Eric Schulz. 2023. Empowerment contributes to exploration behaviour in a creative video game. Nature Human Behaviour 7, 1481–1489 (2023), 1–9.
[13]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
[14]
Eileen Brosnan, Carol Fitzpatrick, John Sharry, and Richard Boyle. 2006. An evaluation of the integrated use of a multimedia storytelling system within a psychotherapy intervention for adolescents. In CHI ’06 Extended Abstracts on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI EA ’06). Association for Computing Machinery, New York, NY, USA, 598–603. https://doi.org/10.1145/1125451.1125576
[15]
Jim Budd, Krystina Madej, Jenna Stephens-Wells, Janice de Jong, Ehren Katzur, and Laura Mulligan. 2007. PageCraft: learning in context a tangible interactive storytelling platform to support early narrative development for young children. In Proceedings of the 6th International Conference on Interaction Design and Children (Aalborg, Denmark) (IDC ’07). Association for Computing Machinery, New York, NY, USA, 97–100. https://doi.org/10.1145/1297277.1297296
[16]
Bengisu Cagiltay, Bilge Mutlu, and Margaret L Kerr. 2023. Family Theories in Child-Robot Interactions: Understanding Families as a Whole for Child-Robot Interaction Design. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (Chicago, IL, USA) (IDC ’23). Association for Computing Machinery, New York, NY, USA, 367–374. https://doi.org/10.1145/3585088.3589386
[17]
Zhenyao Cai. 2023. EmotionBlock: A Tangible Toolkit for Social-emotional Learning Through Storytelling. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (Chicago, IL, USA) (IDC ’23). Association for Computing Machinery, New York, NY, USA, 693–696. https://doi.org/10.1145/3585088.3594485
[18]
Justine Cassell and Kimiko Ryokai. 2001. Making space for voice: Technologies to support children’s fantasy and storytelling. Personal and ubiquitous computing 5 (2001), 169–190.
[19]
Eleanor Chin Derix, Tuck Wah Leong, and Julia Prior. 2022. “It’s A Drag”: Exploring How to Improve Parents’ Experiences of Managing Mobile Device Use During Family Time. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans,LA,USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 216, 20 pages. https://doi.org/10.1145/3491102.3517501
[20]
Peter Knøsgaard Christensen, Christoffer Øland Skovgaard, and Marianne Graves Petersen. 2019. Together Together: Combining Shared and Separate Activities in Designing Technology for Family Life. In Proceedings of the 18th ACM International Conference on Interaction Design and Children (Boise, ID, USA) (IDC ’19). Association for Computing Machinery, New York, NY, USA, 374–385. https://doi.org/10.1145/3311927.3323141
[21]
Raymond Corsini. 2017. Role playing in psychotherapy. Routledge, USA.
[22]
Agathe David-Weill. 2020. Models And Metaphors Of Play Therapy: The Role Of The Child Therapist. Child Development Theses 41, 41 (2020), 144–167.
[23]
Griffin Dietz, Jimmy K Le, Nadin Tamer, Jenny Han, Hyowon Gweon, Elizabeth L Murnane, and James A. Landay. 2021. StoryCoder: Teaching Computational Thinking Concepts Through Storytelling in a Voice-Guided App for Children. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 54, 15 pages. https://doi.org/10.1145/3411764.3445039
[24]
Griffin Dietz, Nadin Tamer, Carina Ly, Jimmy K Le, and James A. Landay. 2023. Visual StoryCoder: A Multimodal Programming Environment for Children’s Creation of Stories. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 96, 16 pages. https://doi.org/10.1145/3544548.3580981
[25]
Stable Diffusion. 2023. Stable Diffusion Public Release. Stable Diffusion. https://stability.ai/blog/stable- diffusion- public- release
[26]
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. UX Design Innovation: Challenges for Working with Machine Learning as a Design Material. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 278–288. https://doi.org/10.1145/3025453.3025739
[27]
Rudolf Dreikurs. 1959. The courage to be imperfect. Oregon Society of Individual Psychology.
[28]
Stefania Druga, Fee Lia Christoph, and Amy J Ko. 2022. Family as a Third Space for AI Literacies: How do children and parents learn about AI together?. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 225, 17 pages. https://doi.org/10.1145/3491102.3502031
[29]
Allison Druin, Benjamin B. Bederson, and Alex Quinn. 2009. Designing intergenerational mobile storytelling. In Proceedings of the 8th International Conference on Interaction Design and Children (Como, Italy) (IDC ’09). Association for Computing Machinery, New York, NY, USA, 325–328. https://doi.org/10.1145/1551788.1551875
[30]
Xuejun Du, Pengcheng An, Justin Leung, April Li, Linda E Chapman, and Jian Zhao. 2024. DeepThInk: Designing and probing human-AI co-creation in digital art therapy. International Journal of Human-Computer Studies 181 (2024), 103139.
[31]
Ninat M Friedland. 2010. Stories of substance: Story-making in art therapy with substance-abusing mothers and their children. Ph.D. Dissertation. Concordia University.
[32]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM 63, 11 (oct 2020), 139–144. https://doi.org/10.1145/3422622
[33]
Helen Greenwood, Chris Leach, Mike Lucock, and Rachael Noble. 2007. The process of long-term art therapy: a case study combining artwork and clinical outcome. Psychotherapy Research 17, 5 (2007), 588–599.
[34]
Stephen Grossberg. 2013. Recurrent neural networks. Scholarpedia 8, 2 (2013), 1888.
[35]
Ariel Han and Zhenyao Cai. 2023. Design implications of generative AI systems for visual storytelling for young learners. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (Chicago, IL, USA) (IDC ’23). Association for Computing Machinery, New York, NY, USA, 470–474. https://doi.org/10.1145/3585088.3593867
[36]
Ruth Harpaz. 2016. Storytelling as Visual Narratives Representations in Art Therapy. Brill, Leiden, The Netherlands, 135 – 147. https://doi.org/10.1163/9781848883802_014
[37]
Steve Harvey. 1990. Dynamic play therapy: An integrative expressive arts approach to the family therapy of young children. The Arts in Psychotherapy 17, 3 (1990), 239–246.
[38]
Lisa D Hinz. 2019. Expressive therapies continuum: A framework for using art in therapy. Routledge, New York.
[39]
Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. Advances in neural information processing systems 33 (2020), 6840–6851.
[40]
Lars Erik Holmquist. 2017. Intelligence on tap: artificial intelligence as a new design material. interactions 24, 4 (2017), 28–33.
[41]
Kristina Höök and Jonas Löwgren. 2012. Strong concepts: Intermediate-level knowledge in interaction design research. ACM Transactions on Computer-Human Interaction (TOCHI) 19, 3 (2012), 1–18.
[42]
Layne Jackson Hubbard, Yifan Chen, Eliana Colunga, Pilyoung Kim, and Tom Yeh. 2021. Child-Robot Interaction to Integrate Reflective Storytelling Into Creative Play. In Proceedings of the 13th Conference on Creativity and Cognition (Virtual Event, Italy) (C&C ’21). Association for Computing Machinery, New York, NY, USA, Article 16, 8 pages. https://doi.org/10.1145/3450741.3465254
[43]
Sue Jennings. 2005. Embodiment-projection-role: A developmental model for the play therapy method. International handbook of play therapy: Advances in assessment, theory, research, and practice 76, 65 (2005), 65–76.
[44]
Jasmine Jones and Mark S. Ackerman. 2018. Co-constructing Family Memory: Understanding the Intergenerational Practices of Passing on Family Stories. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173998
[45]
Phil Jones. 1991. Dramatherapy: Five core processes. Dramatherapy 14, 1 (1991), 8–15.
[46]
Sandra L Kagin and Vija B. Lusebrink. 1978. The expressive therapies continuum. Art Psychotherapy 5, 4 (1978), 171–180. https://doi.org/10.1016/0090-9092(78)90031-5
[47]
Zabihollah KavehFarsani, Roya Kelishadi, and Kioumars Beshlideh. 2020. Study of the effect of family communication and function, and satisfaction with body image, on psychological well-being of obese girls: the mediating role of self-esteem and depression. Child and adolescent psychiatry and mental health 14 (2020), 1–10.
[48]
Christine Kerr. 2011. Family art therapy: Foundations of theory and practice. Routledge, New York, NY, United States.
[49]
David Kirsh. 2013. Embodied cognition and the magical future of interaction design. ACM Transactions on Computer-Human Interaction (TOCHI) 20, 1 (2013), 1–30.
[50]
Bernadett Koles and Peter Nagy. 2016. Avatars as transitional objects: The impact of avatars and digital objects on adolescent gamers. Journal of Gaming & Virtual Worlds 8, 3 (2016), 279–296.
[51]
Jacqueline Kory and Cynthia Breazeal. 2014. Storytelling with robots: Learning companions for preschool children’s language development. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. IEEE, USA, 643–648. https://doi.org/10.1109/ROMAN.2014.6926325
[52]
Terry Kottman. 2014. Play therapy: Basics and beyond. John Wiley & Sons, USA.
[53]
Chinmay Kulkarni, Stefania Druga, Minsuk Chang, Alex Fiannaca, Carrie Cai, and Michael Terry. 2023. A Word is Worth a Thousand Pictures: Prompts as AI Design Material. arXiv preprint arXiv:2303.12647 22, 22 (2023), 22.
[54]
Hanna Yaxa Kwiatkowska. 1967. Family art therapy. Family Process 6, 1 (1967), 37–55.
[55]
Nien-Hwa Lai. 2011. Expressive Arts Therapy for Mother–Child Relationship (EAT-MCR): A novel model for domestic violence survivors in Chinese culture. The Arts in Psychotherapy 38, 5 (2011), 305–311.
[56]
Amanda Lazar, Jessica L. Feuston, Caroline Edasis, and Anne Marie Piper. 2018. Making as Expression: Informing Design with People with Complex Communication Needs through Art Therapy. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3173574.3173925
[57]
Yoonjoo Lee, Tae Soo Kim, Sungdong Kim, Yohan Yun, and Juho Kim. 2023. DAPIE: Interactive Step-by-Step Explanatory Dialogues to Answer Children’s Why and How Questions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg,Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 450, 22 pages. https://doi.org/10.1145/3544548.3581369
[58]
Serena Lee-Cultura, Kshitij Sharma, Sofia Papavlasopoulou, Symeon Retalis, and Michail Giannakos. 2020. Using sensing technologies to explain children’s self-representation in motion-based educational games. In Proceedings of the Interaction Design and Children Conference (London, United Kingdom) (IDC ’20). Association for Computing Machinery, New York, NY, USA, 541–555. https://doi.org/10.1145/3392063.3394419
[59]
Myra Levick and John Herring. 1973. Family dynamics—as seen through art therapy. Art Psychotherapy 1, 1 (1973), 45–54.
[60]
Ellen G Levine and Stephen K Levine. 1998. Foundations of expressive arts therapy: Theoretical and clinical perspectives. Jessica Kingsley Publishers, London.
[61]
Duri Long, Sophie Rollins, Jasmin Ali-Diaz, Katherine Hancock, Samnang Nuonsinoeun, Jessica Roberts, and Brian Magerko. 2023. Fostering AI Literacy with Embodiment & Creativity: From Activity Boxes to Museum Exhibits. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (Chicago, IL, USA) (IDC ’23). Association for Computing Machinery, New York, NY, USA, 727–731. https://doi.org/10.1145/3585088.3594495
[62]
Fei Lu, Feng Tian, Yingying Jiang, Xiang Cao, Wencan Luo, Guang Li, Xiaolong Zhang, Guozhong Dai, and Hongan Wang. 2011. ShadowStory: creative and collaborative digital storytelling inspired by cultural heritage. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver,BC,Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 1919–1928. https://doi.org/10.1145/1978942.1979221
[63]
Michal Luria, Ophir Sheriff, Marian Boo, Jodi Forlizzi, and Amit Zoran. 2020. Destruction, catharsis, and emotional release in human-robot interaction. ACM Transactions on Human-Robot Interaction (THRI) 9, 4 (2020), 1–19.
[64]
Vija B. Lusebrink. 2015. Expressive Therapies Continuum. John Wiley & Sons, Ltd, Hoboken, New Jersey, Chapter 6, 57–67. https://doi.org/10.1002/9781118306543.ch6 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/9781118306543.ch6
[65]
Vija Bergs Lusebrink 1990. Imagery and visual expression in therapy. Springer, New York, NY.
[66]
Cathy A Malchiodi. 2003. Expressive arts therapy and multimodal approaches. Handbook of art therapy 6 (2003), 106–119.
[67]
Cathy A Malchiodi. 2013. Expressive therapies. Guilford Publications, New York,NY.
[68]
Cathy A Malchiodi. 2022. Handbook of expressive arts therapy. Guilford Publications, New York,NY.
[69]
Allison Renee Manheim. 1998. The relationship between the artistic process and self-actualization. Art therapy 15, 2 (1998), 99–106.
[70]
Mark Matthews and Gavin Doherty. 2011. My mobile story: therapeutic storytelling for children. In CHI ’11 Extended Abstracts on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI EA ’11). Association for Computing Machinery, New York, NY, USA, 2059–2064. https://doi.org/10.1145/1979742.1979860
[71]
Mark Matthews, Geri Gay, and Gavin Doherty. 2014. Taking part: role-play in the design of therapeutic systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 643–652. https://doi.org/10.1145/2556288.2557103
[72]
Shaun McNiff. 1992. Art as medicine: Creating a therapy of the imagination. Shambhala Publications, Boulder, Colorado.
[73]
Joseph E. Michaelis and Bilge Mutlu. 2017. Someone to Read with: Design of and Experiences with an In-Home Learning Companion Robot for Reading. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 301–312. https://doi.org/10.1145/3025453.3025499
[74]
Midjourney. 2023. Midjourney. Midjourney. https://www.midjourney.com/app/
[75]
Abhijit Mohanta and Vinay Kumar Mittal. 2020. Classifying Speech of ASD Affected and Normal Children Using Acoustic Features. In 2020 National Conference on Communications (NCC). IEEE, IEEE, Kharagpur, India, 1–6. https://doi.org/10.1109/NCC48643.2020.9056084
[76]
Mary Claire Morr Loftus and Veronica A Droser. 2020. Parent and child experiences of parental work–family conflict and satisfaction with work and family. Journal of Family Issues 41, 9 (2020), 1649–1673.
[77]
Cheryl Neill. 2003. Storymaking and storytelling: Weaving the fabric that creates our lives. In Using the Creative Arts in Therapy and Healthcare. Routledge, Milton Park, Abingdon, Oxfordshire, 147–174.
[78]
Mizuka Ohtaka and Kaori Karasawa. 2019. Perspective-taking in families based on the social relations model. The Japanese journal of Experimental Social Psychology 58, 2 (2019), 111–115.
[79]
David H Olson. 2000. Circumplex model of marital and family systems. Journal of family therapy 22, 2 (2000), 144–167.
[80]
OpenAI. 2022. DALL·E 2. OpenAI. https://openai.com/dall- e- 2/
[81]
Beste Özcan, Daniele Caligiore, Valerio Sperati, Tania Moretta, and Gianluca Baldassarre. 2016. Transitional wearable companions: a novel concept of soft interactive social robots to improve social skills in children with autism spectrum disorder. International Journal of Social Robotics 8 (2016), 471–481.
[82]
Alisha Panjwani. 2017. Constructing Meaning: Designing Powerful Story-Making Explorations for Children to Express with Tangible Computational Media. In Proceedings of the 2017 Conference on Interaction Design and Children (Stanford, California, USA) (IDC ’17). Association for Computing Machinery, New York, NY, USA, 358–364. https://doi.org/10.1145/3078072.3079723
[83]
Luiza Superti Pantoja, Kyle Diederich, Liam Crawford, and Juan Pablo Hourcade. 2019. Voice Agents Supporting High-Quality Social Play. In Proceedings of the 18th ACM International Conference on Interaction Design and Children (Boise, ID, USA) (IDC ’19). Association for Computing Machinery, New York, NY, USA, 314–325. https://doi.org/10.1145/3311927.3323151
[84]
Hae Won Park, Rinat Rosenberg-Kima, Maor Rosenberg, Goren Gordon, and Cynthia Breazeal. 2017. Growing Growth Mindset with a Social Robot Peer. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (Vienna, Austria) (HRI ’17). Association for Computing Machinery, New York, NY, USA, 137–145. https://doi.org/10.1145/2909824.3020213
[85]
Amrita Pathak. 2023. The Complete Guide to Writing Midjourney Prompts. geekflare. https://geekflare.com/midjourney-prompts/
[86]
Susan Perrow. 2008. Healing stories for challenging behaviour. Hawthorn press, USA.
[87]
Ertugrul Portakal. 2023. Midjourney Vs. Stable Diffusion Comparison. textcortex. https://textcortex.com/post/midjourney-vs-stable-diffusion
[88]
Hayes Raffle, Rafael Ballagas, Glenda Revelle, Hiroshi Horii, Sean Follmer, Janet Go, Emily Reardon, Koichi Mori, Joseph Kaye, and Mirjana Spasojevic. 2010. Family story play: reading with young children (and elmo) over a distance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 1583–1592. https://doi.org/10.1145/1753326.1753563
[89]
Hayes Raffle, Glenda Revelle, Koichi Mori, Rafael Ballagas, Kyle Buza, Hiroshi Horii, Joseph Kaye, Kristin Cook, Natalie Freed, Janet Go, and Mirjana Spasojevic. 2011. Hello, is grandma there? let’s read! StoryVisit: family video chat and connected e-books. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver,BC,Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 1195–1204. https://doi.org/10.1145/1978942.1979121
[90]
Tayyab Rashid. 2015. Positive psychotherapy: A strength-based approach. The Journal of Positive Psychology 10, 1 (2015), 25–40.
[91]
Dafna Regev and Sharon Snir. 2017. Parent-child art psychotherapy. Routledge, New York.
[92]
Mitchel Resnick. 2017. Lifelong Kindergarten: Cultivating Creativity through Projects, Passion, Peers, and Play. The MIT Press, Cambridge, Massachusetts. https://doi.org/10.7551/mitpress/11017.001.0001
[93]
L David Ritchie and Mary Anne Fitzpatrick. 1990. Family communication patterns: Measuring intrapersonal perceptions of interpersonal relationships. Communication research 17, 4 (1990), 523–544.
[94]
Ricarose Roque, Mariana Aki Tamashiro, Kathryn Mcconnell, and Julisa Granados. 2021. Opportunities and Limitations of Construction Kits in Culturally Responsive Computing Contexts: Lessons from ScratchJr and Family Creative Learning. In Proceedings of the 20th Annual ACM Interaction Design and Children Conference (Athens, Greece) (IDC ’21). Association for Computing Machinery, New York, NY, USA, 246–256. https://doi.org/10.1145/3459990.3460728
[95]
Elisa Rubegni and Monica Landoni. 2014. Fiabot! design and evaluation of a mobile storytelling application for schools. In Proceedings of the 2014 Conference on Interaction Design and Children (Aarhus, Denmark) (IDC ’14). Association for Computing Machinery, New York, NY, USA, 165–174. https://doi.org/10.1145/2593968.2593979
[96]
Elisa Rubegni and Monica Landoni. 2018. How to Design a Digital Storytelling Authoring Tool for Developing Pre-Reading and Pre-Writing Skills. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC,Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3173574.3173969
[97]
Elisa Rubegni, Monica Landoni, Antonella De Angeli, and Letizia Jaccheri. 2019. Detecting Gender Stereotypes in Children Digital StoryTelling. In Proceedings of the 18th ACM International Conference on Interaction Design and Children (Boise, ID, USA) (IDC ’19). Association for Computing Machinery, New York, NY, USA, 386–393. https://doi.org/10.1145/3311927.3323156
[98]
Elisa Rubegni, Monica Landoni, Laura Malinverni, and Letizia Jaccheri. 2022. Raising awareness of stereotyping through collaborative digital storytelling: Design for change with and for children. International Journal of Human-Computer Studies 157 (2022), 102727.
[99]
Judith Aron Rubin. 1999. Art therapy: An introduction. Psychology Press, London, England, United Kingdom.
[100]
Kimiko Ryokai, Hayes Raffle, and Robert Kowalski. 2012. StoryFaces: pretend-play with ebooks to support social-emotional storytelling. In Proceedings of the 11th International Conference on Interaction Design and Children (Bremen, Germany) (IDC ’12). Association for Computing Machinery, New York, NY, USA, 125–133. https://doi.org/10.1145/2307096.2307111
[101]
Herman Saksono and Andrea G. Parker. 2017. Reflective Informatics Through Family Storytelling: Self-discovering Physical Activity Predictors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5232–5244. https://doi.org/10.1145/3025453.3025651
[102]
Kyle-Althea Santos, Ethel Ong, and Ron Resurreccion. 2020. Therapist vibe: children’s expressions of their emotions through storytelling with a chatbot. In Proceedings of the Interaction Design and Children Conference (London, United Kingdom) (IDC ’20). Association for Computing Machinery, New York, NY, USA, 483–494. https://doi.org/10.1145/3392063.3394405
[103]
Betty Sargeant and Florian ’Floyd’ Mueller. 2014. How far is up? encouraging social interaction through children’s book app design. In CHI ’14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA ’14). Association for Computing Machinery, New York, NY, USA, 483–486. https://doi.org/10.1145/2559206.2574784
[104]
Charles E Schaefer. 2011. Foundations of play therapy. John Wiley & Sons, Hoboken, New Jersey.
[105]
Michael Schlauch, Cristina Sylla, and Maitê Gil. 2022. Investigating Social Emotional Learning at Primary School through Guided Interactive Storytelling. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (Bremen, Germany) (CHI PLAY ’22). Association for Computing Machinery, New York, NY, USA, 240–245. https://doi.org/10.1145/3505270.3558313
[106]
Ji Youn Shin, Minjin Rheu, Jina Huh-Yoo, and Wei Peng. 2021. Designing technologies to support parent-child relationships: a review of current findings and suggestions for future directions. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–31.
[107]
Roy Shuttleworth. 1980. Drama therapy in family therapy. Dramatherapy 4, 1-2 (1980), 1–9.
[108]
Amalia Slater. 2004. Healing and stone carving. Art Therapy 21, 4 (2004), 226–230.
[109]
Cristina Sylla, Clara Coutinho, Pedro Branco, and Wolfgang Müller. 2015. Investigating the use of digital manipulatives for storytelling in pre-school. International Journal of Child-Computer Interaction 6 (2015), 39–48.
[110]
Midjourney Team. 2022. Community Guidelines. Midjourney. https://docs.midjourney.com/docs/community-guidelines
[111]
Jakob Tholander and Martin Jonsson. 2023. Design Ideation with AI - Sketching, Thinking and Talking with Generative Machine Learning Models. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh,PA,USA) (DIS ’23). Association for Computing Machinery, New York, NY, USA, 1930–1940. https://doi.org/10.1145/3563657.3596014
[112]
Elinor Ulman. 2001. Art therapy: Problems of definition. American journal of art therapy 40, 1 (2001), 16.
[113]
Gisela Wajskop and Shelley Stagg Peterson. 2015. Dramatic play as a meaning-making and story-making activity. Early Childhood Education 43, 1 (2015), 17–20.
[114]
Ron Wakkary, Audrey Desjardins, and Sabrina Hauser. 2016. Unselfconscious interaction: A conceptual construct. Interacting with Computers 28, 4 (2016), 501–520.
[115]
Torben Wallbaum, Andrii Matviienko, Swamy Ananthanarayan, Thomas Olsson, Wilko Heuten, and Susanne C.J. Boll. 2018. Supporting Communication between Grandparents and Grandchildren through Tangible Storytelling Systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174124
[116]
Ge Wang, Jun Zhao, Max Van Kleek, and Nigel Shadbolt. 2022. Informing Age-Appropriate AI: Examining Principles and Practices of AI for Children. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans,LA,USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 536, 29 pages. https://doi.org/10.1145/3491102.3502057
[117]
Yunlong Wang, Shuyuan Shen, and Brian Y Lim. 2023. RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 22, 29 pages. https://doi.org/10.1145/3544548.3581402
[118]
Britt-Maj Wikström. 2005. Communicating via expressive arts: the natural medium of self-expression for hospitalized children.Pediatric nursing 31, 6 (2005), 480–5.
[119]
Donald W. Winnicott. 2016. Transitional Objects and Transitional Phenomena. In The Collected Works of D. W. Winnicott: Volume 3, 1946-1951. Oxford University Press, USA,New York. https://doi.org/10.1093/med:psych/9780190271350.003.0088 arXiv:https://academic.oup.com/book/0/chapter/140295268/chapter-ag-pdf/45418501/book_1312_section_140295268.ag.pdf
[120]
Martin Wöllmer, Björn Schuller, Anton Batliner, Stefan Steidl, and Dino Seppi. 2011. Tandem decoding of children’s speech for keyword detection in a child-robot interaction scenario. ACM Transactions on Speech and Language Processing (TSLP) 7, 4 (2011), 1–22.
[121]
Zhiwen Xiao, Xiaoming Li, and Bonita Stanton. 2011. Perceptions of parent–adolescent communication within families: It is a matter of perspective. Psychology, health & medicine 16, 1 (2011), 53–65.
[122]
Wenjie Xu, Jiayi Ma, Jiayu Yao, Weijia Lin, Chao Zhang, Xuanhe Xia, Nan Zhuang, Shitong Weng, Xiaoqian Xie, Shuyue Feng, Fangtian Ying, Preben Hansen, and Cheng Yao. 2023. MathKingdom: Teaching Children Mathematical Language Through Speaking at Home via a Voice-Guided Game. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg,Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 93, 14 pages. https://doi.org/10.1145/3544548.3581043
[123]
Ying Xu, Joseph Aubele, Valery Vigil, Andres S Bustamante, Young-Suk Kim, and Mark Warschauer. 2022. Dialogue with a conversational agent promotes children’s story comprehension via enhancing engagement. Child Development 93, 2 (2022), e149–e167.
[124]
Ying Xu, Kunlei He, Valery Vigil, Santiago Ojeda-Ramirez, Xuechen Liu, Julian Levine, Kelsyann Cervera, and Mark Warschauer. 2023. “Rosita Reads With My Family”: Developing A Bilingual Conversational Agent to Support Parent-Child Shared Reading. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (Chicago, IL, USA) (IDC ’23). Association for Computing Machinery, New York, NY, USA, 160–172. https://doi.org/10.1145/3585088.3589354
[125]
Ying Xu, Valery Vigil, Andres S Bustamante, and Mark Warschauer. 2022. Contingent interaction with a television character promotes children’s science learning and engagement. Journal of Applied Developmental Psychology 81 (2022), 101439.
[126]
Ying Xu, Valery Vigil, Andres S. Bustamante, and Mark Warschauer. 2022. “Elinor’s Talking to Me!”:Integrating Conversational AI into Children’s Narrative Science Programming. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans,LA,USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 166, 16 pages. https://doi.org/10.1145/3491102.3502050
[127]
Junnan Yu, Andrea DeVore, and Ricarose Roque. 2021. Parental Mediation for Young Children’s Use of Educational Media: A Case Study with Computational Toys and Kits. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama,Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 475, 12 pages. https://doi.org/10.1145/3411764.3445427
[128]
Junnan Yu, Sari Widman, and Ricarose Roque. 2023. Family Negotiation in Joint Media Engagement with Creative Computing. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg,Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 92, 15 pages. https://doi.org/10.1145/3544548.3580667
[129]
Niloofar Zarei, Sharon Lynn Chu, Francis Quek, Nanjie ’Jimmy’ Rao, and Sarah Anne Brown. 2020. Investigating the Effects of Self-Avatars and Story-Relevant Avatars on Children’s Creative Storytelling. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu,HI,USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3313831.3376331
[130]
Niloofar Zarei, Francis Quek, Sharon Lynn Chu, and Sarah Anne Brown. 2021. Towards Designing Enactment-Scaffolded Narrative Authoring Tools for Elementary-School Children. In Proceedings of the 20th Annual ACM Interaction Design and Children Conference (Athens, Greece) (IDC ’21). Association for Computing Machinery, New York, NY, USA, 387–395. https://doi.org/10.1145/3459990.3460726
[131]
Chao Zhang, Cheng Yao, Jiayi Wu, Weijia Lin, Lijuan Liu, Ge Yan, and Fangtian Ying. 2022. StoryDrawer: A Child–AI Collaborative Drawing System to Support Children’s Creative Visual Storytelling. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans,LA,USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 311, 15 pages. https://doi.org/10.1145/3491102.3501914
[132]
Chao Zhang, Zili Zhou, Yajing Hu, Lanjing Liu, Jiayi Wu, Yaping Shao, Jianhui Liu, Lingyan Zhang, Lijuan Liu, Hangyue Chen, Fangtian Ying, and Cheng Yao. 2023. Observe It, Draw It: Scaffolding Children’s Observations of Plant Biodiversity with an Interactive Drawing Tool. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (Chicago, IL, USA) (IDC ’23). Association for Computing Machinery, New York, NY, USA, 253–266. https://doi.org/10.1145/3585088.3589380
[133]
Zheng Zhang, Ying Xu, Yanhao Wang, Bingsheng Yao, Daniel Ritchie, Tongshuang Wu, Mo Yu, Dakuo Wang, and Toby Jia-Jun Li. 2022. StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 218, 21 pages. https://doi.org/10.1145/3491102.3517479
Index Terms
- "When He Feels Cold, He Goes to the Seahorse"—Blending Generative AI into Multimaterial Storymaking for Family Expressive Arts Therapy
Index terms have been assigned to the content through auto-classification.
Recommendations
Finding common ground: comparing children's and parents' views on children's online safety
HCI '17: Proceedings of the 31st British Computer Society Human Computer Interaction ConferenceThis study examines children's online safety with a particular interest in children's online safety skills and conduct as well as parents' mediation strategies. A survey of 141 children and 163 parents was conducted. Children have encountered a variety ...
Individual Differences of Children with Autism in Robot-assisted Autism Therapy
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot InteractionResearch has recognized the importance of individual differences of children with Autism Spectrum Disorder (ASD) that require interventions to meet their heterogeneous needs. This relatively large-scale study investigates a robot-assisted autism therapy (...
Changing Family Practices with Assistive Technology: MOBERO Improves Morning and Bedtime Routines for Children with ADHD
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsFamilies of children with Attention Deficit Hyperactivity Disorder (ADHD) often report morning and bedtime routines to be stressful and frustrating. Through a design process involving domain professionals and families we designed MOBERO, a smartphone-...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Badges
Artifacts Available / v1.1
Honorable Mention
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- NSSFC Art Grant
Conference
Acceptance Rates
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%
Upcoming Conference
CHI '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 1,505Total Downloads
- Downloads (Last 12 months)1,505
- Downloads (Last 6 weeks)289
Reflects downloads up to 13 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format