research-article

StoryDrawer: A Child–AI Collaborative Drawing System to Support Children's Creative Visual Storytelling

Authors:

Fangtian YingAuthors Info & Claims

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Article No.: 311, Pages 1 - 15

https://doi.org/10.1145/3491102.3501914

Published: 29 April 2022 Publication History

Abstract

Visual storytelling is a new approach to creative expression based on verbal and figural creativity. The keys to visual storytelling are narrating and drawing over a period of time, which can be beneficial but also demanding on creativity for children. Informed by need-finding investigations, we developed StoryDrawer, a co-creative system that supports visual storytelling for children aged 6–10 years through collaborative drawing between children and artificial intelligence (AI). The system includes a context-based voice agent and two AI-driven collaborative strategies: the real-time transformation of children's telling into drawings, and the generation of abstract sketches with semantic similarity to existing story content. We conducted a 2 × 2 study with 64 children to evaluate the efficacy of StoryDrawer by varying the two strategies in four conditions. The results suggest that StoryDrawer provoked participants’ creative and elaborate ideas and contributed to their creative outcomes during an engaging visual storytelling experience.

Supplementary Material

MP4 File (3491102.3501914-video-figure.mp4)

Video Figure

Download
97.58 MB

MP4 File (3491102.3501914-video-preview.mp4)

Video Preview

Download
33.91 MB

MP4 File (3491102.3501914-talk-video.mp4)

Talk Video

Download
172.98 MB

References

[1]

Forest Agostinelli, Mihir Mavalankar, Vedant Khandelwal, Hengtao Tang, Dezhi Wu, Barnett Berry, Biplav Srivastava, Amit Sheth, and Matthew Irvin. 2021. Designing children's new learning partner: collaborative artificial intelligence for learning to solve the rubik's cube. In Interaction Design and Children (IDC ’21). Association for Computing Machinery, New York, NY, USA, 610–614. https://doi.org/10.1145/3459990.3465175

Digital Library

[2]

Safinah Ali, Hae Won Park, and Cynthia Breazeal. 2020. Can children emulate a robotic non-player character's figural creativity? In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’20). Association for Computing Machinery, New York, NY, USA, 499–509. https://doi.org/10.1145/3410404.3414251

Digital Library

[3]

Safinah Ali, Hae Won Park, and Cynthia Breazeal. 2021. A social robot's influence on children's figural creativity during gameplay. Int. J. Child-Comput. Interact. 28, (June 2021), 100234. https://doi.org/10.1016/j.ijcci.2020.100234

Digital Library

[4]

Patrícia Alves-Oliveira, Patrícia Arriaga, Ana Paiva, and Guy Hoffman. 2017. YOLO, a robot for creativity: a co-design study with children. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC ’17). Association for Computing Machinery, New York, NY, USA, 423–429. https://doi.org/10.1145/3078072.3084304

Digital Library

[5]

Teresa M. Amabile. 1982. Social psychology of creativity: a consensual assessment technique. J. Pers. Soc. Psychol. 43, 5 (1982), 997–1013. https://doi.org/10.1037/0022-3514.43.5.997

[6]

Catherine Angell, Jo Alexander, and Jane A Hunt. 2015. “Draw, write and tell”: a literature review and methodological development on the “draw and write” research method. J. Early Child. Res. 13, 1 (February 2015), 17–28. https://doi.org/10.1177/1476718X14538592

[7]

Alissa N. Antle, Greg Corness, and Milena Droumeva. 2009. What the body knows: exploring the benefits of embodied metaphors in hybrid physical digital environments. Interact. Comput. 21, 1–2 (January 2009), 66–75. https://doi.org/10.1016/j.intcom.2008.10.005

Digital Library

[8]

Rudolf Arnheim. 2004. Art and Visual Perception: A Psychology of the Creative Eye. University of California Press, Berkeley, Calif.

[9]

Rudolf Arnheim. 2004. Visual Thinking. University of California Press, Berkeley, Calif.

[10]

Hamlet Autman and Stephanie Kelly. 2017. Reexamining the writing apprehension measure. Bus. Prof. Commun. Q. 80, 4 (December 2017), 516–529. https://doi.org/10.1177/2329490617691968

[11]

Tony Belpaeme, James Kennedy, Aditi Ramachandran, Brian Scassellati, and Fumihide Tanaka. 2018. Social robots for education: a review. Sci. Robot. 3, 21 (August 2018). https://doi.org/10.1126/scirobotics.aat5954

[12]

Tom Bocklisch, Joey Faulkner, Nick Pawlowski, and Alan Nichol. 2017. Rasa: open source language understanding and dialogue management. arXiv:1712.05181 [cs]. Retrieved from http://arxiv.org/abs/1712.05181

[13]

Margaret A. Boden. 1991. The Creative Mind: Myths & Mechanisms. Basic Books, New York, NY, US.

[14]

Simon Bourdeau, Annemarie Lesage, Béatrice Couturier Caron, and Pierre-Majorique Léger. 2020. When design novices and lego® meet: stimulating creative thinking for interface design. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376495

Digital Library

[15]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qual. Res. Psychol. 3, 2 (January 2006), 77–101. https://doi.org/10.1191/1478088706qp063oa

[16]

Cynthia Breazeal, Paul L. Harris, David DeSteno, Jacqueline M. Kory Westlund, Leah Dickens, and Sooyeon Jeong. 2016. Young children treat robots as informants. Top. Cogn. Sci. 8, 2 (April 2016), 481–491. https://doi.org/10.1111/tops.12192

[17]

David Buckingham. 2009. “Creative” visual methods in media research: possibilities, problems and proposals. Media Cult. Soc. 31, 4 (July 2009), 633–652. https://doi.org/10.1177/0163443709335280

[18]

Tony Caputo, Jim Steranko, and Harlan Ellison. 2002. Visual Storytelling: The Art and Technique. Watson-Guptill, New York.

[19]

Sharon Lynn Chu and Francis Quek. 2013. MAIA: a methodology for assessing imagination in action. In CHI 2013 Workshop on Evaluation Methods for Creativity Support Environments. Association for Computing Machinery, New York, NY, USA.

[20]

Sharon Lynn Chu and Francis Quek. 2014. The effects of visual contextual structures on children's imagination in story authoring interfaces. In Proceedings of the 2014 conference on Interaction design and children (IDC ’14). Association for Computing Machinery, New York, NY, USA, 329–332. https://doi.org/10.1145/2593968.2610484

Digital Library

[21]

Sharon Lynn Chu, Francis Quek, and Joshua Tanenbaum. 2013. Performative authoring: nurturing storytelling in children through imaginative enactment. In Interactive Storytelling (Lecture Notes in Computer Science). Springer International Publishing, Cham, 144–155. https://doi.org/10.1007/978-3-319-02756-2_18

Digital Library

[22]

Sharon Lynn Chu Yew Yee, Francis K.H. Quek, and Lin Xiao. 2011. Studying medium effects on children's creative processes. In Proceedings of the 8th ACM conference on Creativity and cognition (C&C ’11). Association for Computing Machinery, New York, NY, USA, 3–12. https://doi.org/10.1145/2069618.2069622

Digital Library

[23]

Mary L. Courage, Aishah Bakhtiar, Cheryll Fitzpatrick, Sophie Kenny, and Katie Brandeau. 2015. Growing up multitasking: the costs and benefits for cognitive development. Dev. Rev. 35, (March 2015), 5–41. https://doi.org/10.1016/j.dr.2014.12.002

[24]

Jim Davies, Ashok K. Goel, and Nancy J. Nersessian. 2009. A computational model of visual analogies in design. Cogn. Syst. Res. 10, 3 (September 2009), 204–215. https://doi.org/10.1016/j.cogsys.2008.09.006

Digital Library

[25]

Nicholas Davis. 2015. An enactive approach to facilitate interactive machine learning for co-creative agents. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition (C&C ’15). Association for Computing Machinery, New York, NY, USA, 345–346. https://doi.org/10.1145/2757226.2764773

Digital Library

[26]

Nicholas Davis, Chih-Pin Hsiao, Kunwar Yashraj Singh, Brenda Lin, and Brian Magerko. 2017. Creative sense-making: quantifying interaction dynamics in co-creation. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (C&C ’17). Association for Computing Machinery, New York, NY, USA, 356–366. https://doi.org/10.1145/3059454.3059478

Digital Library

[27]

Nicholas Davis, Holger Winnemöller, Mira Dontcheva, and Ellen Yi-Luen Do. 2013. Toward a cognitive theory of creativity support. In Proceedings of the 9th ACM Conference on Creativity & Cognition (C&C ’13). Association for Computing Machinery, New York, NY, USA, 13–22. https://doi.org/10.1145/2466627.2466655

Digital Library

[28]

Nisha Devasia, Safinah Ali, and Cynthia Breazeal. 2020. Escape!bot: child-robot interaction to promote creative expression during gameplay. In Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’20). Association for Computing Machinery, New York, NY, USA, 219–223. https://doi.org/10.1145/3383668.3419895

Digital Library

[29]

Griffin Dietz, Jimmy K Le, Nadin Tamer, Jenny Han, Hyowon Gweon, Elizabeth L Murnane, and James A. Landay. 2021. StoryCoder: teaching computational thinking concepts through storytelling in a voice-guided app for children. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). ACM, Yokohama Japan, 1–15. https://doi.org/10.1145/3411764.3445039

Digital Library

[30]

Griffin Dietz, Zachary Pease, Brenna McNally, and Elizabeth Foss. 2020. Giggle gauge: a self-report instrument for evaluating children's engagement with technology. In Proceedings of the Interaction Design and Children Conference (IDC ’20). Association for Computing Machinery, New York, NY, USA, 614–623. https://doi.org/10.1145/3392063.3394393

Digital Library

[31]

Johanna Einarsdottir, Sue Dockett, and Bob Perry. 2009. Making meaning: children's perspectives expressed through drawings. Early Child Dev. Care 179, 2 (February 2009), 217–232. https://doi.org/10.1080/03004430802666999

[32]

Will Eisner. 2008. Graphic Storytelling and Visual Narrative. W. W. Norton & Company, New York.

[33]

Robert Epstein and Victoria Phan. 2012. Which competencies are most important for creative expression? Creat. Res. J. 24, 4 (October 2012), 278–282. https://doi.org/10.1080/10400419.2012.726579

[34]

Augusto Esteves, Elise van den Hoven, and Ian Oakley. 2013. Physical games or digital games? comparing support for mental projection in tangible and virtual representations of a problem-solving task. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI ’13). Association for Computing Machinery, New York, NY, USA, 167–174. https://doi.org/10.1145/2460625.2460651

Digital Library

[35]

Jonas Frich, Lindsay MacDonald Vermeulen, Christian Remy, Michael Mose Biskjaer, and Peter Dalsgaard. 2019. Mapping the landscape of creativity support tools in hci. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3290605.3300619

Digital Library

[36]

Katy Ilonka Gero, Zahra Ashktorab, Casey Dugan, Qian Pan, James Johnson, Werner Geyer, Maria Ruiz, Sarah Miller, David R. Millen, Murray Campbell, Sadhana Kumaravel, and Wei Zhang. 2020. Mental models of ai agents in a cooperative game setting. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376316

Digital Library

[37]

Gabriela Goldschmidt and Maria Smolkov. 2006. Variances in the impact of visual stimuli on design problem solving performance. Des. Stud. 27, 5 (September 2006), 549–569. https://doi.org/10.1016/j.destud.2006.01.002

[38]

M. Gonçalves, C. Cardoso, and P. Badke-Schaub. 2012. How far is too far? using different abstraction levels in textual and visual stimuli. 70 Proc. Des. 2012 12th Int. Des. Conf. Dubrov. Croat., (2012), 1861–1870.

[39]

Goren Gordon, Cynthia Breazeal, and Susan Engel. 2015. Can children catch curiosity from a social robot? In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI ’15). Association for Computing Machinery, New York, NY, USA, 91–98. https://doi.org/10.1145/2696454.2696469

Digital Library

[40]

J. P. Guilford. 1957. Creative abilities in the arts. Psychol. Rev. 64, 2 (1957), 110–118. https://doi.org/10.1037/h0048280

[41]

J.P. Guilford. 1967. The Nature of Human Intelligence. McGraw-Hill, New York, NY, US.

[42]

María Teresa Fleta Guillén and María Luisa García Bermejo. 2011. Creative writing for language, content and literacy teaching. Int. Educ. Stud. 4, 5 (December 2011), 39–46.

[43]

Jiahao Guo, Yuyu Lin, Hongyu Yang, Junwu Wang, Shuo Li, Enmao Liu, Cheng Yao, and Fangtian Ying. 2020. Comparing the tangible tutorial system and the human teacher in intangible cultural heritage education. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (DIS ’20). Association for Computing Machinery, New York, NY, USA, 895–907. https://doi.org/10.1145/3357236.3395449

Digital Library

[44]

David Ha and Douglas Eck. 2017. A neural representation of sketch drawings. arXiv:1704.03477 [cs, stat]. Retrieved from http://arxiv.org/abs/1704.03477

[45]

Yon Ade Lose Hermanto. 2019. Visual storytelling in folklore children book illustration. Asian J. Res. Educ. Soc. Sci. 1, 1 (October 2019), 62–70.

[46]

Edwin Hutchins. 1995. Cognition in the Wild. A Bradford Book, Cambridge, MA, USA.

[47]

Youngseung Jeon, Seungwan Jin, Patrick C. Shih, and Kyungsik Han. 2021. FashionQ: an ai-driven creativity support tool for facilitating ideation in fashion design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3411764.3445093

Digital Library

[48]

Yasmin B. Kafai. 1994. Minds in Play: Computer Game Design as A Context for Children's Learning. Routledge, New York. https://doi.org/10.4324/9780203052914

[49]

Pegah Karimi, Nicholas Davis, Mary Lou Maher, Kazjon Grace, and Lina Lee. 2019. Relating cognitive models of design creativity to the similarity of sketches generated by an ai partner. In Proceedings of the 2019 on Creativity and Cognition (C&C ’19). Association for Computing Machinery, New York, NY, USA, 259–270. https://doi.org/10.1145/3325480.3325488

Digital Library

[50]

Pegah Karimi, Kazjon Grace, Nicholas Davis, and Mary Lou Maher. 2019. Creative sketching apprentice: supporting conceptual shifts in sketch ideation. In Design Computing and Cognition ’18. Springer International Publishing, Cham, 721–738. https://doi.org/10.1007/978-3-030-05363-5_39

[51]

Pegah Karimi, Jeba Rezwana, Safat Siddiqui, Mary Lou Maher, and Nasrin Dehbozorgi. 2020. Creative sketching partner: an analysis of human-ai co-creativity. In Proceedings of the 25th International Conference on Intelligent User Interfaces (IUI ’20). Association for Computing Machinery, New York, NY, USA, 221–230. https://doi.org/10.1145/3377325.3377522

Digital Library

[52]

Bogyeong Kim, Chaeeun Lee, Jung Huh, and Woohun Lee. 2020. Puppet book: digital storybook with back-of-device puppeteering interface for parent and child. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3334480.3383175

Digital Library

[53]

Kyung Hee Kim. 2011. The creativity crisis: the decrease in creative thinking scores on the torrance tests of creative thinking. Creativity Research Journal 23, 4 (October 2011), 285–295. https://doi.org/10.1080/10400419.2011.627805

[54]

Anne Lamott. 1995. Bird by Bird: Some Instructions on Writing and Life. Anchor, New York.

[55]

Zhuying Li, Yan Wang, Wei Wang, Stefan Greuter, and Florian “Floyd” Mueller. 2020. Empowering a creative city: engage citizens in creating street art through human-ai collaboration. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3382976

Digital Library

[56]

Mike Ligthart, Timo Fernhout, and Mark A Neerincx. 2019. A child and a robot getting acquainted – interaction design for eliciting self-disclosure. (2019), 10.

[57]

Ruilin Lin. 2012. Creative thinking for picture book creation. IERI Procedia 2, (January 2012), 30–35. https://doi.org/10.1016/j.ieri.2012.06.047

[58]

Yuyu Lin, Jiahao Guo, Yang Chen, Cheng Yao, and Fangtian Ying. 2020. It is your turn: collaborative ideation with a co-creative robot through sketch. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376258

Digital Library

[59]

Karin Lindgaard and Heico Wesselius. 2017. Once more, with feeling: design thinking and embodied cognition. She Ji J. Des. Econ. Innov. 3, 2 (2017), 83–92. https://doi.org/10.1016/j.sheji.2017.05.004

[60]

Laura Malinverni, Brenda López Silva, and Narcís Parés. 2012. Impact of embodied interaction on learning processes: design and analysis of an educational application based on physical activity. In Proceedings of the 11th International Conference on Interaction Design and Children (IDC ’12). Association for Computing Machinery, New York, NY, USA, 60–69. https://doi.org/10.1145/2307096.2307104

Digital Library

[61]

Paul Marshall, Alissa Antle, Elise Van Den Hoven, and Yvonne Rogers. 2013. Introduction to the special issue on the theory and practice of embodied interaction in hci and interaction design. ACM Trans. Comput.-Hum. Interact. 20, 1 (March 2013), 1–3. https://doi.org/10.1145/2442106.2442107

Digital Library

[62]

Robert H. McKim. 1972. Experiences in Visual Thinking. Brooks/Cole Pub. Co, Monterey, Calif.

[63]

R. A. McWilliam and Amy M. Casey. 2008. Engagement of Every Child in the Preschool Classroom. Paul H. Brookes Publishing Company Baltimore.

[64]

Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Distributed representations of words and phrases and their compositionality. arXiv:1310.4546 [cs, stat]. Retrieved from https://arxiv.org/abs/1310.4546

[65]

Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I lead, you help but only with enough details: understanding user experience of co-creation with artificial intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174223

Digital Library

[66]

Hiroyuki Osone, Jun-Li Lu, and Yoichi Ochiai. 2021. BunCho: ai supported story co-creation via unsupervised multitask learning to increase writers’ creativity in japanese. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3411763.3450391

Digital Library

[67]

Luiza Superti Pantoja, Kyle Diederich, Liam Crawford, and Juan Pablo Hourcade. 2019. Voice agents supporting high-quality social play. In Proceedings of the 18th ACM International Conference on Interaction Design and Children (IDC ’19). Association for Computing Machinery, New York, NY, USA, 314–325. https://doi.org/10.1145/3311927.3323151

Digital Library

[68]

Hae Won Park, Rinat Rosenberg-Kima, Maor Rosenberg, Goren Gordon, and Cynthia Breazeal. 2017. Growing growth mindset with a social robot peer. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI ’17). Association for Computing Machinery, New York, NY, USA, 137–145. https://doi.org/10.1145/2909824.3020213

Digital Library

[69]

Louise Phillips. 2000. Storytelling: the seeds of children's creativity. Australas. J. Early Child. 25, 3 (September 2000), 1–5. https://doi.org/10.1177/183693910002500302

[70]

Julie Porteous, Fred Charles, Cameron Smith, Marc Cavazza, Jolien Mouw, and Paul van den Broek. 2017. An interactive narrative platform for story understanding experiments. In Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems (AAMAS ’17). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 1808–1810.

[71]

Anna Reid and Ian Solomonides. 2007. Design students’ experience of engagement and creativity. Art Des. Commun. High. Educ. 6, 1 (October 2007), 27–39. https://doi.org/10.1386/adch.6.1.27_1

[72]

R. Keith Sawyer, Vera John-Steiner, Seana Moran, Robert J Sternberg, David Henry Feldman, Jeanne Nakamura, and Mihaly Csikszentmihalyi. 2003. Creativity and Development. Oxford University Press, New York. https://doi.org/10.1093/acprof:oso/9780195149005.001.0001

[73]

D. A. Schön. 1992. Designing as reflective conversation with the materials of a design situation. Knowl.-Based Syst. 5, 1 (March 1992), 3–14. https://doi.org/10.1016/0950-7051(92)90020-G

Digital Library

[74]

Raymond Scupin. 1997. The KJ method: a technique for analyzing data derived from japanese ethnology. Human Organization 56, 2 (1997), 233–237.

[75]

Yang Shi, Yang Wang, Ye Qi, John Chen, Xiaoyao Xu, and Kwan-Liu Ma. 2017. IdeaWall: improving creative collaboration through combinatorial visual stimuli. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW ’17). Association for Computing Machinery, New York, NY, USA, 594–603. https://doi.org/10.1145/2998181.2998208

Digital Library

[76]

Rawley A. Silver. 1989. Developing Cognitive and Creative Skills through Art: Programs for Children with Communication Disorders or Learning Disabilities. Third Edition. Revised.

[77]

Luiza Superti Pantoja, Kyle Diederich, Liam Crawford, Megan Corbett, Samantha Klemm, Kerry Peterman, Flannery Currin, and Juan Pablo Hourcade. 2020. Play-based design: giving 3- to 4-year-old children a voice in the design process. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376407

Digital Library

[78]

Paul Thagard. 2005. Mind: Introduction to Cognitive Science. MIT Press.

[79]

E. Paul Torrance. 1968. A longitudinal examination of the fourth grade slump in creativity. Gift. Child Q. 12, 4 (December 1968), 195–199. https://doi.org/10.1177/001698626801200401

[80]

E. Paul Torrance. 1972. Predictive validity of the torrance tests of creative thinking. J. Creat. Behav. 6, 4 (1972), 236–262. https://doi.org/10.1002/j.2162-6057.1972.tb00936.x

[81]

Klaus K. Urban. 2004. Assessing creativity: the test for creative thinking - drawing production (tct-dp): the concept, application, evaluation, and international studies. Psychol. Sci. 46, 3 (2004), 387–397.

[82]

Francisco J. Varela, Eleanor Rosch, and Evan Thompson. 1991. The Embodied Mind: Cognitive Science and Human Experience. MIT Press, Cambridge, MA, USA.

[83]

Trefor Williams, Noreen Wetton, Alysoun Moon, and Health Education Authority. 1989. A Way in: Five Key Areas of Health Education. Health Education Authority, London.

[84]

Margaret Wilson. 2002. Six views of embodied cognition. Psychon. Bull. Rev. 9, 4 (December 2002), 625–636. https://doi.org/10.3758/BF03196322

[85]

Miranda Kit-Yi Wong and Wing Chee So. 2016. Spoken narrative assessment: a supplementary measure of children's creativity. Creat. Res. J. 28, 4 (October 2016), 471–477. https://doi.org/10.1080/10400419.2016.1229989

[86]

Ying Xu and Mark Warschauer. 2020. Exploring young children's engagement in joint reading with a conversational agent. In Proceedings of the Interaction Design and Children Conference (IDC ’20). Association for Computing Machinery, New York, NY, USA, 216–228. https://doi.org/10.1145/3392063.3394417

Digital Library

[87]

Niloofar Zarei, Sharon Lynn Chu, Francis Quek, Nanjie “Jimmy” Rao, and Sarah Anne Brown. 2020. Investigating the effects of self-avatars and story-relevant avatars on children's creative storytelling. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3313831.3376331

Digital Library

[88]

Chao Zhang, Zili Zhou, Jiayi Wu, Yajing Hu, Yaping Shao, Jianhui Liu, Yuqi Hu, Fangtian Ying, and Cheng Yao. 2021. Bio sketchbook: an ai-assisted sketching partner for children's biodiversity observational learning. In Interaction Design and Children (IDC ’21). Association for Computing Machinery, New York, NY, USA, 466–470. https://doi.org/10.1145/3459990.3465197

Digital Library

Cited By

Jung DSuh S(2024)Enhancing Soft Skills through Generative AI in Sustainable Fashion Textile Design EducationSustainability10.3390/su1616697316:16(6973)Online publication date: 14-Aug-2024
https://doi.org/10.3390/su16166973
Paudel RAl-Ameen M(2024)Leveraging the Power of Storytelling to Encourage and Empower Children towards Strong PasswordsProceedings of the ACM on Human-Computer Interaction10.1145/36870438:CSCW2(1-27)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687043
Panchanadikar RFreeman G(2024)"I'm a Solo Developer but AI is My New Ill-Informed Co-Worker": Envisioning and Designing Generative AI to Support Indie Game DevelopmentProceedings of the ACM on Human-Computer Interaction10.1145/36770828:CHI PLAY(1-26)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677082
Show More Cited By

Index Terms

StoryDrawer: A Child–AI Collaborative Drawing System to Support Children's Creative Visual Storytelling
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools

Recommendations

StoryDrawer: A Co-Creative Agent Supporting Children's Storytelling through Collaborative Drawing
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Storytelling is a common creative activity for children. During storytelling, children need creative support and are subjected to cognitive challenges. This paper explores a co-creative agent - StoryDrawer, which supports children in creating oral ...
Bio Sketchbook: an AI-assisted Sketching Partner for Children's Biodiversity Observational Learning
IDC '21: Proceedings of the 20th Annual ACM Interaction Design and Children Conference

Observational sketching is a common method to facilitate repeated observations that increase individual knowledge and awareness of biodiversity. However, this method presents a high barrier of entry for some novices, particularly young children. In this ...
Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytelling
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Mathematical language is a cornerstone of a child’s mathematical development, and children can effectively acquire this language through storytelling with a knowledgeable and engaging partner. In this study, we leverage the recent advances in large ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

10459 pages

ISBN:9781450391573

DOI:10.1145/3491102

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA
,
Steven Drucker
Microsoft Research, USA
,
Julie Williamson
University of Glasgow, UK
,
Koji Yatani
University of Tokyo, Japan

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Fundamental Research Funds for the Central Universities
Major Project of Zhejiang Social Science Foundation
National Natural Science Foundation of China

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
2,259
Total Downloads

Downloads (Last 12 months)911
Downloads (Last 6 weeks)89

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jung DSuh S(2024)Enhancing Soft Skills through Generative AI in Sustainable Fashion Textile Design EducationSustainability10.3390/su1616697316:16(6973)Online publication date: 14-Aug-2024
https://doi.org/10.3390/su16166973
Paudel RAl-Ameen M(2024)Leveraging the Power of Storytelling to Encourage and Empower Children towards Strong PasswordsProceedings of the ACM on Human-Computer Interaction10.1145/36870438:CSCW2(1-27)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687043
Panchanadikar RFreeman G(2024)"I'm a Solo Developer but AI is My New Ill-Informed Co-Worker": Envisioning and Designing Generative AI to Support Indie Game DevelopmentProceedings of the ACM on Human-Computer Interaction10.1145/36770828:CHI PLAY(1-26)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677082
Zhu YZhou ZMiao JMi HGuo YKostakos VKay JHoang T(2024)TangibleNegotiation: Probing Design Opportunities for Integration of Generative AI and Swarm Robotics for Imagination Cultivation in Child Art EducationCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677586(66-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677586
Antony VHuang C(2024)ID.8: Co-Creating Visual Stories with Generative AIACM Transactions on Interactive Intelligent Systems10.1145/367227714:3(1-29)Online publication date: 15-Jun-2024
https://dl.acm.org/doi/10.1145/3672277
Hwang ASiy JShelby RLentz A(2024)In Whose Voice?: Examining AI Agent Representation of People in Social Interaction through Generative SpeechProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661555(224-245)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661555
Halperin BLukin S(2024)Artificial Dreams: Surreal Visual Storytelling as Inquiry Into AI 'Hallucination'Proceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660685(619-637)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660685
Wan QHu SZhang YWang PWen BLu Z(2024)"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language ModelsProceedings of the ACM on Human-Computer Interaction10.1145/36373618:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637361
Srinivasan R(2024)To See or Not to See: Understanding the Tensions of Algorithmic Curation for Visual ArtsProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658917(444-455)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3658917
Fan MCui XHao JYe RMa WTong XLi M(2024)StoryPrompt: Exploring the Design Space of an AI-Empowered Creative Storytelling System for Elementary ChildrenExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651118(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651118
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents