Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3313831.3376171acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Self-Expression by Design: Co-Designing the ExpressiBall with Minimally-Verbal Children on the Autism Spectrum

Published: 23 April 2020 Publication History

Abstract

Expressing one's thoughts and feelings is a fundamental human need - the basis for communication and social interaction. We ask, how do minimally-verbal children on the autism spectrum express themselves? How can we better recognise instances of self-expression? And how might technologies support and encourage self-expression? To address these questions, we undertook co-design research at an autism-specific primary school with 20 children over one school year. This paper contributes six Modalities of Self-Expression, through which children self-express and convey their design insights. Each modality of self-expression can occur across two different dimensions (socio-expressive and auto-expressive) and can be of a fundamental or an integrative nature. Further, we contribute the design trajectory of a tangible ball prototype, the ExpressiBall, which - through voice, sounds, lights, and motion sensors - explores how tangible technologies can support this range of expressive modalities. Finally, we discuss the concept of Self-Expression by Design.

References

[1]
Andrea Alessandrini, Victor Loux, Gabriel Ferreira Serra, and Cormac Murray. 2016. Designing ReduCat: AudioAugmented Paper Drawings Tangible Interface in Educational Intervention for High-Functioning Autistic Children. In Proceedings of the 15th International Conference on Interaction Design and Children (IDC '16), 463--472.
[2]
Meryl Alper. 2017. Giving voice: Mobile communication, disability, and inequality. MIT Press, 2017.
[3]
Aloha Hufana Ambe, Margot Brereton, Alessandro Soro, and Paul Roe. 2017. Technology Individuation: The Foibles of Augmented Everyday Objects. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 6632--6644.
[4]
Alissa N. Antle. 2008. Inquiring materials for tangible prototyping. In Proceedings of the 2nd international conference on Tangible and embedded interaction (TEI '08). ACM, NY, NY, USA, 139--140.
[5]
AssistiveWare 'Proloquo2Go'. 2013. Retrieved July 14, 2019 from https://www.assistiveware.com/products/proloquo2go
[6]
Ellie Bates, Kristy Evers, Lee Leewis, Jenny Zhou, Asimina Vasalou, Vali Lalioti, and Kandase Augustin. 2018. The bits & atoms of play: critical engagements with intercultural meaning making. In Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18), 761--764.
[7]
Tilde Bekker, Janienke Sturm, Rik Wesselink, Bas Groenendaal, and Berry Eggen. 2008. Interactive play objects and the effects of open-ended play on social interaction and fun. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology (ACE '08), 389--392.
[8]
Erna Blanche, Gustavo Imperatore, Megan Reinoso, Megan C. Chang, and Stefanie Bodison. 2012. Proprioceptive processing difficulties among children with autism spectrum disorders and developmental disabilities. American Journal of Occupational Therapy 66, 5: 621--624.
[9]
Margot Brereton, Laurianne Sitbon, Muhammad Haziq Lim Abdullah, Mark Vanderberg, and Stewart Koplick. 2015. Design after design to bridge between people living with cognitive or sensory impairments, their friends and proxies. CoDesign 11,1 : 4--20.
[10]
Franceli L. Cibrian. 2016. Music therapy on interactive surfaces to improve sensorimotor problems of children with autism. SIGACCESS Transactions on Accessible Computing 114 (March 2016), 20--24.
[11]
Tom Djajadiningrat, Ben Matthews, and Marcelle Stienstra. 2007. Easy doesn't do it: skill and expression in tangible aesthetics. In Personal and Ubiquitous Computing 11, 8, 657676.
[12]
Paul Dourish. Where the action is: the foundations of embodied interaction. MIT press, 2004.
[13]
Allison Druin. 1999. Cooperative Inquiry: Developing New Technologies for Children with Children. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, NY, NY, USA, 592--599.
[14]
Carl J. Dunst. 1998. Sensorimotor development and developmental disabilities. Handbook of mental retardation and development, 135--182.
[15]
eSafety Commission Website 'Safety by Design'. 2019. Retrieved August 10, 2019 from https://www.esafety.gov.au/esafety-information/safety-bydesign
[16]
William Farr, Nicola Yuill, Eric Harris, and Steve Hinske. 2010. In my own words: configuration of tangibles, object interaction and children with autism. In Proceedings of the 9th International Conference on Interaction Design and Children (IDC '10), 30--38.
[17]
Christina T. Fuentes, Stewart H. Mostofsky, and Amy J. Bastian. 2011. No proprioceptive deficits in autism despite movement-related sensory and execution impairments. Journal of autism and developmental disorders 41, no. 10: 1352--1361.
[18]
Christopher Frauenberger, Julia Makhaeva, and Katharina Spiel. 2016. Designing Smart Objects with Autistic Children: Four Design Exposès. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16) 130--139.
[19]
Elisa Giaccardi and Elvin Karana. 2015. Foundations of Materials Experience: An Approach for HCI. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2447--2456.
[20]
Jenna Gillett-Swan and Jonathon Sargeant. 2018. Assuring children's human right to freedom of opinion and expression in education. International Journal of Speech-Language Pathology, 20,1 (2018),120--127
[21]
Mitchell S. Green. 2007. Self-expression. Oxford University Press.
[22]
Mariellen Griffith. 1997. Empowering techniques of play therapy: A method for working with sexually abused children. Journal of Mental Health Counseling 19 (2): 130-
[23]
Clint Heyer and Margot Brereton. 2010. Design from the everyday: continuously evolving, embedded exploratory prototypes. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10), 282--291.
[24]
Hanneke Hooft van Huysduynen, Linda de Valk, and Tilde Bekker. 2016. Tangible Play Objects: Influence of Different Combinations of Feedback Modalities. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16), 262--270.
[25]
Eva Hornecker and Jacob Buur. 2006. Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), 437--446.
[26]
Ole Sejer Iversen, Rachel Charlotte Smith, and Christian Dindler. 2017. Child As Protagonist: Expanding the Role of Children in Participatory Design. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC '17), 27--37.
[27]
Carey Jewitt. 2013. Multimodal methods for researching digital technologies. In Price S and Jewitt C (eds) The SAGE Handbook of Digital Technology Research, 250--265.
[28]
Brigitte Jordan and Austin Henderson. 1995. Interaction Analysis: Foundations and Practice. Journal of the Learning Sciences 4, 1 (1995), 39--103.
[29]
Connie Kasari, Stephanny Freeman, and Tanya Paparella. 2006. Joint attention and symbolic play in young children with autism: A randomized controlled intervention study. Journal of Child Psychology and Psychiatry 47, 6: 611--620.
[30]
Barbara Kawulich. 2005. Participant Observation as a Data Collection Method. Qualitative Social Research 6, 2 (2005).
[31]
Wendy Keay-Bright and Imogen Howarth. 2012. Is simplicity the key to engagement for children on the autism spectrum?. Personal and Ubiquitous Computing 16, 2: 129--141.
[32]
Heejung S. Kim and Deborah Ko. 2007. Culture and selfexpression. In C. Sedikides & S. Spencer (Eds.), Frontiers of social psychology: The self (pp. 325--342). New York, US: Psychology Press.
[33]
Garry L. Landreth. 2012. Play Therapy: The Art of the Relationship. (3rd ed.). London: Routledge.
[34]
Amanda Lazar, Jessica L. Feuston, Caroline Edasis, and Anne Marie Piper. 2018. Making As Expression: Informing Design with People with Complex Communication Needs Through Art Therapy. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Artcile 351, 16 pages.
[35]
Susan R. Leekam, Carmen Nieto, Sarah J. Libby, Lorna Wing, and Judith Gould. 2007. Describing the sensory abnormalities of children and adults with autism. Journal of autism and developmental disorders 37, 5 (2007), 894--910.
[36]
Kevin Lefeuvre, Soeren Totzauer, Michael Storz, Albrecht Kurze, Andreas Bischof, and Arne Berger. 2018. Bricks, Blocks, Boxes, Cubes, and Dice: On the Role of Cubic Shapes for the Design of Tangible Interactive Devices. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). 485--496.
[37]
Julia Makhaeva, Christopher Frauenberger, and Katharina Spiel. 2016. Creating Creative Spaces for Co-designing with Autistic Children: The Concept of a "Handlungsspielraum". In Proceedings of the 14th Participatory Design Conference: Full Papers - Volume 1 (PDC '16), 51--60.
[38]
Laura Malinverni, Edith Ackermann, and Narcis Pares. 2016. Experience as an Object to Think with: from Sensing-in-action to Making-Sense of action in Full-Body Interaction Learning Environments. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16), 332--339.
[39]
Laura Malinverni, Marie-Monique Schaper, and Narcis Pares. 2019. Multimodal methodological approach for participatory design of Full-Body Interaction Learning Environments. Qualitative Research 19, 1 (2019), 71--89.
[40]
Elysa J. Marco, L. B. Hinkley, Susanna S. Hill and Srikantan S. Nagarajan. 2011. Sensory processing in autism: A review of neurophysiologic findings. Paediatric Research, 69 (5 Part 2), 48.
[41]
Nancy J. Minshew, Jessica Meyer, and Gerald Goldstein. 2002. Abstract reasoning in autism: A disassociation between concept formation and concept identification. Neuropsychology 16, 3 (2002), 327.
[42]
Ulric Neisser. 1988. Five kinds of self-knowledge. Philosophical psychology, 1(1): 35--59.
[43]
Antonella Nonnis and Nick Bryan-Kinns. 2019. Mazi: Tangible Technologies as a Channel for Collaborative Play. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19) 440, 13
[44]
Marianna Obrist, Carlos Velasco, Chi Thanh Vi, Nimesha Ranasinghe, Ali Israr, Adrian D. Cheok, Charles Spence, and Ponnampalam Gopalakrishnakone. 2016. Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16), 3285--3292.
[45]
Marianna Obrist, Elia Gatti, Emanuela Maggioni, Chi Thanh Vi, and Carlos Velasco. 2017. Multisensory experiences in HCI. IEEE MultiMedia 24, 2 (2017), 9--13
[46]
Deysi Helen Ortega, Franceli Linney Cibrian, and Mónica Tentori. 2015. BendableSound: a Fabric-based Interactive Surface to Promote Free Play in Children with Autism. In Proc. of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '15), 315-
[47]
Jean Piaget. 2013. Play, dreams and imitation in childhood. Routledge.
[48]
Kenneth K. Poon, Linda R. Watson, Grace T. Baranek, and Michele D. Poe. 2012. To What Extent Do Joint Attention, Imitation, and Object Play Behaviors in Infancy Predict Later Communication and Intellectual Functioning in ASD? Journal of Autism and Developmental Disorders 42, 6 (Jun 2012), 1064--1074.
[49]
Barry M. Prizant, and Judith F. Duchan. 1981. The functions of immediate echolalia in autistic children. Journal of speech and hearing disorders 46, 3 (1981), 241--249.
[50]
Nicolas Rasamimanana, Frédéric Bevilacqua, Julien Bloit, Norbert Schnell, Emmanuel Fléty, Andrea Cera, Uros Petrevski, and Jean-Louis Frechin. 2012. The urban musical game: using sport balls as musical interfaces. In CHI '12 Extended Abstracts on Human Factors in Computing Systems(CHI EA '12), 1027--1030
[51]
Kathryn E. Ringland, Rodrigo Zalapa, Megan Neal, Lizbeth Escobedo, Monica E. Tentori, and Gillian R. Hayes. 2014. SensoryPaint: a natural user interface supporting sensory integration in children with neurodevelopmental disorders. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14), 1681--1686.
[52]
Kathryn E. Ringland, LouAnne Boyd, Heather Faucett, Amanda L.L. Cullen, and Gillian R. Hayes. 2017. Making in Minecraft: A Means of Self-Expression for Youth with Autism. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC '17) 340--345.
[53]
John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2015. Pass the Ball: Enforced Turn-Taking in Activity Tracking. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2417--2426.
[54]
Richard M. Ryan and Edward L. Deci. 2000. Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary educational psychology 25, 1: 54--67.
[55]
Daniel Salber, and Joëlle Coutaz. 1993. Applying the wizard of oz technique to the study of multimodal systems. In International Conference on Human-Computer Interaction, 753: 219--230, Springer, Berlin, Heidelberg
[56]
Laura Scheepmaker, Christopher Frauenberger, and Katta Spiel. 2018. The Things We Play with Roles of Technology in Social Play. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '18), 451462.
[57]
Katta Spiel, Julia Makhaeva, and Christopher Frauenberger. 2016. Embodied Companion Technologies for Autistic Children. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16) 245--252.
[58]
Miguel Sicart. Play matters. MIT Press, 2014.
[59]
Steve Silberman. Neurotribes: The legacy of autism and the future of neurodiversity. Penguin, 2015.
[60]
Helen Tager-Flusberg and Connie Kasari. 2013. Minimally Verbal School--Aged Children with Autism Spectrum Disorder: The Neglected End of the Spectrum. Autism Research 6, 6: 468--478.
[61]
Jelle van Dijk, Remko van der Lugt, and Caroline Hummels. 2014. Beyond distributed representation: embodied cognition design supporting socio-sensorimotor couplings. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14), 181--188.
[62]
Jelle van Dijk and Caroline Hummels. 2017. Designing for Embodied Being-in-the-World: Two Cases, Seven Principles and One Framework. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17), 47--56.
[63]
Lilia Villafuerte, Milena Markova and Sergi Jorda. 2012. Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the Reactable. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12), 745--760.
[64]
Lev S. Vygotsky. 1967. Play and its role in the mental development of the child. Soviet psychology 5, 3 (1967), 6--18.
[65]
Alan Waterman, Seth Schwartz and Regina Conti. 2008. The implications of two conceptions of happiness (hedonic enjoyment and eudaimonia) for the understanding of intrinsic motivation. Journal of Happiness Studies, 9, 1: 41--79.
[66]
Gil Weinberg, Maggie Orth, and Peter Russo. 2000. The embroidered musical ball: a squeezable instrument for expressive performance. In CHI '00 Extended Abstracts on Human Factors in Computing Systems (CHI EA '00), 283--284.
[67]
Danielle Wilde. 2008. The hipdiskettes: learning (through) wearables. In Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat (OZCHI '08), 259--262.
[68]
Cara Wilson, Margot Brereton, Bernd Ploderer, Laurianne Sitbon, and Beth Saggers. 2017. Digital Strategies for Supporting Strengths- and Interests-based Learning with Children with Autism. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). Association for Computing Machinery, New York, NY, USA, 52--61.
[69]
Cara Wilson, Margot Brereton, Bernd Ploderer, and Laurianne Sitbon. 2018. MyWord: Enhancing Engagement, Interaction and Self- expression with Minimally-verbal Children on the Autism Spectrum Through a Personal Audio-visual Dictionary. In Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18), 106--118.
[70]
Cara Wilson, Margot Brereton, Bernd Ploderer, and Laurianne Sitbon. 2019. Co-Design Beyond Words: 'Moments of Interaction' with Minimally-Verbal Children on the Autism Spectrum. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), Paper 21, 1--15.
[71]
Yulia Zhiglova. 2018. The Interactive Carpet - Smart Textile Interface for Children on Autism Spectrum Disorder. In Proc. of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18), 712--714.

Cited By

View all
  • (2024)The Degree of Application of Language Activities in Autistic Children and Their Relationship in Improving Verbal Expression Skills in Special Education Centers in JordanEuropean Journal of Educational Research10.12973/eu-jer.13.1.353volume-13-2024:volume-13-issue-1-january-2024(353-365)Online publication date: 15-Jan-2024
  • (2024)From research participant to co-researcher: Chloe's story on co-designing inclusive technologies with people with intellectual disabilityProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688541(1-6)Online publication date: 27-Oct-2024
  • (2024)"He always wanted to be far": Exploring Expanded Proxies to Design Social Play Experiences with Autistic and Neurotypical ChildrenProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659391(765-769)Online publication date: 17-Jun-2024
  • Show More Cited By

Index Terms

  1. Self-Expression by Design: Co-Designing the ExpressiBall with Minimally-Verbal Children on the Autism Spectrum

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
    April 2020
    10688 pages
    ISBN:9781450367080
    DOI:10.1145/3313831
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 April 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. autism
    2. children
    3. minimally-verbal
    4. modalities
    5. multimodal
    6. non-verbal
    7. play
    8. self-expression
    9. tangible

    Qualifiers

    • Research-article

    Conference

    CHI '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)202
    • Downloads (Last 6 weeks)19
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The Degree of Application of Language Activities in Autistic Children and Their Relationship in Improving Verbal Expression Skills in Special Education Centers in JordanEuropean Journal of Educational Research10.12973/eu-jer.13.1.353volume-13-2024:volume-13-issue-1-january-2024(353-365)Online publication date: 15-Jan-2024
    • (2024)From research participant to co-researcher: Chloe's story on co-designing inclusive technologies with people with intellectual disabilityProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688541(1-6)Online publication date: 27-Oct-2024
    • (2024)"He always wanted to be far": Exploring Expanded Proxies to Design Social Play Experiences with Autistic and Neurotypical ChildrenProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659391(765-769)Online publication date: 17-Jun-2024
    • (2024)Autistic Expression Beyond the Verbal - Studying Minimally-Verbal Autistic Indian Children's Embodied Interactions with Screen-Based TechnologyProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655792(612-624)Online publication date: 17-Jun-2024
    • (2024)Restarting the conversation about conversational search: exploring new possibilities for multimodal and collaborative systems with people with intellectual disabilityProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638339(231-242)Online publication date: 10-Mar-2024
    • (2024)Understanding Neurodiverse Social Play Between Autistic and Non-Autistic ChildrenProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642809(1-16)Online publication date: 11-May-2024
    • (2024)“I feel like he’s looking in the computer world to be social, but I can’t trust his judgement”: Reimagining Parental Control for Children with ASDProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642696(1-25)Online publication date: 11-May-2024
    • (2024)An Emotion Translator: Speculative Design By Neurodiverse DyadsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642210(1-18)Online publication date: 11-May-2024
    • (2024)Co-Designing QuickPic: Automated Topic-Specific Communication Boards from Photographs for AAC-Based Language InstructionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642080(1-16)Online publication date: 11-May-2024
    • (2024)Remembering through Sound: Co-creating Sound-based Mementos together with People with BlindnessProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641940(1-19)Online publication date: 11-May-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media