research-article

Lands of Fog: Helping Children with Autism in Social Interaction through a Full-Body Interactive Experience

Authors:

Joan Mora-Guiard,

Pamela HeatonAuthors Info & Claims

IDC '16: Proceedings of the The 15th International Conference on Interaction Design and Children

Pages 262 - 274

https://doi.org/10.1145/2930674.2930695

Published: 21 June 2016 Publication History

Abstract

Autism Spectrum Disorder is characterized by impaired social communication capacities which can prevent the formation of social relationships with peers. In recent years, potential programs for people with ASD have increasingly used Information and Communication Technologies mainly motivated by the affinity that people with ASD show towards technology-supported tasks. We present the design of a full-body interaction experience called Lands of Fog, in which a child with ASD plays together with a typically developed child. The system is aimed towards fostering social interaction behaviors and collaboration. We have undertaken user trials with 34 ASD children through which Lands of Fog has proven to be a useful tool to foster social interaction. In this paper, we focus on the description of the interaction design process, methods and criteria that support the final experience. We then provide preliminary results from the user trials which provide a first hint of the efficacy of the system in fostering user's engagement and making socialization attitudes emerge.

References

[1]

Alyssa Alcorn, Helen Pain, Gnanathusharan Rajendran, et al. 2011. Artificial Intelligence in Education. Springer Berlin Heidelberg, Berlin, Heidelberg. http://doi.org/10.1007/978-3-642-21869-9

[2]

Ariana Anderson, Jill Locke, Mark Kretzmann, Connie Kasari, and AIR-B Network. 2015. Social network analysis of children with autism spectrum disorder: Predictors of fragmentation and connectivity in elementary school classrooms. Autism. http://doi.org/10.1177/1362361315603568

[3]

American Psychiatric Association. 2013. Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC. http://doi.org/10.1176/appi.books.9780890425596.744053

[4]

Simon Baron-Cohen, Ofer Golan, and Emma Ashwin. 2009. Can emotion recognition be taught to children with autism spectrum conditions? Philosophical transactions of the Royal Society of London. Series B, Biological sciences 364, 1535: 3567--74. http://doi.org/10.1098/rstb.2009.0191

[5]

Laura Bartoli, Clara Corradi, Franca Garzotto, and Matteo Valoriani. 2013. Exploring motion-based touchless games for autistic children's learning. Proceedings of the 12th International Conference on Interaction Design and Children - IDC '13, ACM Press, 102--111. http://doi.org/10.1145/2485760.2485774

Digital Library

[6]

Nirit Bauminger, Marjorie Solomon, and Sally J Rogers. 2010. Externalizing and internalizing behaviors in ASD. Autism research: official journal of the International Society for Autism Research 3, 3: 101--12. http://doi.org/10.1002/aur.131

[7]

Nirit Bauminger-Zviely, Eynat Karin, Yael Kimhi, and Galit Agam-Ben-Artzi. 2014. Spontaneous peer conversation in preschoolers with high-functioning autism spectrum disorder versus typical development. Journal of Child Psychology and Psychiatry 55, 4: 363--373. http://doi.org/10.1111/jcpp.12158

[8]

Ayelet Ben-Sasson, Liron Lamash, and Eynat Gal. 2012. To enforce or not to enforce? The use of collaborative interfaces to promote social skills in children with high functioning autism spectrum disorder. Autism 17, 5: 608--622. http://doi.org/10.1177/1362361312451526

[9]

Arpita Bhattacharya, Mirko Gelsomini, Patricia Pérez-Fuster, Gregory D. Abowd, and Agata Rozga. 2015. Designing motion-based activities to engage students with autism in classroom settings. Proceedings of the 14th International Conference on Interaction Design and Children - IDC '15, ACM Press, 69--78. http://doi.org/10.1145/2771839.2771847

Digital Library

[10]

Anna M Borghi and Felice Cimatti. 2010. Embodied cognition and beyond: acting and sensing the body. Neuropsychologia 48, 3: 763--73. http://doi.org/10.1016/j.neuropsychologia.2009.10.029

[11]

Alexis Bosseler and Dominic W Massaro. 2003. Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. Journal of autism and developmental disorders 33, 6: 653--72.

[12]

Jennifer Brown and Donna Murray. 2001. Strategies For Enhancing Play Skills For Children With Autism Spectrum Disorder. Education and Training in Mental Retardation and Developmental Disabilities 36, 3: 312--317.

[13]

Xavier Casas, Gerardo Herrera, Inmaculada Coma, and Marcos Fernandez. 2012. A Kinect-Based Augmented Reality System for Individuals with Autism Spectrum Disorders. GRAPP/IVAPP: 440--446. http://doi.org/978-989-8565-02-0

[14]

SH H Chen and Vera Bernard-Opitz. 1993. Comparison of personal and computer-assisted instruction for children with autism. Mental retardation 31, 6: 368--76.

[15]

Yufang Cheng and Jun Ye. 2010. Exploring the social competence of students with autism spectrum conditions in a collaborative virtual learning environment -- The pilot study. Computers & Education 54, 4: 1068--1077. http://doi.org/10.1016/j.compedu.2009.10.011

Digital Library

[16]

Mari Beth Coleman, Kathryn Wolff Heller, David F. Cihak, and Kathryn L. Irvine. 2005. Using Computer-Assisted Instruction and the Nonverbal Reading Approach to Teach Word Identification. Focus on Autism and Other Developmental Disabilities 20, 2: 80--90. http://doi.org/10.1177/10883576050200020401

[17]

Peter Dalsgaard and Christian Dindler. 2014. Between theory and practice. Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14, ACM Press, 1635--1644. http://doi.org/10.1145/2556288.2557342

Digital Library

[18]

Megan Davis, Kerstin Dautenhahn, Stuart D Powell, and Chrystopher L. Nehaniv. 2010. Guidelines for researchers and practitioners designing software and software trials for children with autism. Journal of Assistive Technologies 4, 1: 38--48. http://doi.org/10.5042/jat.2010.0043

[19]

Paul Dourish. 2001. Where the action is: the foundations of embodied interaction. MIT Press, Cambridge, MA.

Digital Library

[20]

Tina Taylor Dyches, Annabelle Davis, Bonnie Lucido, and James Young. 2002. Generalization of skills using pictographic and voice output communication devices. Augmentative and Alternative Communication 18, 2: 124--131. http://doi.org/10.1080/07434610212331281211

[21]

Pelle Ehn. 1990. Work-Oriented Design of Computer Artifacts. Retrieved from http://dl.acm.org/citation.cfm?id=1102017

Digital Library

[22]

Christopher Frauenberger, Judith Good, Alyssa Alcorn, and Helen Pain. 2012. Supporting the design contributions of children with autism spectrum conditions. Proceedings of the 11th International Conference on Interaction Design and Children, 134--143. http://doi.org/10.1145/2307096.2307112

Digital Library

[23]

Jos N. van der Geest, Chantal Kemner, Gert Camfferman, Marinus Verbaten, and Herman van Engeland. Looking at Images with Human Figures: Comparison Between Autistic and Normal Children. Journal of Autism and Developmental Disorders 32, 2: 69--75. http://doi.org/10.1023/A:1014832420206

[24]

Sukeshini A. Grandhi, Gina Joue, and Irene Mittelberg. 2011. Understanding naturalness and intuitiveness in gesture production. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, ACM Press, 821. http://doi.org/10.1145/1978942.1979061

Digital Library

[25]

Ouriel Grynszpan, Jean-Claude Martin, and Jacqueline Nadel. 2008. Multimedia interfaces for users with high functioning autism: An empirical investigation. International Journal of Human-Computer Studies 66, 8: 628--639. http://doi.org/10.1016/j.ijhcs.2008.04.001

Digital Library

[26]

Sarika S. Gupta, William R. Henninger, and Megan E. Vinh. 2014. First Steps to Preschool Inclusion. Brookes Publishing, Baltimore.

[27]

Gillian R. Hayes, Sen Hirano, Gabriela Marcu, Mohamad Monibi, David H. Nguyen, and Michael Yeganyan. 2010. Interactive visual supports for children with autism. Personal and Ubiquitous Computing 14, 7: 663--680. http://doi.org/10.1007/s00779-010-0294-8

Digital Library

[28]

Perry Hoberman, Narcis Pares, and Roc Pares. 1999. El ball del fanalet or lightpools.

[29]

Hanne De Jaegher. 2013. Embodiment and sense-making in autism. Frontiers in integrative neuroscience 7: 15. http://doi.org/10.3389/fnint.2013.00015

[30]

David H. Jonassen and Lucia Rohrer-Murphy. 1999. Activity theory as a framework for designing constructivist learning environments. Educational Technology Research and Development 47, 1: 61--79. http://doi.org/10.1007/BF02299477

[31]

Connie Kasari, Erin Rotheram-Fuller, Jill Locke, and Amanda Gulsrud. 2012. Making the connection: randomized controlled trial of social skills at school for children with autism spectrum disorders. Journal of child psychology and psychiatry, and allied disciplines 53, 4: 431--9. http://doi.org/10.1111/j.1469-7610.2011.02493.x

[32]

Ami Klin, Warren Jones, Robert Schultz, and Fred Volkmar. 2003. The enactive mind, or from actions to cognition: lessons from autism. Philosophical transactions of the Royal Society of London. Series B, Biological sciences 358, 1430: 345--60. http://doi.org/10.1098/rstb.2002.1202

[33]

Diana Luckevich. Computer assisted instruction for teaching vocabulary to a child with autism. Retrieved from https://www.researchgate.net/publication/36710527_Computer_assisted_instruction_for_teaching_vocabulary_to_a_child_with_autism

[34]

Laura Malinverni, Joan Mora-Guiard, Vanesa Padillo, MariaAngeles Mairena, Amaia Hervás, and Narcis Pares. 2014. Participatory design strategies to enhance the creative contribution of children with special needs. Proceedings of the 2014 conference on Interaction design and children - IDC '14, ACM Press, 85--94. http://doi.org/10.1145/2593968.2593981

Digital Library

[35]

Laura Malinverni, Joan Mora-Guiard, and Narcis Pares. 2016. Towards Methods for Evaluating and Communicating Participatory Design: a Multimodal Approach. International Journal of Human-Computer Studies: Manuscript submitted for publication.

Digital Library

[36]

Linda C. Mechling, David L. Gast, and Beth A. Cronin. 2006. The Effects of Presenting High-Preference Items, Paired With Choice, Via Computer-Based Video Programming on Task Completion of Students With Autism. Focus on Autism and Other Developmental Disabilities 21, 1: 7--13. http://doi.org/10.1177/10883576060210010201

[37]

Laura Millen, Sue Cobb, Harshada Patel, and Tony Glover. 2012. Collaborative virtual environment for conducting design sessions with students with autism spectrum conditions. Proc.9th Intl Conf. on Disability, Virtual Reality and Assoc. Technologies, 269--278.

[38]

Laura Millen, Rob Edlin-White, and Sue Cobb. 2010. The development of educational collaborative virtual environments for children with autism. 5th Cambridge Workshop on Universal Access and Assistive Technology.

[39]

Pat Mirenda. 2003. Toward Functional Augmentative and Alternative Communication for Students With Autism. Language Speech and Hearing Services in Schools 34, 3: 203. http://doi.org/10.1044/0161-1461(2003/017)

[40]

David Moore, Paul McGrath, Norman J. Powell, and Yufang Cheng. 2005. Collaborative Virtual Environment Technology for People With Autism. Focus on Autism and Other Developmental Disabilities 20, 4: 231--243. http://doi.org/10.1177/10883576050200040501

[41]

Monique Moore and Sandra Calvert. Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction. Journal of Autism and Developmental Disorders 30, 4: 359--362. http://doi.org/10.1023/A:1005535602064

[42]

Michael Nielsen, Moritz Störring, Thomas B. Moeslund, and Erik Granum. A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. In Gesture-Based Communication in Human-Computer Interaction. 409--420.

[43]

Narcis Pares, Anna Carreras, Jaume Durany, et al. 2005. Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment. Proceedings of the 2005 conference on Interaction design and children, 110--116. http://doi.org/10.1145/1109540.1109555

Digital Library

[44]

Sarah Parsons and Sue Cobb. 2011. State-of-the-art of virtual reality technologies for children on the autism spectrum. European Journal of Special Needs Education 26, 3: 355--366. http://doi.org/10.1080/08856257.2011.593831

[45]

Sarah Parsons, Anne Leonard, and Peter Mitchell. 2006. Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder. Computers & Education. http://doi.org/10.1016/j.compedu.2004.10.003 <<http://dx.doi.org/10.1016/j.compedu.2004.10.003>).

Digital Library

[46]

Bertram O Ploog, Alexa Scharf, DeShawn Nelson, and Patricia J Brooks. 2013. Use of computer-assisted technologies (CAT) to enhance social, communicative, and language development in children with autism spectrum disorders. Journal of autism and developmental disorders 43, 2: 301--22. http://doi.org/10.1007/s10803-012-1571-3

[47]

Kaska Porayska-Pomsta, Cristopher Frauenberger, Helen Pain, et al. 2011. Developing technology for autism: an interdisciplinary approach. Personal and Ubiquitous Computing 16, 2: 117--127. http://doi.org/10.1007/s00779-011-0384-2

Digital Library

[48]

Maria Roussos, Andrew Johnson, Thomas Moher, Jason Leigh, Christina Vasilakis, and Craig Barnes. 1999. Learning and Building Together in an Immersive Virtual World. Presence: Teleoperators and Virtual Environments 8, 3: 247--263. http://doi.org/10.1162/105474699566215

Digital Library

[49]

Phillip S. Strain. 1983. Generalization of autistic children's social behavior change: Effects of developmentally integrated and segregated settings. Analysis and Intervention in Developmental Disabilities 3, 1: 23--34. http://doi.org/10.1016/0270-4684(83)90024-1

[50]

Dorothy Strickland. 1996. A Virtual Reality Application with Autistic Children. Presence: Teleoperators and Virtual Environments 5, 3: 319--329. http://doi.org/10.1162/pres.1996.5.3.319

Digital Library

[51]

Wendy Symes and Neil Humphrey. 2011. School factors that facilitate or hinder the ability of teaching assistants to effectively support pupils with autism spectrum disorders (ASDs) in mainstream secondary schools. Journal of Research in Special Educational Needs 11, 3: 153--161. http://doi.org/10.1111/j.1471-3802.2011.01196.x

[52]

Helen Tager-Flusberg and Robert M Joseph. 2003. Identifying neurocognitive phenotypes in autism. Philosophical transactions of the Royal Society of London. Series B, Biological sciences 358, 1430: 303--14. http://doi.org/10.1098/rstb.2002.1198

[53]

Andrea Tartaro and Justine Cassell. 2008. Playing with virtual peers: bootstrapping contingent discourse in children with autism. 382--389. Retrieved January 6, 2016 from http://dl.acm.org/citation.cfm?id=1599871.1599919

Digital Library

[54]

Monica Tentori and Gillian R. Hayes. 2010. Designing for interaction immediacy to enhance social skills of children with autism. Proceedings of the 12th ACM international conference on Ubiquitous computing - Ubicomp '10, ACM Press, 51. http://doi.org/10.1145/1864349.1864359

Digital Library

[55]

Marian Tuedor. 2006. Universal access through accessible computer educational programs to develop the reading skills of children with autistic spectrum disorders. Universal Access in the Information Society 5, 3: 292--298. http://doi.org/10.1007/s10209-006-0047-7

Digital Library

[56]

Patrice L. Weiss, Eynat Gal, Sigal Eden, Massimo Zancanaro, and Francesco Telch. 2011. Usability of a multi-touch tabletop surface to enhance social competence training for children with Autism Spectrum Disorder. 71 Patrice L. (Tamar) Weiss, Eynat Gal, Sigal Eden, Massimo Zancanaro, Francesco Telch Proceedings of the Chais conference on instructional technologies research 2011: Learning in the technological era, 71--78.

[57]

James V. Wertsch. 1985. Vygotsky and the social formation of mind. Retrieved from https://books.google.es/books/about/Vygotsky_and_the_social_formation_of_min.html?id=9P0kAQAAMAAJ&pgis=1

[58]

Margaret Wilson. 2002. Six views of embodied cognition. Psychonomic Bulletin & Review 9, 4: 625--36. http://doi.org/10.3758/BF03196322

Cited By

Peretti SPino MCaruso FDi Mascio T(2024)Evaluating the Potential of Immersive Virtual Reality-Based Serious Games Interventions for Autism: A Pocket Guide Evaluation FrameworkEducation Sciences10.3390/educsci1404037714:4(377)Online publication date: 5-Apr-2024
https://doi.org/10.3390/educsci14040377
Economidou EItzlinger AFrauenberger C(2024)Lived experience in human-building interaction (HBI): an initial frameworkFrontiers in Computer Science10.3389/fcomp.2023.12339045Online publication date: 4-Jan-2024
https://doi.org/10.3389/fcomp.2023.1233904
Gali OTüter GErcan SDelgado ÓAtherton GCross LPares N(2024)Participatory Design of an Embodied Mixed Reality Experience Aimed to Assessing Individual and Collaborative Behaviors of ChildrenProceedings of the ACM on Human-Computer Interaction10.1145/36770938:CHI PLAY(1-27)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677093
Show More Cited By

Index Terms

Lands of Fog: Helping Children with Autism in Social Interaction through a Full-Body Interactive Experience
1. Applied computing
  1. Education
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments

Recommendations

Interaction Design of Full-Body Interactive Play Experiences for Children with Autism
CHI PLAY '18 Extended Abstracts: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts

This doctoral work focuses on strategies for designing and implementing playful interactive experiences for social intervention of children with Autism Spectrum Disorder. In particular, this study explores strategies for fostering socialization in ...
MyCalendar: supporting families to communicate with their child on the autism spectrum
OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

This paper presents a study in which a mobile application, 'MyCalendar', was trialled with children on the autism spectrum and their families. In previous work, we described how the MyCalendar app supported communication across both home and school ...
Analysis of Interaction Design and Evaluation Methods in Full-Body Interaction for Special Needs
IUI '18: Proceedings of the 23rd International Conference on Intelligent User Interfaces

This work is focused on the specific properties and evaluation of full-body interaction design of multi-user mixed reality environments. The main goal is to study how full-body interaction can aid in intervention strategies for children with autism, to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IDC '16: Proceedings of the The 15th International Conference on Interaction Design and Children

June 2016

774 pages

ISBN:9781450343138

DOI:10.1145/2930674

Conference Chairs:
Janet C. Read
University of Central Lancashire, UK
,
Phil Stenton
BBC Research & Development, UK

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

IDC '16

Sponsor:

SIGCHI

IDC '16: Interaction Design and Children

June 21 - 24, 2016

Manchester, United Kingdom

Acceptance Rates

IDC '16 Paper Acceptance Rate 36 of 77 submissions, 47%;

Overall Acceptance Rate 172 of 578 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

52
Total Citations
View Citations
728
Total Downloads

Downloads (Last 12 months)58
Downloads (Last 6 weeks)9

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Peretti SPino MCaruso FDi Mascio T(2024)Evaluating the Potential of Immersive Virtual Reality-Based Serious Games Interventions for Autism: A Pocket Guide Evaluation FrameworkEducation Sciences10.3390/educsci1404037714:4(377)Online publication date: 5-Apr-2024
https://doi.org/10.3390/educsci14040377
Economidou EItzlinger AFrauenberger C(2024)Lived experience in human-building interaction (HBI): an initial frameworkFrontiers in Computer Science10.3389/fcomp.2023.12339045Online publication date: 4-Jan-2024
https://doi.org/10.3389/fcomp.2023.1233904
Gali OTüter GErcan SDelgado ÓAtherton GCross LPares N(2024)Participatory Design of an Embodied Mixed Reality Experience Aimed to Assessing Individual and Collaborative Behaviors of ChildrenProceedings of the ACM on Human-Computer Interaction10.1145/36770938:CHI PLAY(1-27)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677093
Morris BHavlucu HOldfield AMetatla O(2024)Understanding Neurodiverse Social Play Between Autistic and Non-Autistic ChildrenProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642809(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642809
Schaper MTamashiro MVan Mechelen MIversen OEriksson E(2024)Onboarding new talent to Child–Computer Interaction researchInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2024.10065540:COnline publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2024.100655
Shafiee EArjmandnia AGhasemzadeh SHasanzadeh SGholamali Lavasani M(2023)The Applicability of Assistive Technology in the Education and Treatment of Children with Autism: A Systematic ReviewPajouhan Scientific Journal10.61186/psj.21.4.29521:4(295-304)Online publication date: 1-Dec-2023
https://doi.org/10.61186/psj.21.4.295
Razzak RLi JHe SSokhadze E(2023)Investigating Sex-Based Neural Differences in Autism and Their Extended Reality Intervention ImplicationsBrain Sciences10.3390/brainsci1311157113:11(1571)Online publication date: 9-Nov-2023
https://doi.org/10.3390/brainsci13111571
Peretti SCaruso FPino MDi Mascio T(2023)A Systematic Review to Know How Interventions Realized with Immersive Virtual Reality-Based Serious Games for Individuals with Autism are EvaluatedProceedings of the 15th Biannual Conference of the Italian SIGCHI Chapter10.1145/3605390.3605396(1-14)Online publication date: 20-Sep-2023
https://dl.acm.org/doi/10.1145/3605390.3605396
Jahadakbar MAraujo de Aguiar CNikkhah Dehnavi AGhandi M(2023)Sounds of Play: Designing Augmented Toys for Children with AutismProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594859(338-346)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594859
Minissi MLandini GMaddalon LTorres SGiglioli ISirera MAbad LGómez-García SAlcañiz M(2023)Virtual Reality-Based Serious Games to Improve Motor Learning in Children with Autism Spectrum Disorder: An Exploratory Study2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH)10.1109/SeGAH57547.2023.10253792(1-6)Online publication date: 28-Aug-2023
https://doi.org/10.1109/SeGAH57547.2023.10253792
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents