article

Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders

Authors:

Juan Pablo Hourcade,

Natasha E. Bullock-Rest,

Thomas E. HansenAuthors Info & Claims

Personal and Ubiquitous Computing, Volume 16, Issue 2

Pages 157 - 168

https://doi.org/10.1007/s00779-011-0383-3

Published: 01 February 2012 Publication History

Abstract

In spite of great improvements in early diagnosis and interventions, most children diagnosed with autism spectrum disorders (ASD) are unlikely to live independently when they reach adulthood. We have been conducting research on novel computer-based interventions with the goal of promoting social skills. Working with 26 children with ASD, their teachers, and other stakeholders, we have iteratively developed a set of activities based on applications that run on multitouch tablets. Our observations suggest these activities increased pro-social behaviors such as collaboration and coordination, augmented appreciation for social activities, and provided children with novel forms of expression.

References

[1]

Albinali F, Goodwin MS, Intille S (2009) Recognizing stereotypical motor movements in the laboratory and classroom: a case study with children on the autism spectrum. Proc Ubicomp 2009:71-80.

[2]

American Psychiatric Association (2000) Diagnostic and statistical manual of mental disorders, 4th edn. American Psychiatric Association, Washington, DC.

[3]

Bailey JS, Burch MR (2002) Research methods in applied behavior analysis. SAGE Publications, Thousand Oaks.

[4]

Billstedt E, Gillberg C, Gillberg C (2005) Autism after adolescense: population-based 13-22-year follow-up study of 120 individuals with autism diagnosed in childhood. J Autism Dev Disord 35(3):351-360.

[5]

Binger C (2008) Classroom-based language goals and intervention for children who use AAC: back to basics. Perspect Augment Altern Commun 17:20-26.

[6]

Bosseler A, Massaro DW (2003) Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. J Autism Dev Disord 33(6):653-669.

[7]

CDC (2010) Autism spectrum disorder. http://www.cdc.gov/ ncbddd/autism/index.html

[8]

Coleman-Martin MB, Wolff-Heller K, Cihak DF, Irvine KL (2005) Using computer-assisted instruction and the nonverbal reading approach to teach word identification. Focus Autism Other Dev Disabl 20:80-90.

[9]

Davis M, Dautenhahn K, Nehaniv C, Powell S (2006) Touch story: towards an interactive learning environment for helping children with autism to understand narrative. In: Miesenberger K et al (eds) Designing accessible technology. Springer, London, pp 785-792.

[10]

Eaves LC, Ho HH (2008) Young adult outcome of autism spectrum disorders. J Autism Dev Disord 38(4):739-747.

[11]

Elkeseth S (2009) Outcome of comprehensive psychoeducational interventions for young children with autism. Res Dev Disabil 30(1):158-178.

[12]

Faja S, Aylward E, Bernier R, Dawson G (2008) Becoming a face expert: a computerized face-training program for high-functioning individuals with autism spectrum disorders. Dev Neuropsychol 33(1):1-24.

[13]

Farr W, Yuill N, Raffle H (2010) Social benefits of a tangible user interface for children with autistic spectrum conditions. Autism 14(3):237-252.

[14]

Feil-Seifer D, Mataric MJ (2009) Toward socially assistive robotics for augmenting interventions for children with autism spectrum disorders. In: Siciliano B, Khatib O, Groen F (eds) Experimental robotics. Springer, Berlin.

[15]

Gal E, Bauminger N, Goren-Bar D, Pianesi F, Stock O, Zancanaro M, Weiss PL (2009) Enhancing social communication of children with high-functioning autism through a co-located interface. AI Soc 24:75-84.

[16]

Grynzpan O, Martin JC, Nadel J (2008) Multimedia interfaces for users with high-functioning autism: an empirical investigation. Int J Hum Comput Stud 66:628-639.

[17]

Hailpern J, Karahalios K, Halle J (2009) Creating a spoken impact: encouraging vocalization through audio visual feedback in children with ASD. In: Proceedings of CHI 2009, pp 453-462.

[18]

Hansen TE, Hourcade JP, Virbel M, Patali S, Serra T (2009) PyMT: a post-WIMP multi-touch user interface toolkit. In: Proceedings of Tabletop 2009, pp 17-24.

[19]

Hayes GR, Kientz JA, Truiong KN, White DR, Abowd GD, Pering T (2004) Designing capture applications to support the education of children with autism. In: Proceedings of Ubicomp 2004, pp 161-178.

[20]

Hayes GR, Hirano S, Marcu G, Monibi M, Nguyen DH, Yeganyan M (2010) Interactive visual supports for children with autism. Pers Ubiquit Comput 14(7):663-680.

[21]

Hendrix K, van Herk R, Verhaegh J, Markopoulos P (2009) Increasing children's social competence through games: an exploratory study. In: Proceedings of IDC 2009, pp 182-185.

[22]

Hetzroni OE, Tannous J (2004) Effects of computer-based intervention program on the communicative functions of children with autism. J Autism Dev Disord 34(2):95-113.

[23]

Hirano SH, Yeganyan MT, Marcu G, Nguyen DH, Boyd L, Hayes GR (2010) vSked: evaluation of a system to support classroom activities for children with autism. In: Proceedings of CHI 2010, pp 1633-1642.

[24]

Hourcade JP, Bederson BB, Druin A, Rose A, Farber A, Takayama Y (2003) The international children's digital library: viewing digital books online. Interact Comput 15:151-167.

[25]

Hourcade JP, Bederson BB, Druin A (2004) Building kidpad: an application for children's collaborative storytelling. Softw Pract Exp 34:895-914.

[26]

Hourcade JP, Beitler D, Cormenzana F, Flores P (2008) Early OLPC experiences in a rural Uruguayan school. In: Proceedings of extended abstracts of CHI 2008 conference, pp 2503-2512.

[27]

Howlin P, Goode S, Hutton J, Rutter M (2004) Adult outcome for children with autism. J Child Psychol Psychiatr 45(2):212-229.

[28]

Keay-Bright W (2007) Can computers create relaxation? Designing ReacTickles© software with children on the autistic spectrum. CoDes 3(2):97-110.

[29]

Kientz JA, Hayes GR, Westeyn TL, Starner T, Abowd GD (2007) Pervasive computing and autism: assisting caregivers of children with special needs. IEEE Perv Comput 6(1):28-35.

[30]

Madsen M, el Kaliouby R, Goodwin M, Picard R (2008) Technology for just-in-time in situ learning of facial affect for persons diagnosed with an autism spectrum disorder. In: Proceedings of ASSETS 2008, pp 19-26.

[31]

Moore M, Calvert S (2000) Brief report: vocabulary acquisition for children with autism: teacher or computer instruction. J Autism Dev Disord 30(4):359-362.

[32]

Mottron L, Dawson M, Soulieres I, Hubert B, Burack J (2006) Enhanced perceptual functioning in autism: an update, and eight principles of autistic perception. J Autism Dev Disord 36(1): 27-43.

[33]

Parés N et al (2005) Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment. In: Proceedings of IDC 2005, pp 110-116.

[34]

Piper AM, O'Brien E, Ringel Morris M, Winograd T (2006) SIDES: a cooperative tabletop computer game for social skills development. In: Proceedings of CSCW 2006, pp 1-10.

[35]

Putnam C, Chong L (2008) Software and technologies designed for people with autism: what do users want? In: Proceedings of ASSETS 2008, pp 3-10.

[36]

Robins B, Dickerson P, Stribling P, Dautenhahn K (2004) Robot-mediated joint attention in children with autism: a case study in robot-human interaction. Interact Stud 5(2):151-198.

[37]

Tartaro A, Cassell J (2008) Playing with virtual peers: bootstrapping contingent discourse in children with Autism. In: Proceedings of ICLS 2008, pp 23-42.

[38]

Tentori M, Hayes GR (2010) Designing for interaction immediacy to enhance social skills of children with Autism. In: Proceedings of Ubicomp 2010, pp 51-60.

[39]

TI WA (1997) Designing environments for successful kids: a resource manual. Wisconsin Assistive Technology Initiative, Oshkosh.

[40]

Westeyn TL, Vadas K, Bian X, Starner T, Abowd GD (2005) Recognizing mimicked autistic self-stimulatory behaviors using HMMs. ISWC 2005:164-169.

[41]

Whalen C, Liden L, Ingersoll B, Dallaire E, Liden S (2006) Behavioral improvements associated with computer-assisted instruction for children with developmental disabilities. J Speech Lang Pathol 1(1):11-26.

[42]

Wheelwright S, Baron-Cohen S (2001) The link between autism and skills such as engineering, maths, physics and computing. Autism 5(2):223-227.

Cited By

Affleck JGooravin SMalcolm CMcHutchison SShearer AWatt CAlessandrini A(2023)A Human-Robot Conversation Interface for Children with ASDHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42293-5_37(368-372)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-42293-5_37
Fu YMichelson RLin YNguyen LTayebi THiniker A(2022)Social Emotional Learning with Conversational AgentsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346226:2(1-23)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534622
Huang YWang YXiao TBei RZhao YLu ZTong X(2022)StarRescue: Transforming A Pong Game to Visually Convey the Concept of Turn-taking to Children with AutismExtended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play10.1145/3505270.3558320(246-252)Online publication date: 2-Nov-2022
https://dl.acm.org/doi/10.1145/3505270.3558320
Show More Cited By

Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders
1. Applied computing

Recommendations

Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

The increasing rates of diagnosis for Autism Spectrum Disorders (ASDs) have brought unprecedented attention to these conditions. Interventions during childhood can increase the likelihood of independent living later in life, but most adults with ASDs ...
Evaluating a Collaborative iPad Game's Impact on Social Relationships for Children with Autism Spectrum Disorder

This article describes how collaborative assistive technologies, housed on off-the-shelf, low-cost platforms such as the iPad, can be used to facilitate social relationships in children with autism spectrum disorder (ASD). Through an empirical study of ...
Can a robot be an efficient mediator in promoting dyadic activities among children with Autism Spectrum Disorders and children of Typical Development?
BCI'19: Proceedings of the 9th Balkan Conference on Informatics

Studies have provided evidence that interventions with Socially Assistive Robots (SARs), can help children with Autism Spectrum Disorder (ASD) to develop social skills. This study will outline features of SAR that respond to the heterogeneity of the ASD,...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Personal and Ubiquitous Computing

Personal and Ubiquitous Computing Volume 16, Issue 2

February 2012

102 pages

ISSN:1617-4909

Issue’s Table of Contents

Copyright © Copyright © 2012 Springer-Verlag London Limited.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 February 2012

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

59
Total Citations
View Citations
896
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Affleck JGooravin SMalcolm CMcHutchison SShearer AWatt CAlessandrini A(2023)A Human-Robot Conversation Interface for Children with ASDHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42293-5_37(368-372)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-42293-5_37
Fu YMichelson RLin YNguyen LTayebi THiniker A(2022)Social Emotional Learning with Conversational AgentsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346226:2(1-23)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534622
Huang YWang YXiao TBei RZhao YLu ZTong X(2022)StarRescue: Transforming A Pong Game to Visually Convey the Concept of Turn-taking to Children with AutismExtended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play10.1145/3505270.3558320(246-252)Online publication date: 2-Nov-2022
https://dl.acm.org/doi/10.1145/3505270.3558320
Horton P(2022)Tensions in designing tablet-based musical instruments for students with disabilitiesInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2022.10047233:COnline publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.ijcci.2022.100472
Chung SGhinea G(2022)Towards developing digital interventions supporting empathic ability for children with autism spectrum disorderUniversal Access in the Information Society10.1007/s10209-020-00761-421:1(275-294)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1007/s10209-020-00761-4
Jodra MRodellar V(2022)What Can Technology Do for Autistic Spectrum Disorder People?Artificial Intelligence in Neuroscience: Affective Analysis and Health Applications10.1007/978-3-031-06242-1_30(301-309)Online publication date: 31-May-2022
https://dl.acm.org/doi/10.1007/978-3-031-06242-1_30
Piana SMalagoli CUsai MCamurri A(2021)Effects of Computerized Emotional Training on Children with High Functioning AutismIEEE Transactions on Affective Computing10.1109/TAFFC.2019.291602312:4(1045-1054)Online publication date: 1-Oct-2021
https://dl.acm.org/doi/10.1109/TAFFC.2019.2916023
Qiu SAn PKang KHu JHan TRauterberg M(2021)Investigating socially assistive systems from system design and evaluation: a systematic reviewUniversal Access in the Information Society10.1007/s10209-021-00852-w22:2(609-633)Online publication date: 15-Nov-2021
https://dl.acm.org/doi/10.1007/s10209-021-00852-w
Baykal GEriksson EBarendregt WTorgersson OBjork SLamas DSarapuu HŠmorgun IBerget G(2020)Evaluating Co-located Games as a Mediator for Children’s Collaborative InteractionProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420118(1-11)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3419249.3420118
Begnaud DCoenraad MJain NPatel DBonsignore ERubegni EVasalou AParés NSawhney N(2020)"It's just too much"Proceedings of the Interaction Design and Children Conference10.1145/3392063.3394414(624-636)Online publication date: 21-Jun-2020
https://dl.acm.org/doi/10.1145/3392063.3394414
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents