research-article

Visualizations: speech, language & autistic spectrum disorder

Authors:

Mary-Kelsey ColettoAuthors Info & Claims

CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

Pages 3591 - 3596

https://doi.org/10.1145/1358628.1358896

Published: 05 April 2008 Publication History

Get Access

Abstract

Without speech, we can have great difficulty communicating wants, emotions, needs, and interacting with society at large. During typical child development, an infant acquires language skills without explicit teaching. However, some children, including those with Autistic Spectrum Disorder (ASD) have explicit difficulty developing these skills in the context of everyday interactions. HCI is situated to help by developing technology and techniques to teach speech and language skills to children with ASD through the use of visual and auditory feedback. This paper examines preliminary results from a study, as well as describes new directions of research.

References

[1]

Adler-Block, M., Bernhardt, B. M., Gick, B. and PBacsfalvi, P. The Use of Ultrasound in Remediation of North American English /r/ in 2 Adolescents. American Journal of Speech-Language Pathology, 16 (May 2007). 128--139.

Crossref

Google Scholar

[2]

Apple.Inc. Logic Pro, 2007.

Google Scholar

[3]

Autism Society of America, A. Autism Society of America, http://www.autism-society.org, 2007.

Google Scholar

[4]

Barry, R. M. EPG from square one: An overview of electropalatography as an aid to therapy. Clinical Linguistics & Phonetics, 3 (1). 81--91.

Google Scholar

[5]

Baskett, C. B. The effect of live interactive video on the communicative behavior in children with autism, University of North Carolina at Chapel Hill, Chapel Hill, 1996.

Google Scholar

[6]

Bergstrom, T. and Karahalios, K., Seeing More: Visualizing Audio Cues. in INTERACT, (Rio de Janerio, Brasil, 2007).

Digital Library

Google Scholar

[7]

Center for Disease Control and Prevention, C. Autism Information Center, DD, NCBDDD, CDC, Atlanta, April 25, 2007.

Google Scholar

[8]

DigiDesign. Pro Tools, 1991--2007.

Google Scholar

[9]

Hayes, G. R., Kientz, J. A., Truong, K. N., White, D. R., Abowd, G. D. and Pering, T., Designing Capture Applications to Support the Education of Children with Autism in International Conference on Ubiquitous Computing, (Nottingham, England, 2004).

Google Scholar

[10]

IBM. Speech Viewer III, 1997.

Google Scholar

[11]

Kanner, L. Autistic Disturbances of Affective Contact. in Kanner, L. ed. Nervous Child 2, V.H. Winston, 1943, 217--250.

Google Scholar

[12]

Kerr, S. J., Neale, H. R. and Cobb, S. V. G. Virtual environments for social skills training: the importance of scaffolding in practice Proceedings of the fifth international ACM conference on Assistive technologies, ACM Press, Edinburgh, Scotland, 2002.

Digital Library

Google Scholar

[13]

Kientz, J. A., Arriaga, R. I., Chetty, M., Hayes, G. R., Richardson, J., Patel, S. N. and Abowd, G. D. Grow and know: understanding record-keeping needs for tracking the development of young children Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, San Jose, California, USA, 2007.

Digital Library

Google Scholar

[14]

Kientz, J. A., Hayes, G. R., Abowd, G. D. and Grinter, R. E. From the war room to the living room: decision support for home-based therapy teams Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, ACM Press, Banff, Alberta, Canada, 2006.

Digital Library

Google Scholar

[15]

Lehman, J. F. Toward the use of speech and natural language technology in intervention for a languagedisordered population Proceedings of the third international ACM conference on Assistive technologies, ACM Press, Marina del Rey, California, United States, 1998.

Digital Library

Google Scholar

[16]

Lovaas, I.I. The Autistic Child. John Wiley & Sons, Inc, New York, 1977.

Google Scholar

[17]

Michaud, F. and Théberge-Turmel, C. Mobile robotic toys and autism. in Dautenhahn, K. ed. Socially Intelligent Agents - Creating Relationships with Computers and Robots, Springer, 2002, 125--132.

Google Scholar

[18]

Nakagawa, S. A Survey on Automatic Speech Recognition. IEICE TRANSACTIONS on Information and Systems, E85-D (3). 465--486.

Google Scholar

[19]

Parés, N., Carreras, A., Durany, J., Ferrer, J., Freixa, P., Gómez, D., Kruglanski, O., Parés, R., Ribas, J. I., Soler, M. and Sanjurjo, A. Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment Proceeding of the 2005 conference on Interaction design and children, ACM Press, Boulder, Colorado, 2005.

Digital Library

Google Scholar

[20]

Shuster, L. I. and Ruscello, D. M. Evoking {r} Using Visual Feedback. American Journal of Speech-Language Pathology, 1 (May 1992). 29--34.

Crossref

Google Scholar

[21]

Strik, H. and Cucchiarini, C. Modeling pronunciation variation for ASR: A survey of the literature. Speech Communication, 29 (2-4). 225--246.

Digital Library

Google Scholar

[22]

Tartaro, A. Storytelling with a virtual peer as an intervention for children with autism. SIGACCESS Access. Comput. (84). 42--44.

Digital Library

Google Scholar

[23]

Whittaker, S. and Amento, B., Semantic Speech Editing. in SIGCHI conference on Human factors in computing systems, (Vienna, Austria, 2004), ACM.

Digital Library

Google Scholar

Cited By

View all

Alzahrani MTag BJohnson BWybrow MKostakos VKay JHoang T(2024)Unlocking Autistic Children's Potential: The Crux with Data Visualisations and IoTCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678477(701-705)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678477
Yang YChung K(2022)Pilot Randomized Control Trial of an App-Based CBT Program for Reducing Anxiety in Individuals with ASD without Intellectual DisabilityJournal of Autism and Developmental Disorders10.1007/s10803-022-05617-953:4(1331-1346)Online publication date: 10-Jun-2022
https://doi.org/10.1007/s10803-022-05617-9
Wilson CBrereton MPloderer BMival OSmyth MDalsgaard P(2017)MyWordProceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems10.1145/3064857.3079133(132-137)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1145/3064857.3079133
Show More Cited By

Index Terms

Visualizations: speech, language & autistic spectrum disorder

Recommendations

Creating a spoken impact: encouraging vocalization through audio visual feedback in children with ASD
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

One hallmark difficulty of children with Autism Spectrum Disorder (ASD) centers on communication and speech. Research into computer visualizations of voice has been shown to influence conversational patterns and allow users to reflect upon their speech. ...
Designing visualizations to facilitate multisyllabic speech with children with autism and speech delays
DIS '12: Proceedings of the Designing Interactive Systems Conference

The ability of children to combine syllables represents an important developmental milestone. This ability is often delayed or impaired in a variety of clinical groups, including children with autism spectrum disorders (ASD) and speech delays (SPD). ...
Talking points: the differential impact of real-time computer generated audio/visual feedback on speech-like & non-speech-like vocalizations in low functioning children with ASD
Assets '09: Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility

Real-time computer feedback systems (CFS) have been shown to impact the communication of neurologically typical individuals. Promising new research appears to suggest the same for the vocalization of low functioning children with Autistic Spectrum ...

Reviews

Reviewer: Brad D. Reid

Autism spectrum disorder (ASD), also called pervasive development disorder (PDD), involves impairment in feeling, thinking, and language development. The most severe form is associated with autism and the milder form with Asperger's syndrome. In this paper, Hailpern et al. report the preliminary results of using human computer interaction (HCI) with visual and auditory feedback to teach children with ASD speech and language skills. Researchers "hypothesize that computers and HCI techniques [may] augment practitioners by teaching and reinforcing both vocalization and speech skills in children who are on the autism spectrum." The investigators use visualizations instead of struggling with the limitations of speech recognition software. A four-month pilot study involving five "low-functioning" autistic children was conducted from August to November 2007. Initial results concerning the usefulness of a software system that prompts a word with the reward of a visual and auditory display are encouraging. Other systems using waveform visualization, such as Pro Tools and Logic, allow a child to build a graphic design, with a feedback reward at the end. A research direction to be explored involves toy-like interfaces with auditory or flashing responses. While the paper is a brief five pages and very tentative, the researchers conclude with a significant list of citations and "early qualitative results that appear to be promising." Developers of educational computer applications and interactive designers will find this study of interest. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

April 2008

2035 pages

ISBN:9781605580128

DOI:10.1145/1358628

General Chairs:
Mary Czerwinski
Microsoft Research, USA
,
Arnie Lund
Microsoft, USA
,
Program Chair:
Desney Tan
Microsoft Research, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '08

Sponsor:

CHI '08: CHI Conference on Human Factors in Computing Systems

April 5 - 10, 2008

Florence, Italy

Acceptance Rates

Overall Acceptance Rate 5,779 of 22,566 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
716
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alzahrani MTag BJohnson BWybrow MKostakos VKay JHoang T(2024)Unlocking Autistic Children's Potential: The Crux with Data Visualisations and IoTCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678477(701-705)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678477
Yang YChung K(2022)Pilot Randomized Control Trial of an App-Based CBT Program for Reducing Anxiety in Individuals with ASD without Intellectual DisabilityJournal of Autism and Developmental Disorders10.1007/s10803-022-05617-953:4(1331-1346)Online publication date: 10-Jun-2022
https://doi.org/10.1007/s10803-022-05617-9
Wilson CBrereton MPloderer BMival OSmyth MDalsgaard P(2017)MyWordProceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems10.1145/3064857.3079133(132-137)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1145/3064857.3079133
Tentori MMercado JCibrian FEscobedo L(2016)PERVASIVE COMPUTING TO SUPPORT INDIVIDUALS WITH COGNITIVE DISABILITIESWireless Computing in Medicine10.1002/9781118993620.ch6(137-185)Online publication date: Jul-2016
https://doi.org/10.1002/9781118993620.ch6
Tan CJohnston ABluff AFerguson SBallard K(2014)Retrogaming as visual feedback for speech therapySIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications10.1145/2669062.2669069(1-5)Online publication date: 24-Nov-2014
https://dl.acm.org/doi/10.1145/2669062.2669069
Tan CJohnston ABallard KFerguson SPerera-Schulz DGreuter SMcCrea CMueller FHjorth LRichards D(2013)sPeAK-MANProceedings of The 9th Australasian Conference on Interactive Entertainment: Matters of Life and Death10.1145/2513002.2513022(1-4)Online publication date: 30-Sep-2013
https://dl.acm.org/doi/10.1145/2513002.2513022
Ferguson SJohnston ABallard KTan CPerera-Schulz DFloros AMniestris AZannos ILotis T(2012)Visual feedback of acoustic data for speech therapyProceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound10.1145/2371456.2371478(135-140)Online publication date: 26-Sep-2012
https://dl.acm.org/doi/10.1145/2371456.2371478
Chen SQuintian DTian Y(2012)Towards a visual speech learning system for the deaf by matching dynamic lip shapesProceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part I10.1007/978-3-642-31522-0_1(1-9)Online publication date: 11-Jul-2012
https://dl.acm.org/doi/10.1007/978-3-642-31522-0_1

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Creating a spoken impact: encouraging vocalization through audio visual feedback in children with ASD

Designing visualizations to facilitate multisyllabic speech with children with autism and speech delays

Talking points: the differential impact of real-time computer generated audio/visual feedback on speech-like & non-speech-like vocalizations in low functioning children with ASD

Reviews

Access critical reviews of Computing literature here