research-article

Visual feedback of acoustic data for speech therapy: model and design parameters

Authors:

Andrew Johnston,

Kirrie Ballard,

Dharani Perera-SchulzAuthors Info & Claims

AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound

Pages 135 - 140

https://doi.org/10.1145/2371456.2371478

Published: 26 September 2012 Publication History

Abstract

Feedback, usually of a verbal nature, is important for speech therapy sessions. Some disadvantages exist however with traditional methods of speech therapy, and visual feedback of acoustic data is a useful alternative that can be used to complement typical clinical sessions. Visual feedback has been investigated before, and in this paper we propose several new prototypes. From these prototypes we develop an iterative model of analysing the design of feedback systems by examining the feedback process. From this iterative model, we then extract methods to inform design of visual feedback systems for speech therapy.

References

[1]

S. Al Hashimi. Beyond using voice as voice. In 16th International Conference of Advance Studies in Systems Research, Information and Cybernetics, Baden-Baden, Germany, 2005.

[2]

S. Al Hashimi. Blowtter: a voice-controlled plotter. In 20th BCS HCI Group Conference in Cooperation with ACM, London, UK, 2006.

[3]

S. Al Hashimi. Users as performers in vocal interactive media: The role of expressive voice-visualizations in transforming users into performers. International Journal of Performance Arts and Digital Media, 2(3), 2006.

[4]

A. Dowd, J. Smith, and J. Wolfe. Learning to pronounce vowel sounds in a foreign language using acoustic measurements of the vocal tract as feedback in real time. Language and Speech, (41):1--20, 1998.

[5]

S. Ferguson, A. Vande Moere, and D. Cabrera. Seeing sound: Real-time sound visualisation in visual feedback loops used for training musicians. In Proceedings of the 10th Symposium on Information Visualisation, London, UK, 2005.

Digital Library

[6]

J. Hailpern, K. K. G, and J. Halle. Creating spoken impact: Encouraging vocalizations through audio visual feedback. In Proceedings of the CHI 2009, Massachusetts, USA, 2009.

Digital Library

[7]

J. Hailpern, K. K. G., J. Halle, L. DeThorne, and M.-K. Coletto. Visualizations: Speech, language and autistic spectrum disorder. In Proceedings of the CHI 2008, Florence, Italy, 2008.

Digital Library

[8]

A. Halpern, R. Cole, L. Ramig, J. Yan, J. Petska, S. V. Vuuren, and J. Spielman. Virtual speech therapist: Expanding the horizons of speech treatment for parkinson's disease. In Thirteenth Biennial Conference on Motor Speech, Austin, Texas, 2006.

[9]

A. Halpern, C. Matos, L. Ramig, J. Petska, and J. Spielman. Lsvtc: A pda supported speech treatment for parkinson's disease. In 9th International Congress of Parkinson's Disease and Movement Disorders, New Orleans, LA, USA, 2005.

[10]

S. Harada, J. Landay, J. Malkin, X. Li, and J. Bilmes. The vocal joystick: Evaluation of voice-based cursor control techniques. In 8th International ACM SIGACCESS Conference on Computers and Accessibility, Portland, Oregon, 2006.

Digital Library

[11]

A. Johnston, B. Marks, and L. Candy. Sound controlled musical instruments based on physical models. In international Computer Music Conference, Copenhagen, Denmark, 2007.

[12]

A. Johnston, D. Perera-Schulz, K. Ballard, and A. Levy. Creative vocal systems for engaging speech therapy. In OZCHI 2011, Canberra, Australia, 2011.

[13]

R. Kent. Hearing and believing: Some limits to the auditory-perceptual assessment of speech and voice disorders. American Journal of Speech-Language Pathology, 5:7--23, 1996.

[14]

R. Kent and Y.-J. Kim. Toward an acoustic typology of motor speech disorders. Clinical Linguistics and Phonetics, 17:427--445, 2003.

[15]

D. Perera, R. T. J. Eales, and K. Blashki. Supporting the creative drive: Investigating paralinguistic voice as a mode of interaction for artists with upper limb disabilities. Universal Access in the Information Society, 8(2):77--88, 2009.

Digital Library

[16]

M. Puckette. Pure data. In International Conference on Computer Music, pages 224--227, Thessaloniki, Greece, 1997.

[17]

L. Ruggero, P. McCabe, N. Munro, and K. Ballard. Paediatric speech-language pathology service delivery: An australian parent survey. International Journal of Speech Language Pathology, in press.

[18]

A. Sporka, S. Kurniawan, M. Mahmud, and P. Slavik. Longitudinal study of continuous non-speech operated mouse pointer. In CHI '07 Extended Abstracts on Human Factors in Computing Systems, pages 2669--74, San Jose, California, USA, 2007. ACM Press.

Digital Library

[19]

A. Sporka, S. Kurniawan, and P. Slavik. Acoustic control of mouse pointer. Universal Access in the Information Society, 4(3):237--45, 2005.

Digital Library

Cited By

Ganzeboom MYılmaz ECucchiarini CStrik HBoll SAizawa KBriasouli AGurrin CJalali LMeyer J(2016)On the Development of an ASR-based Multimedia Game for Speech TherapyProceedings of the 2016 ACM Workshop on Multimedia for Personal Health and Health Care10.1145/2985766.2985771(3-8)Online publication date: 16-Oct-2016
https://dl.acm.org/doi/10.1145/2985766.2985771

Index Terms

Visual feedback of acoustic data for speech therapy: model and design parameters

Recommendations

Comparing heterogeneous visual gestures for measuring the diversity of visual speech signals
Highlights
- We present comprehensive experiments on two datasets in isolated words and continuous speech which use speaker-specific visemes and show that these improve ...
Abstract
Visual lip gestures observed whilst lipreading have a few working definitions, the most common two are: ‘the visual equivalent of a phoneme’ and ‘phonemes which are indistinguishable on the lips’. To date there is no formal definition, ...
A new approach to acoustic analysis of two British regional accents--Birmingham and Liverpool accents

Accent is a reflection of an individual speaker's regional affiliation and is shaped by the speaker's community background. This study investigated the acoustic characteristics of two British regional accents--the Birmingham and Liverpool accents--and ...
Developmental Disorders Manifestation in the Characteristics of the Child’s Voice and Speech: Perceptual and Acoustic Study
Speech and Computer
Abstract
The paper presents the data of the perceptual experiment on recognition of the child’s developmental disorders via speech. Participants of the study were 30 children aged 11–12 years: with autism spectrum disorders (ASD, n = 10), with Down ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound

September 2012

174 pages

ISBN:9781450315692

DOI:10.1145/2371456

Conference Chairs:
Andreas Floros
Ionian University, Greece
,
Andreas Mniestris
Ionian University, Greece
,
Program Chairs:
Iani Zannos
Ionian University, Greece
,
Theodoros Lotis
Ionian University, Greece

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AM '12

AM '12: A conference on interaction with sound

September 26 - 28, 2012

Corfu, Greece

Acceptance Rates

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
295
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)2

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ganzeboom MYılmaz ECucchiarini CStrik HBoll SAizawa KBriasouli AGurrin CJalali LMeyer J(2016)On the Development of an ASR-based Multimedia Game for Speech TherapyProceedings of the 2016 ACM Workshop on Multimedia for Personal Health and Health Care10.1145/2985766.2985771(3-8)Online publication date: 16-Oct-2016
https://dl.acm.org/doi/10.1145/2985766.2985771

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents