article

Design issues encountered in the development of a mobile multimedia augmentative communication service

Authors:

D. SmithAuthors Info & Claims

Universal Access in the Information Society, Volume 2, Issue 3

Pages 255 - 264

https://doi.org/10.1007/s10209-003-0058-6

Published: 01 October 2003 Publication History

Abstract

Augmentative and alternative communication (AAC) systems can be mounted on a range of different hardware platforms, from custom-designed units to desktop or laptop personal computers and hand-held and palmtop systems. Palmtop devices such as personal data assistants (PDAs) offer great advantages of portability. The small display size and limited storage and processing capacity of a PDA compared to larger systems are likely to impose some limitations on the range of AAC applications which can be supported, however, particularly when multimedia-based applications are considered. This paper addresses issues involved in migrating a multimedia AAC application onto a palm-top PDA and discusses the user involvement in the re-engineering of the system for that environment. Outcomes from an initial practical trial with a person who uses AAC are reported.

References

[1]

Alm N, Arnott JL, Newell AF (1992) Prediction and conversational momentum in an augmentative communication system. Communications of the ACM, 35(5):46---57

Digital Library

[2]

Alm N, Arnott JL (1998) Computer-assisted conversation for non-vocal people using pre-stored texts. IEEE Transactions on systems, man and cybernetics: Part C, 28(3):318---328

[3]

Alm N, Newell AF, Arnott JL (1997) Lessons from applying conversation modelling to augmentative and alternative communication. In: Proceedings of the 12th annual international conference on technology for persons and disabilities (CSUN 97), Northridge, CA, March 1997. Online at: http://www.csun.edu/cod/conf/1997/proceedings/csun97_003.htm

[4]

American Speech-Language-Hearing Association (1989) Competencies for speech-language pathologists providing services in augmentative communication. ASHA 31:107---110. American Speech-Language-Hearing Association, Rockville, MD

[5]

Beukelman DR, Ansel BM (1995) Research priorities in augmentative and alternative communication. Augmentative Alternative Commun (AAC) 11(2):131---134

[6]

Beukelman DR, Mirenda P (1998) Augmentative and alternative communication: management of severe communication disorders in children and adults, 2nd ed. Paul H Brookes, Baltimore, MD

[7]

Brewster SA (2002) Overcoming the lack of screen space on mobile Computers. Personal Ubiquitous Comput 6:188---205

Digital Library

[8]

Brewster SA, Cryer PG (1999) Maximising screen-space on mobile computing devices. In: Summary proceedings of the ACM conference on human factors in computing systems (CHI 99), Pittsburgh, 15---20 May 1999, pp 224---225

[9]

Brewster SA, Murray R (2000) Presenting dynamic information on mobile computers. Personal Technol 4(2):209---212

Digital Library

[10]

Brophy-Arnott MB, Newell AF, Arnott JL, Condie D (1992) A survey of the communication impaired population of Tayside. Eur J Disorders Commun 27:159---173

[11]

Broumley E, Arnott JL, Cairns AY, Newell AF (1990) TalksBack: an application of AI techniques to a communication prosthesis for non-speaking people. In: Proceedings of the 9th European conference on artificial intelligence, Stockholm, 6---10 August 1990, pp 117---119

[12]

Carpenter T, McCoy K, Pennington C (1997) Schema-based organization of re-usable text in AAC: user-interface considerations. In: Proceedings of the 20th RESNA conference (RESNA 97), Pittsburgh, 20---24 June 1997, pp 57---59

[13]

Csikszentmihalyi M, Rochberg-Halton E (1981) The meaning of things: Domestic symbols and the self. Cambridge University Press, Cambridge, UK

[14]

De Bruijn O, Spence R, Chong MH (2002) RSVP Browser: Web browsing on small screen devices. Personal Ubiquitous Comput 6(4):245---252

Digital Library

[15]

Dunbar RIM (1996) Grooming, gossip and the evolution of language. Mackays of Chatham, Chatham, Kent, UK

[16]

Dunlop M, Brewster SA (2002) The challenge of mobile devices for human computer interaction. Personal Ubiquitous Comput 6(4):235---236

Digital Library

[17]

Dunlop MD, Davidson N (2000) Visual information seeking on palmtop devices. In: Proceedings of HCI 2000, Sunderland, UK, 5---8 September 2000, 2:19---20

[18]

Dye R, Alm N, Arnott J, Harper G, Morrison A (1998) A script-based AAC system for transactional interaction. Nat Language Eng 4(1):57---71

Digital Library

[19]

Emler N (1994) Gossip, reputation and social adaptation. In: Goodman RF, Ben-Ze'ev A (eds) Good gossip. Kansas University Press, Lawrence, KS, pp 117---138

[20]

Enderby P, Philipp R (1986) Speech and language handicap: towards knowing the size of the problem. Br J Disorders Commun 21(2):151---165

[21]

Enkidu (2002) Portable IMPACT: versatile AAC devices. Enkidu Research, Spencerport, NY, Online at: http://www.enkidu.net/enkidu_portable.html

[22]

Gawronski M (2001) Augmentative communication devices: getting better and better. In: Assistive technology in action: a publication of the Helen Hayes Hospital Center for Rehabilitation Technology, vol 3. Online at: http://www.helenhayeshospital.org/crtnews1201.htm

[23]

Glennen SL (1997) Augmentative and alternative communication systems. In: Glennen SL, DeCoste DC (eds) Handbook of augmentative and alternative communication. Singular, San Diego, pp 59---96

[24]

Hawes P, Blenkhorn P (2000) The use of Windows CE as a platform for AAC. In: Proceedings of the 15th annual international conference on technology and persons with disabilities (CSUN 2000), Northridge, CA, March 2000. Online at: http://www.csun.edu/cod/conf/2000/proceedings/0237Hawes.htm

[25]

Higginbotham DJ, Wilkins DP, Lesher GW (1999) Frametalker: a communication frame and utterance-based augmentative communication device. In: Proceedings of the 22nd RESNA conference, Long Beach, CA 25---29 June 1999, pp 40---42

[26]

Higginbotham DJ, Cornish J, Wilkins D, Lesher G, Moulton B (2000) The development of communication frames for augmentative communication devices. In: Proceedings of the 9th biennial conference of the International Society for Augmentative and Alternative Communication (ISAAC 2000), Washington, DC, 2---6 August 2000, pp 732---734

[27]

Hine N, Arnott JL (2002) Assistive social interaction for non-speaking people living in the community. In: Proceedings of the 5th international ACM conference on assistive technologies (ASSETS 2002), Edinburgh, 8---10 July 2002, pp 162---169

[28]

Hine N, Arnott JL (2002) A multimedia social interaction service for inclusive community living: initial user trials. Universal Access Inform Soc 2(1):8---17

[29]

Lesher GW, Moulton BJ, Higginbotham, DJ (1999) Effects of n-gram order and training text size on word prediction. In: Proceedings of the 22nd RESNA conference (RESNA 99), Long Beach, CA, 25---29 June 1999, pp 52---54

[30]

Mäkelä A, Giller V, Tscheligi M, Sefelin R (2000) Joking, story-telling, past-sharing, expressing affection: a field trial of how children and their social network communicate with digital images in leisure time. In: Proceedings of the ACM conference on human factors in computing systems (CHI 2000), The Hague, Netherlands, 1---6 April 2000, pp 548---555

[31]

Moulton BJ, Lesher GW, Higginbotham DJ (1999) A system for automatic abbreviation expansion. In: Proceedings of the 22nd RESNA conference (RESNA 99), Long Beach, CA, 25---29 June, pp 55---57

[32]

Newell AF, Arnott JL, Booth L, Beattie W, Brophy MB, Ricketts IW (1992) Effect of the PAL word prediction system on the quality and quantity of text generation. Augmentative Alternative Commun (AAC) 8(4):304---311

[33]

Poulson D, Ashby M, Richardson S (1996) Userfit: a practical handbook on user-centred design for assistive technology. ECSC-AC-EAEC, European Commission, Brussels-Luxembourg

[34]

Read SJ, Miller LC (1995) Stories are fundamental to meaning and memory: For social creatures could it be otherwise? In: Wyer RS (ed.) Knowledge and memory: the real story. Lawrence Erlbaum, Hillsdale, NJ, pp 139---152

[35]

Raghunath MT, Narayanaswami C (2002) User interfaces for applications on a wrist watch. Personal Ubiquitous Comput 6(1):17---30

Digital Library

[36]

Rist T, Brandmeier P (2002) Customizing graphics for tiny displays of mobile devices. Personal Ubiquitous Comput 6(4):260---268

Digital Library

[37]

Saltillo (2002) ChatPC. Saltillo Corp., Millersburg, OH. Online at: http://saltillo.buyol.com/Item/2860N.htm

[38]

Schank RC, Abelson R (1977) Scripts, plans, goals and understanding. Lawrence Erlbaum, Hillsdale, NJ

[39]

Schank RC (1995) Tell me a story: narrative and intelligence. Northwestern University Press, Evanston, IL

[40]

Schank RC, Abelson RP (1995) Knowledge and memory: the real story. In: Wyer RS (ed) Knowledge and memory: the real story. Lawrence Erlbaum, Hillsdale, NJ, pp 1---85

[41]

Scott LM (1995) Representation and narrative: a commentary on Schank and Abelson's "Knowledge and Memory". In: Wyer RS (ed) Knowledge and memory: the real story. Lawrence Erlbaum, Hillsdale, NJ, pp 165---176

[42]

Todman J, Alm N, Elder L (1994) Computer-aided conversation: a prototype system for non-speaking people with physical disabilities. Appl Psycholinguist 15:45---73

[43]

Todman J, Elder L, Alm N (1995) Evaluation of the content of computer-aided conversations. Augmentative Alternative Commun (AAC) 11(4):229---234

[44]

Todman J, Alm N (1997) Pragmatics and AAC approaches to conversational goals. In: Proceedings of the ACL workshop on natural language processing for communication aids, Madrid, 12 July 1997, pp 1---8

[45]

Todman J (2000) Rate and quality of conversations using a text-storage AAC system: Single-case training study. Augmentative Alternative Commun (AAC) 16(3):164---179

[46]

Vanderheyden PB, Demasco PW, McCoy KF, Pennington C (1996) A preliminary study into schema-based access and organization of reusable text in AAC. In: Proceedings of the 19th RESNA conference (RESNA 96), Salt Lake City, 7---12 June 1996, pp 59---61

[47]

Walker A, Brewster SA (1999) Spatial audio in small screen device displays. Personal Technol 4(2):144---154

[48]

Waller A (1992) Providing narratives in an augmentative communication system. PhD Thesis. University of Dundee, Dundee, Scotland

[49]

Waller A, Dennis F, Brodie J, Cairns AY (1998) Evaluating the use of TalksBac, a predictive communication device for non-fluent adults with aphasia. Int J Language Commun Disorders 33(1):45---70

[50]

Waller A, Francis J, Tait L, Booth L, Hood H (1999) The WriteTalk project: story-based interactive communication. In: Proceedings of the European conference on the advancement of assistive technology (AAATE 99), Düsseldorf, 1---4 November 1999, pp 180---184

[51]

Zygo (2002) Polyana IITM with PersonaTM. ZYGO Industries Inc., Portland, OR. Online at: http://www.zygo-usa.com/polyana.html

Cited By

MacKenzie ITanaka-Ishii K(2007)Text Entry SystemsundefinedOnline publication date: 12-Mar-2007
Boyd-Graber JNikolova SMoffatt KKin KLee JMackey LTremaine MKlawe M(2006)Participatory design with proxiesProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1124772.1124797(151-160)Online publication date: 22-Apr-2006

Design issues encountered in the development of a mobile multimedia augmentative communication service
1. Applied computing
  1. Law, social and behavioral sciences
  2. Life and medical sciences

Recommendations

An augmentative and alternative communication tool for children and adolescents with cerebral palsy
Medical teamwork, collaboration and patient-centred care

People with disabilities face many accessibility problems in their daily lives. One such group of disabled people, children who suffer from cerebral palsy, faces specific challenges, which arise due to motor dysfunction and communication disorders. In ...
Development of a Location and Situation Based Augmentative and Alternative Communication Service
Computers Helping People with Special Needs
Abstract
Mobile Augmentative and Alternative Communication (AAC) applications have great advantages in portability. Choosing the appropriate AAC board for a user’s current location or situation is a very difficult and hard job for people with cerebral ...
Developing an augmentative mobile communication system
ICCHP'12: Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part II

The widespread use of smartphones and the inclusion of new tech-nologies as Near Field Communications (NFC) in the mobile devices offer a chance to turn the classic Augmentative and Alternative Communication (AAC) boards into Hi-Tech AAC systems with ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Universal Access in the Information Society

Universal Access in the Information Society Volume 2, Issue 3

October 2003

88 pages

ISSN:1615-5289

EISSN:1615-5297

Issue’s Table of Contents

Copyright © Copyright © 2003 Springer-Verlag.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 October 2003

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

MacKenzie ITanaka-Ishii K(2007)Text Entry SystemsundefinedOnline publication date: 12-Mar-2007
Boyd-Graber JNikolova SMoffatt KKin KLee JMackey LTremaine MKlawe M(2006)Participatory design with proxiesProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1124772.1124797(151-160)Online publication date: 22-Apr-2006

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents