Abstract
Augmentative and alternative communication (AAC) systems can be mounted on a range of different hardware platforms, from custom-designed units to desktop or laptop personal computers and hand-held and palmtop systems. Palmtop devices such as personal data assistants (PDAs) offer great advantages of portability. The small display size and limited storage and processing capacity of a PDA compared to larger systems are likely to impose some limitations on the range of AAC applications which can be supported, however, particularly when multimedia-based applications are considered. This paper addresses issues involved in migrating a multimedia AAC application onto a palm-top PDA and discusses the user involvement in the re-engineering of the system for that environment. Outcomes from an initial practical trial with a person who uses AAC are reported.
Similar content being viewed by others
References
Alm N, Arnott JL, Newell AF (1992) Prediction and conversational momentum in an augmentative communication system. Communications of the ACM, 35(5):46–57
Alm N, Arnott JL (1998) Computer-assisted conversation for non-vocal people using pre-stored texts. IEEE Transactions on systems, man and cybernetics: Part C, 28(3):318–328
Alm N, Newell AF, Arnott JL (1997) Lessons from applying conversation modelling to augmentative and alternative communication. In: Proceedings of the 12th annual international conference on technology for persons and disabilities (CSUN 97), Northridge, CA, March 1997. Online at: http://www.csun.edu/cod/conf/1997/proceedings/csun97_003.htm
American Speech-Language-Hearing Association (1989) Competencies for speech-language pathologists providing services in augmentative communication. ASHA 31:107–110. American Speech-Language-Hearing Association, Rockville, MD
Beukelman DR, Ansel BM (1995) Research priorities in augmentative and alternative communication. Augmentative Alternative Commun (AAC) 11(2):131–134
Beukelman DR, Mirenda P (1998) Augmentative and alternative communication: management of severe communication disorders in children and adults, 2nd ed. Paul H Brookes, Baltimore, MD
Brewster SA (2002) Overcoming the lack of screen space on mobile Computers. Personal Ubiquitous Comput 6:188–205
Brewster SA, Cryer PG (1999) Maximising screen-space on mobile computing devices. In: Summary proceedings of the ACM conference on human factors in computing systems (CHI 99), Pittsburgh, 15–20 May 1999, pp 224–225
Brewster SA, Murray R (2000) Presenting dynamic information on mobile computers. Personal Technol 4(2):209–212
Brophy-Arnott MB, Newell AF, Arnott JL, Condie D (1992) A survey of the communication impaired population of Tayside. Eur J Disorders Commun 27:159–173
Broumley E, Arnott JL, Cairns AY, Newell AF (1990) TalksBack: an application of AI techniques to a communication prosthesis for non-speaking people. In: Proceedings of the 9th European conference on artificial intelligence, Stockholm, 6–10 August 1990, pp 117–119
Carpenter T, McCoy K, Pennington C (1997) Schema-based organization of re-usable text in AAC: user-interface considerations. In: Proceedings of the 20th RESNA conference (RESNA 97), Pittsburgh, 20–24 June 1997, pp 57–59
Csikszentmihalyi M, Rochberg-Halton E (1981) The meaning of things: Domestic symbols and the self. Cambridge University Press, Cambridge, UK
De Bruijn O, Spence R, Chong MH (2002) RSVP Browser: Web browsing on small screen devices. Personal Ubiquitous Comput 6(4):245–252
Dunbar RIM (1996) Grooming, gossip and the evolution of language. Mackays of Chatham, Chatham, Kent, UK
Dunlop M, Brewster SA (2002) The challenge of mobile devices for human computer interaction. Personal Ubiquitous Comput 6(4):235–236
Dunlop MD, Davidson N (2000) Visual information seeking on palmtop devices. In: Proceedings of HCI 2000, Sunderland, UK, 5–8 September 2000, 2:19–20
Dye R, Alm N, Arnott J, Harper G, Morrison A (1998) A script-based AAC system for transactional interaction. Nat Language Eng 4(1):57–71
Emler N (1994) Gossip, reputation and social adaptation. In: Goodman RF, Ben-Ze’ev A (eds) Good gossip. Kansas University Press, Lawrence, KS, pp 117–138
Enderby P, Philipp R (1986) Speech and language handicap: towards knowing the size of the problem. Br J Disorders Commun 21(2):151–165
Enkidu (2002) Portable IMPACT: versatile AAC devices. Enkidu Research, Spencerport, NY, Online at: http://www.enkidu.net/enkidu_portable.html
Gawronski M (2001) Augmentative communication devices: getting better and better. In: Assistive technology in action: a publication of the Helen Hayes Hospital Center for Rehabilitation Technology, vol 3. Online at: http://www.helenhayeshospital.org/crtnews1201.htm
Glennen SL (1997) Augmentative and alternative communication systems. In: Glennen SL, DeCoste DC (eds) Handbook of augmentative and alternative communication. Singular, San Diego, pp 59–96
Hawes P, Blenkhorn P (2000) The use of Windows CE as a platform for AAC. In: Proceedings of the 15th annual international conference on technology and persons with disabilities (CSUN 2000), Northridge, CA, March 2000. Online at: http://www.csun.edu/cod/conf/2000/proceedings/0237Hawes.htm
Higginbotham DJ, Wilkins DP, Lesher GW (1999) Frametalker: a communication frame and utterance-based augmentative communication device. In: Proceedings of the 22nd RESNA conference, Long Beach, CA 25–29 June 1999, pp 40–42
Higginbotham DJ, Cornish J, Wilkins D, Lesher G, Moulton B (2000) The development of communication frames for augmentative communication devices. In: Proceedings of the 9th biennial conference of the International Society for Augmentative and Alternative Communication (ISAAC 2000), Washington, DC, 2–6 August 2000, pp 732–734
Hine N, Arnott JL (2002) Assistive social interaction for non-speaking people living in the community. In: Proceedings of the 5th international ACM conference on assistive technologies (ASSETS 2002), Edinburgh, 8–10 July 2002, pp 162–169
Hine N, Arnott JL (2002) A multimedia social interaction service for inclusive community living: initial user trials. Universal Access Inform Soc 2(1):8–17
Lesher GW, Moulton BJ, Higginbotham, DJ (1999) Effects of n-gram order and training text size on word prediction. In: Proceedings of the 22nd RESNA conference (RESNA 99), Long Beach, CA, 25–29 June 1999, pp 52–54
Mäkelä A, Giller V, Tscheligi M, Sefelin R (2000) Joking, story-telling, past-sharing, expressing affection: a field trial of how children and their social network communicate with digital images in leisure time. In: Proceedings of the ACM conference on human factors in computing systems (CHI 2000), The Hague, Netherlands, 1–6 April 2000, pp 548–555
Moulton BJ, Lesher GW, Higginbotham DJ (1999) A system for automatic abbreviation expansion. In: Proceedings of the 22nd RESNA conference (RESNA 99), Long Beach, CA, 25–29 June, pp 55–57
Newell AF, Arnott JL, Booth L, Beattie W, Brophy MB, Ricketts IW (1992) Effect of the PAL word prediction system on the quality and quantity of text generation. Augmentative Alternative Commun (AAC) 8(4):304–311
Poulson D, Ashby M, Richardson S (1996) Userfit: a practical handbook on user-centred design for assistive technology. ECSC-AC-EAEC, European Commission, Brussels-Luxembourg
Read SJ, Miller LC (1995) Stories are fundamental to meaning and memory: For social creatures could it be otherwise? In: Wyer RS (ed.) Knowledge and memory: the real story. Lawrence Erlbaum, Hillsdale, NJ, pp 139–152
Raghunath MT, Narayanaswami C (2002) User interfaces for applications on a wrist watch. Personal Ubiquitous Comput 6(1):17–30
Rist T, Brandmeier P (2002) Customizing graphics for tiny displays of mobile devices. Personal Ubiquitous Comput 6(4):260–268
Saltillo (2002) ChatPC. Saltillo Corp., Millersburg, OH. Online at: http://saltillo.buyol.com/Item/2860N.htm
Schank RC, Abelson R (1977) Scripts, plans, goals and understanding. Lawrence Erlbaum, Hillsdale, NJ
Schank RC (1995) Tell me a story: narrative and intelligence. Northwestern University Press, Evanston, IL
Schank RC, Abelson RP (1995) Knowledge and memory: the real story. In: Wyer RS (ed) Knowledge and memory: the real story. Lawrence Erlbaum, Hillsdale, NJ, pp 1–85
Scott LM (1995) Representation and narrative: a commentary on Schank and Abelson’s “Knowledge and Memory”. In: Wyer RS (ed) Knowledge and memory: the real story. Lawrence Erlbaum, Hillsdale, NJ, pp 165–176
Todman J, Alm N, Elder L (1994) Computer-aided conversation: a prototype system for non-speaking people with physical disabilities. Appl Psycholinguist 15:45–73
Todman J, Elder L, Alm N (1995) Evaluation of the content of computer-aided conversations. Augmentative Alternative Commun (AAC) 11(4):229–234
Todman J, Alm N (1997) Pragmatics and AAC approaches to conversational goals. In: Proceedings of the ACL workshop on natural language processing for communication aids, Madrid, 12 July 1997, pp 1–8
Todman J (2000) Rate and quality of conversations using a text-storage AAC system: Single-case training study. Augmentative Alternative Commun (AAC) 16(3):164–179
Vanderheyden PB, Demasco PW, McCoy KF, Pennington C (1996) A preliminary study into schema-based access and organization of reusable text in AAC. In: Proceedings of the 19th RESNA conference (RESNA 96), Salt Lake City, 7–12 June 1996, pp 59–61
Walker A, Brewster SA (1999) Spatial audio in small screen device displays. Personal Technol 4(2):144–154
Waller A (1992) Providing narratives in an augmentative communication system. PhD Thesis. University of Dundee, Dundee, Scotland
Waller A, Dennis F, Brodie J, Cairns AY (1998) Evaluating the use of TalksBac, a predictive communication device for non-fluent adults with aphasia. Int J Language Commun Disorders 33(1):45–70
Waller A, Francis J, Tait L, Booth L, Hood H (1999) The WriteTalk project: story-based interactive communication. In: Proceedings of the European conference on the advancement of assistive technology (AAATE 99), Düsseldorf, 1–4 November 1999, pp 180–184
Zygo (2002) Polyana IITM with PersonaTM. ZYGO Industries Inc., Portland, OR. Online at: http://www.zygo-usa.com/polyana.html
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Hine, N., Arnott, J. & Smith, D. Design issues encountered in the development of a mobile multimedia augmentative communication service. UAIS 2, 255–264 (2003). https://doi.org/10.1007/s10209-003-0058-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-003-0058-6