Desenvolvimento de interfaces multimodais a partir da integração de comandos vocais à interface gráfica
Pages 31 - 39
Abstract
In the last years, mouse/keyboard based graphical interaction is the current standard of human-computer interfaces. The integration of voice as an input mode to visual-only interfaces provide means for reducing some of the known limitations of existing human-computer interaction. One of the major issues that remains is how to integrate voice input into a graphical interface application. In this paper, we introduce a process for developing multimodal interfaces that combine voice and visual input/output. In order to evaluate the proposed approach, a video application multimodal interface was implemented and analysed.
References
[1]
Carneiro, M. Interfaces Assistidas para Deficientes Visuais utilizando Dispositivos Reativos e Transformadas de Distância. Rio de Janeiro. Tese de Doutorado, Pontificia Universidade Católica, Rio de Janeiro, RJ. 2003. 162p.
[2]
Carvalho, J. O. F. Referenciais para Projetistas e Usuários de Interfaces de Computadores Destinadas aos Deficientes Visuais. Dissertação de Mestrado, Universidade Estadual de Campinas, Campinas, SP. 1994.
[3]
Charwat, H. J. Lexikon der Mensch-Maschine-Kommunikation. Oldenbourg, 1992.
[4]
Courtiat, J. P.; Santos, C. A. S.; Lohr, C.; Outtaj, B. Experience with RT-LOTOS, a temporal extension of the LOTOS formal description technique. In: Computer Communications, 23, July 2000.
[5]
Damper, R. I. Speech as an interface medium: how can it best be used?, in Baber, C. and Noyes, J. M., Eds. Interactive Speech Technology: Human Factors Issues in the Application of Speech Input/Output to Computers. Taylor and Francis. 1993. p.59--71. (URL: http://eprints.ecs.soton.ac.uk/301/, access on May 2005)
[6]
De Souza, C. S.; Leite, J. C.; Prates, R. O.; Barbosa, S. D. J. Projeto de Interfaces de Usuário: perspectivas cognitivas e semióticas. Jornada de Atualização em Informática (JAI), Congresso da SBC, Rio de Janeiro. 1999.
[7]
Gavaldà, M. La Investigación em Tecnologías de La Lengua. Quark Ciencia, Medicina, Comunicación y Cultura. N.19, Jul-Dec. 2000, p. 20--25.
[8]
Grasso, M. A. Speech Input in Multimodal Environments: A proposal to Study the Effects of Reference Visibility, Reference Number, and Task Integration. Technical Report CS-96-09, University of Maryland, Baltimore Campus. 1996. (URL: www.csee.umbc.edu/~mikeg/papers/report01.pdf)
[9]
Hix, D.; Hartson, H. R., 1993. Developing User Interfaces: Ensuring Usability Through Product & Process. Caps 1, 2 e 3. John Wiley & Sons, Inc.
[10]
Ibm, 2003. Multimodal Application Design Issues. (URL: ftp://ftp.software.ibm.com/software/pervasive/info/multimodal/multimodal_apps_design_issus.pdf) Access on Jul. 2005.
[11]
IBM VIA VOICE. (URL: http://www-3.ibm.com/software/speech/). Acess on: Jun. 2004
[12]
JMF, API Specifications. (URL: http://java.sun.com/products/java-media/jmf/reference/api) Acess on May 2005.
[13]
Marchal, B. Xml Conceitos e Aplicações. Berkeley, São Paulo, 2000.
[14]
Maybury, M. Coordination and Fusion in Multimodal Interaction. 2001. (URL:http://www.mitre.org/work/tech_papers/tech_papers_01/maybury_coordination/maybury_coordination.pdf) Acess on Jun. 2004.
[15]
Mountford, S. J.; Gaver, W. W. Talking and listening to computers. In: Laurel, B. (Ed.), The art of human-computer interface design, Reading, MA: Addison-Wesley. 1990, p.319--334.
[16]
Oviatt, S., 2002. Multimodal Interfaces. Handbook of Human-Computer Interaction, Lawrence Erlbaum: New Jersey. (URL: http://www.cse.ogi.edu/CHCC/Publications/zHCIHandbookMMI-OviattSS.pdf). Access on Feb. 2005.
[17]
Preece, J. et al. Human-computer interaction. Addison-Wesley, U.K. 1994.
[18]
Raksin, J. The Humane Interface: New Directions for Designing Interactive Systems, Cap. 1. Jul. 2000. ACM Press.
[19]
Santos, C. A. S.; Rehem Neto, A. N; Tavares, T. A. Um Ambiente para Anotação em Vídeos Digitais com Aplicação em Telemedicina. Proc. of the Webmedia & LA Web 2004, Ribeirãão Preto, Brazil, 2004.
[20]
Schomaker, L. et al. A Taxonomy of Multimodal Interaction in the Human Information Processing System. Tech. Report, ESPRIT PROJECT 8579. 1995. (URL: hwr.nici.kun.nl/~miami/taxonomy/taxonomy.html. acess on Jun 2004)
[21]
Shneiderman, B. Designing the User Interface: Strategies for Effective Human-Computer-Interaction. Caps 1, 8 e 9, 3rd ed. Addison-Wesley. U.K. 1998.
[22]
Siqueira, E. G. Estratégias e padrões para a modelagem da interface humano-computador de sistemas baseados na arquitetura softboard. São José dos Campos: INPE, 2001.
[23]
Srivatsa, H. Multimodal Applications: Another Step in computer/human interaction. Jul. 2002. (URL: http://www-28.ibm.com/developerworks/wireless/library/wi-multimodal/index.html). Acess on Jul. 2005.
[24]
Sun Microsystems. Java Speech API Programmer's Guide. October, 1998. 156 p. (URL:http://java.sun.com/products/java-media/speech/forDevelopers/jsapi-guide.pdf)
Index Terms
- Desenvolvimento de interfaces multimodais a partir da integração de comandos vocais à interface gráfica
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2006
251 pages
ISBN:1595934324
DOI:10.1145/1298023
- General Chair:
- Jair Cavalcanti Leite,
- Program Chair:
- Raquel Oliveira Prates
Copyright © 2006 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- SBC: Brazilian Computer Society
- CEIHC - SBC Special Interest Group in Human-Computer Interaction
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 November 2006
Check for updates
Author Tags
Qualifiers
- Article
Conference
IHC'06
Sponsor:
- SBC
Acceptance Rates
IHC '06 Paper Acceptance Rate 20 of 68 submissions, 29%;
Overall Acceptance Rate 331 of 973 submissions, 34%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 463Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 19 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in