short-paper

A comparison of speech and GUI input for navigation in complex visualizations on mobile devices

Authors:

Eleftherios KoutsofiosAuthors Info & Claims

MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services

Pages 357 - 360

https://doi.org/10.1145/1851600.1851665

Published: 07 September 2010 Publication History

Abstract

Mobile devices are ubiquitously used to access web applications. Multimodal mobile interfaces can offer advantages over less flexible approaches, in both usability and range of features. In this study we consider applying speech input to a web-based network management service. The key issue we are interested in is how to perform suitable multidimensional search through web-based interface on mobile devices. We present results from a pilot user evaluation, focusing on the comparison of a novel speech input method with the existing manual (GUI, Graphical User Interface) input for AT&T's Visualizer management service, on an iPhone. Speech input was experimentally shown to be as effective, more efficient, and preferred over GUI input by most users. We foresee that a multimodal approach may be preferable for many applications on mobile devices.

References

[1]

Chang, E., Meng, H., et al., 2009. Efficient Web Search on Mobile Devices with Multi-Modal Input and Intelligent Text Summarization. In Proceedings of the 11th World Wide Web Conference. (Honolulu, Hawaii, USA, May 7-11, 2002). WWW'02.

[2]

Cherubini, M., Anguera, X., Oliver, N., and de Oliveira, R., 2009. Text versus Speech: A Comparison of Tagging Input Modalities for Camera Phones. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services. (Bonn, Germany, September 15-18, 2009). MobileHCI'09, ACM 978-1-60558-281-8.

Digital Library

[3]

Doyle, J., and Bertolotto, M., 2006. Combining Speech and Pen Input for Effective Interaction in Mobile GeoSpatial Environments. In Proceedings of the 21st Annual ACM Symposium on Applied Computing. (Dijon, France, April 23-27, 2006) ACM 1-59593-108-2.

Digital Library

[4]

Fabbrizio, G., D., Okken, T., and Wilpon, J., G., 2009. A Speech Mashup Framework for Multimodal Mobile Services. In Proceedings of the 11th International Conference on Multimodal Interfaces. (Cambridge, Massachusetts, USA, Nov 2-4, 2009) ICMI-MLMI'09 ACM 1-60558-772-1.

Digital Library

[5]

Goffin, V., Allauzen, C., et al., 2005. The AT&T WATSON speech recognizer. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing. (Columbus, Ohio, USA, June 2008). ACL'08.

[6]

Gruenstein, A., Hsu, B., et al., 2008. A Multimodal Home Entertainment Interface via a Mobile Device. In Proceedings of the ACL-08: HLT Workshop on Mobile Language Processing. (Philadelphia, USA, March 18-23, 2005). ICASSP'05.

[7]

Johnston, M., Bangalore, S., et al., 2002. MATCH: An Architecture for Multimodal Dialogue Systems. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics. (Philadelphia, USA, 2002).

Digital Library

[8]

Jokinen, K., and Kanto, K., 2004. User Expertise Modelling and Adaptivity in a Speech-based E-mail System. In Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics. (Barcelona, Spain, 2004).

Digital Library

[9]

Kalyuga, S., Chandler, P., and Sweller, J.: Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology 13(4), 351--371 (1999)

[10]

McBurney, D. H., and White, T. L., Research Methods (with Info Trac), Page 273. ISBN: 0-534-52418-4

[11]

MediaPost news, January 5, 2010. http://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=120085&nid=109540

[12]

Melto, A., Turunen, M., et al., 2008. Evaluation of Predictive Text and Speech Inputs in a Multimodal Mobile Route Guidance Application. In Proceedings of the 10th International Conference on Human-Computer Interaction with Mobile Devices and Services. (Amsterdam, Netherlands, September 2-5, 2008). MobileHCI'08, ACM 978-1-59593-952-4.

Digital Library

[13]

Montgomery, D. C., Design and Analysis, 3rd edition, Page 76--79. ISBN: 0471316490

[14]

Nijholt, A., Hulstijn, J., and Hessen, A., 1999. Speech and Language Interactions in a Web Theatre Environment. In Proceedings of ESCA Workshop on Interactive Dialogue in Multi-Modal Systems. (Kloster Irsee, Germany, June 1999).

[15]

Nunnally, J., Psychometric Theory, Wiley, NY, 1978.

[16]

Schofield, E., and Zheng, Z., 2003. A Speech Interface for Open-Domain Question-Answering. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 2. (Sapporo, Japan, 2003) ISBN: 0-111-456789

Digital Library

[17]

Turunen, M., Kallinen, A., et al., 2009. Multimodal Interaction with Speech and Physical Touch Interface in a Media Center Application. In Proceedings of the 5th Advances in Computer Entertainment Technology Conference incorporating DIMEA 2009. (Athens, Greece, Oct 29-31, 2009). ISBN: 978-1-60558-864-3.

Digital Library

Cited By

Viswanathan SGuillot FChang MGrasso ARenders J(2022)Addressing Hiccups in Conversations with Recommender SystemsProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533491(1243-1259)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533491
Zhang DChou HZhou L(2012)Hype or Ready for Prime Time?International Journal of Handheld Computing Research10.4018/jhcr.20121001033:4(40-55)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.4018/jhcr.2012100103

Index Terms

A comparison of speech and GUI input for navigation in complex visualizations on mobile devices

Recommendations

Spatial metaphors for a speech-based mobile city guide service

Speech-based automated mobile phone services allow people to access information whilst on the move, but are difficult to use due to the arbitrary assignment of numbers to menu options. For this study, it was hypothesised that the use of spatial ...
Usability Comparison of Pen-Based Input for Young Children on Mobile Devices
SUTC '08: Proceedings of the 2008 IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (sutc 2008)

This research implements a system, primarily focusing on examining young children's capability of pen-based input on mobile devices, to compare accuracy of pointing-and-clicking and dragging-and-dropping dots with different sizes, locations, and ...
Mobile devices and web services
ACS'07: Proceedings of the 7th Conference on 7th WSEAS International Conference on Applied Computer Science - Volume 7

Service oriented architecture (SOA) presents one of modern approaches used in the process of information systems development. One of the technologies the SOA is based on are web services. Rapid development of capabilities of mobile devices (including ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services

September 2010

552 pages

ISBN:9781605588353

DOI:10.1145/1851600

General Chairs:
Marco de Sá
LaSIGE & University of Lisboa, Portugal
,
Luís Carriço
LaSIGE & University of Lisboa, Portugal
,
Program Chair:
Nuno Correia
CITI & New University of Lisboa, Portugal

Copyright © 2010 Copyright is held by the author/owner(s).

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MobileHCI '10

MobileHCI '10: 12th International Conference on Human Computer Interaction with Mobile Devices and Services

September 7 - 10, 2010

Lisbon, Portugal

Acceptance Rates

MobileHCI '10 Paper Acceptance Rate 46 of 225 submissions, 20%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
804
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Viswanathan SGuillot FChang MGrasso ARenders J(2022)Addressing Hiccups in Conversations with Recommender SystemsProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533491(1243-1259)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533491
Zhang DChou HZhou L(2012)Hype or Ready for Prime Time?International Journal of Handheld Computing Research10.4018/jhcr.20121001033:4(40-55)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.4018/jhcr.2012100103

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten