research-article

Experiments in mobile spatial audio-conferencing: key-based and gesture-based interaction

Authors:

Christina Dicke,

Mark Billinghurst,

Juha LehikoinenAuthors Info & Claims

MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

Pages 91 - 100

https://doi.org/10.1145/1409240.1409251

Published: 02 September 2008 Publication History

Abstract

In this paper we describe an exploration into the usability of spatial sound and multimodal interaction techniques for a mobile phone conferencing application. We compared traditional keypad based-interaction to that of a newer approach using the phone itself as a device to navigate within a virtual spatial auditory environment. While the traditional keypad interaction proved to be more straightforward to use, there was no significant impact on task completion times or number of interaction movements made between the techniques. Overall, users felt that the spatial audio application supported group awareness while aiding peripheral task monitoring. They also felt it aided the feeling of social connectedness and offered enhanced support for communication.

References

[1]

Billinghurst, M., Bowskill, J., and Morphett, J., Wearable communication space, in British Telecommunications Engineering, vol. 16, 1998, pp. 311--317.

[2]

Billinghurst, M., Deo, S., Adams, N., & Lehikoinen, J., Motion-Tracking in Spatial Mobile Audio-Conferencing, presented at Workshop on Spatial Audio for Mobile Devices (SAMD'07), Mobile HCI'07 (Singapore), 2007.

[3]

Brewster, S., Lumsden, J., Bell, M., Hall, M. and Tasker, S., Multimodal 'Eyes-Free' Interaction Techniques for Wearable Devices, in SIGCHI conference on Human Factors in Computing Systems, vol. 5 (1), 2003, pp. 473--480.

Digital Library

[4]

Cohen, M. and L. F. Ludwig, Multidimensional audio window management, in International Journal of Man-Machine Studies, vol. 34(3), 1991, pp. 319--336.

Digital Library

[5]

Corso, J. F., Age and Sex Differences in Pure Tone Thresholds, in Archives of Otolaryngology, vol 77, 1963, pp. 385--405.

[6]

Crispien, K. and Ehrenberg, T., Evaluation of the "cocktail party effect" for multiple speech stimuli within a spatial audio display, in Journal of the Audio Engineering Society 43, 1995, pp. 932--940.

[7]

Crispien. K., Fellbaum. K., Savidis. A. and Stephanidis. C., A 3D-Auditory Environment for Hierarchical Navigation in Non-visual Interaction, in Proceedings of the 3rd International Conference on Audio Display, Palo Alto, USA, 1996, pp. 18--21.

[8]

Drullman, R., & Bronkhorst, A. W., Multichannel speech intelligibility and talker recognition using monaural, binaural, and three-dimensional auditory presentation, in Journal of the Accoustical Society of America, vol. 107(4), 2000, pp. 2224--2235.

[9]

Ericson, M. A., and McKinley, R. L., The intelligibility of multiple talkers separated spatially in noise, in Binaural and Spatial Hearing in Real and Virtual Environments, edited by R. H. Gilkey and T. R. Anderson (Erlbaum, Mahwah, NJ), 1997, pp. 701--724.

[10]

Frauenberger. C. and Stockman. T., Patterns in Auditory Menu Design, in Proceedings of the 12th International Conference on Auditory Display, London, UK, 2006, pp. 141--147.

[11]

Goose, S., Riedlinger, J. and Kodlahalli, S., Conferencing3: 3D audio conferencing and archiving services for handheld wireless devices, in International Journal of Wireless and Mobile Computing, vol. 1(1), 2005, pp. 5--13.

Digital Library

[12]

Kan, A., Pope, G., Jin, C., and van Schaik, A., Mobile Spatial Audio Communication System, in Proc of ICAD 04-Tenth Meeting of the International Conference on Auditory Display, Sydney, Australia, 2004.

[13]

Kobayashi, M. and Schmandt, C., Dynamic Soundscape: mapping time to space for audio browsing., in Human Factors in Computing Systems, CHI, 1997, pp. 194--201.

Digital Library

[14]

Pearson J. D., Morrell C. H., Gordon-Salant S., Brant, L. J., Metter, E. J., Klein, L. L. and Fozard, J. L., Gender differences in a longitudinal study of age-associated hearing loss, in Journal of the Acoustic Society of America, 1997, pp. 1196--1205.

[15]

Savidis A., Stephanidis. C., Korte. A., Crispien. K. and Fellbaum. K., A Generic Direct-Manipulation 3D-Auditory Environment for Hierarchical Navigation in Non-visual Interaction, in Proceedings of Assets'96. New York, USA, ACM, 1996, pp. 117--123.

Digital Library

[16]

Sawhney, N., and Schmandt, C., Nomadic Radio: Speech and audio interaction for contextual messaging in nomadic environments, in ACM Transactions on Computer-Human Interaction, vol. 7, 2000, pp. 353--383.

Digital Library

[17]

Walker, A. and Brewster, S. A, Extending the Auditory Display Space in Handheld Computing Devices, in Proceedings of the Second Workshop on Human Computer Interaction with Mobile Devices, Edinburgh, 1999, Available at www.dcs.gla.ac.uk/~mark/research/workshops/mobile99

[18]

Wirth, M., H. Horn, Koenig, T., Stein, M., Federspiel, A., Meier, B., Michel, CM. and Strik, W., Sex Differences in Semantic Processing: Event-Related Brain Potentials Distinguish between Lower and Higher Order Semantic Analysis during Word Reading, in Cerebral Cortex, vol. 17(9), 2006, pp. 1987--1997.

[19]

Yankelovich, N., J. Kaplan, Provino, J., Wessler, M. and DiMicco, J. M. Improving Audio Conferencing: Are Two Ears Better than One? CSCW, ACM, 2006, p. 334--342.

Digital Library

Cited By

Zhong SRosset LPapinutto MLalanne DAlavi H(2022)Binaural Audio in Hybrid Meetings: Effects on Speaker Identification, Comprehension, and User ExperienceProceedings of the ACM on Human-Computer Interaction10.1145/35551706:CSCW2(1-24)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555170
Dicke CMüller JBanic ASuma ESteinicke FStuerzlinger W(2015)Evaluating Mid-air List Interaction for Spatial Audio InterfacesProceedings of the 3rd ACM Symposium on Spatial User Interaction10.1145/2788940.2788945(24-33)Online publication date: 8-Aug-2015
https://dl.acm.org/doi/10.1145/2788940.2788945
Heller FBorchers JBegole BKim JInkpen KWoo W(2015)AudioScopeProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems10.1145/2702123.2702159(949-952)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702123.2702159
Show More Cited By

Index Terms

Experiments in mobile spatial audio-conferencing: key-based and gesture-based interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Experiments in spatial mobile audio-conferencing
Mobility '07: Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology

With improvements in digital cellular networks, and greater pervasiveness of wireless communication, mobiles phones begin to support multi-party calling. Due to hardware limitations in current models, speakers are presented in a single audio stream, ...
Designing Interactions with Multilevel Auditory Displays in Mobile Audio-Augmented Reality

Auditory interfaces offer a solution to the problem of effective eyes-free mobile interactions. In this article, we investigate the use of multilevel auditory displays to enable eyes-free mobile interaction with indoor location-based information in non-...
Extraction of Pinna Features for Customized Binaural Audio Delivery on Mobile Devices
MoMM '13: Proceedings of International Conference on Advances in Mobile Computing & Multimedia

The paper presents a system for customized binaural audio delivery based on the extraction of the relevant features from a 2-D representation of the listener's pinna. A procedure based on multi-flash imaging for recognizing the main contours of the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

September 2008

568 pages

ISBN:9781595939524

DOI:10.1145/1409240

Conference Chairs:
Henri ter Hofte
Telematica Instituut
,
Ingrid Mulder
Telematica Instituut & Rotterdam University

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 September 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI08

MobileHCI08: 10th International Conference on Human Computer Interaction with Mobile Devices and Services

September 2 - 5, 2008

Amsterdam, The Netherlands

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
538
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhong SRosset LPapinutto MLalanne DAlavi H(2022)Binaural Audio in Hybrid Meetings: Effects on Speaker Identification, Comprehension, and User ExperienceProceedings of the ACM on Human-Computer Interaction10.1145/35551706:CSCW2(1-24)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555170
Dicke CMüller JBanic ASuma ESteinicke FStuerzlinger W(2015)Evaluating Mid-air List Interaction for Spatial Audio InterfacesProceedings of the 3rd ACM Symposium on Spatial User Interaction10.1145/2788940.2788945(24-33)Online publication date: 8-Aug-2015
https://dl.acm.org/doi/10.1145/2788940.2788945
Heller FBorchers JBegole BKim JInkpen KWoo W(2015)AudioScopeProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems10.1145/2702123.2702159(949-952)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702123.2702159
Rantala JMüller SRaisamo RSuhonen KVäänänen-Vainio-Mattila KLantz VEpps JChen FOviatt SMase KSears AJokinen KSchuller B(2013)User experiences of mobile audio conferencing with spatial audio, haptics and gesturesProceedings of the 15th ACM on International conference on multimodal interaction10.1145/2522848.2522863(59-66)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1145/2522848.2522863
Bleeker TGun Lee Billinghurst M(2013)Ego- and Exocentric interaction for mobile AR conferencing2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR.2013.6671823(1-6)Online publication date: Oct-2013
https://doi.org/10.1109/ISMAR.2013.6671823
Hyder MHaun MHoene C(2010)Placing the participants of a spatial audio conference callProceedings of the 7th IEEE conference on Consumer communications and networking conference10.5555/1834217.1834370(680-686)Online publication date: 9-Jan-2010
https://dl.acm.org/doi/10.5555/1834217.1834370
Dicke CWolf KTal Yde Sá MCarriço LCorreia N(2010)FoogueProceedings of the 12th international conference on Human computer interaction with mobile devices and services10.1145/1851600.1851705(455-458)Online publication date: 7-Sep-2010
https://dl.acm.org/doi/10.1145/1851600.1851705
Deray KSimoff S(2010)Kinetic Inter-actingProceedings of the 2010 14th International Conference Information Visualisation10.1109/IV.2010.20(73-78)Online publication date: 26-Jul-2010
https://dl.acm.org/doi/10.1109/IV.2010.20
Hyder MHaun MHoene C(2010)Placing the Participants of a Spatial Audio Conference Call2010 7th IEEE Consumer Communications and Networking Conference10.1109/CCNC.2010.5421622(1-7)Online publication date: Jan-2010
https://doi.org/10.1109/CCNC.2010.5421622
Deray KSimoff S(2009)Designing Technology for Visualisation of Interactions on Mobile DevicesJournal of Computing Science and Engineering10.5626/JCSE.2009.3.4.2183:4(218-237)Online publication date: 31-Dec-2009
https://doi.org/10.5626/JCSE.2009.3.4.218
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents