Article

Free access

A system for three-dimensional acoustic "visualization" in a virtual environment workstation

Authors:

Elizabeth M. Wenzel,

Scott S. Fisher,

Philip K. Stone,

Scott H. FosterAuthors Info & Claims

VIS '90: Proceedings of the 1st conference on Visualization '90

Pages 329 - 337

Published: 23 October 1990 Publication History

Abstract

This paper describes the real time acoustic display capabilities developed for the VIrtual Environment Workstation (VIEW) project at NASA-Ames Research Center. The acoustic display is capable of generating localized acoustic cues in real time over headphones. An auditory symbology, a related collection of representational auditory "objects" or "icons," can be designed using ACE, the Auditory Cue Editor, which links both discrete and continuously-varying acoustic parameters with information or events in the display. During a given display scenario, the symbology can be dynamically co-ordinated in real time with three-dimensional visual objects, speech, and gestural displays. The types of displays feasible with the system range from simple warnings and alarms to the acoustic representation of multidimensional data or events.

References

[1]

Begault, D. R. & Wenzel, E. M. (1990) Techniques and applications for binaural sound manipulation in man-machine interfaces. NASA Technical Memorandum No. TM102279, In Press.

[2]

Blattner, M. M., Sumikawa, D. A., & Greenberg. R. M. (1989) Earcons and icons: Their structure and common design principles. Hum.-Comp. Interact., 4, 11--44.

Digital Library

[3]

Blauert, J. (1983) Spatial Hearing. The MIT Press: Cambridge, MA.

[4]

Bly, S. (1982) Sound and computer information presentation. Unpublished doctoral thesis (UCRL-53282) Lawrence Livermore National Laboratory and University of California, Davis, CA.

Digital Library

[5]

Brooks, F. P. (1988) Grasping reality through illusion - Interactive graphics serving science. Proc. CHI'88, ACM Conf. Hum. Fac. Comp. Sys., Washington, D.C., 1--11.

Digital Library

[6]

Bregman, A. (1981) Asking the "what for" question in auditory perception. In Kubovy & Pomerantz (Eds.), Perceptual Organization, Lawrence Erlbaum Associates: Hillsdale, NJ.

[7]

Brown, M., Newsome, S., & Glinert, E. (1989) An experiment into the use of auditory cues to reduce visual workload. Proceedings of CHI'89, ACM Conference on Human Factors in Computing Systems, 339--346.

Digital Library

[8]

Buxton, W., Gaver, W., & Bly, S. (1989) The use of non-speech audio at the interface. Tutorial #10, CHI'89, ACM Press: New York.

[9]

Calhoun, G. L., Valencia, G., & Furness, T. A. III (1987) Three-dimensional auditory cue simulation for crew station design/evaluation. Proc. Hum. Fac. Soc., 31, 1398--1402.

[10]

Cherry, E. C. (1953) Some experiments on the recognition of speech with one and two ears. J. Acoust. Soc. Am., 22, 61--62.

[11]

Colquhoun, W. P. (1975) Evaluation of auditory, visual, and dual-mode displays for prolonged sonar monitoring in repeated sessions. Hum. Fac., 17, 425--437.

[12]

Deatherage, B. H. (1972) Auditory and other sensory forms of information presentation. In H. P. Van Cott & R. G. Kincade (Eds.), Human Engineering Guide to Equipment Design, (rev. ed.), Washington, DC: U.S. Government Printing Office, 123--160.

[13]

Doll, T. J., Gerth, J. M., Engelman, W. R. & Folds, D. J. (1986) Development of simulated directional audio for cockpit applications. USAF Report No. AAMRLTR-86-014.

[14]

Durlach, N. I. & Pang, X. D. (1986) Interaural magnification. J. Acoust. Soc. Am., 80, 1849--1850.

[15]

Edwards, A. D. N. (1989) Soundtrack: An auditory interface for blind users. Hum. Comp. Interact., 4, 45--66.

Digital Library

[16]

Egan, J. P., Carterette, E. C., & Thwing, EJ. (1954) Some factors affecting multichannel listening. J. Acoust. Soc. Am., 26, 774--782.

[17]

Fisher, S. S. (1986) Telepresence master glove controller for dexterous robotic end-effectors. Advances in Intelligent Robotics Systems, D. P. Casasent (Ed.), Proc. SPIE, 726.

[18]

Fisher, S. S., McGreevy, M. W., Humphries, J., & Robinett, W. (1986) Virtual environment display system. ACM Workshop on Interactive 3D Graphics, Chapel Hill, NC.

Digital Library

[19]

Fisher, S. S., Wenzel, E. M., Coler, C. & McGreevy, M. W. (1988) Virtual interface environment workstations. Proc. Hum. Fac. Soc., 32, 91--95.

[20]

Foley, J. D. (1987) Interfaces for advanced computing. Sci. Amer., 257, 126--135.

Digital Library

[21]

Furness, T. A. (1986) The super cockpit and its human factors challenges. Proc. Hum. Fac. Soc., 1986 (1), 48--52.

[22]

Garner, W. R. (1949) Auditory signals. In a Survay Report on Human Factors in Undersea Warfare, Washington, D.C.: National Research Council, 201--217.

[23]

Gaver, W. (1986) Auditory icons: Using sound in computer interfaces. Hum.-Comp. Interact., 2, 167--177.

Digital Library

[24]

Genuit, K. (1986) A description of the human outer ear transfer function by elements of communication theory. Proc. 12th ICA (Toronto), Paper B6-8.

[25]

Loomis, J. M., Hebert, C., & Cicinelli, J. G. (1990) Active localization of virtual sound sources. Submitted to J. Acoust. Soc. Am.

[26]

O'Leary, A. & Rhodes, G. (1984) Cross-modal effects on visual and auditory object perception. Perc. & Psychophys., 35, 565--569.

[27]

Patterson, R. R. (1982) Guidelines for Auditory Warning Systems on Civil Aircraft. Civil Aviation Authority Paper No. 82017, London.

[28]

Smith, S., Bergeron, R. D., & Grinstein, G. G. (1990) Stereophonic and surface sound generation for exploratory data analysis. Proceedings of CHI'90, ACM Conference on Human Factors in Computing Systems, 125--132.

Digital Library

[29]

Sorkin, R. D., Wightman, F. L., Kistler, D. J., & Elvers, G. C. (1989) An exploratory study of the use of movement-correlated cues in an auditory heads-up display. Hum. Fact, 31, 161--166.

[30]

Sutherland, I. E. (1968) Head-mounted three-dimensional display. Proc. Fall Joint Comp. Conf., 33, 757--764.

[31]

Warren, D. H., Welch, R., & McCarthy, T. J. (1981) The role of visual-auditory "compellingness" in the ventriloquism effect: Implications for transitivity among the spatial senses. Perc. & Psychophys., 30, 557--564.

[32]

Wenzel, E. M., Wightman, F. L., & Foster, S. H. (1988a) Development of a three-dimensional auditory display system. SIGCHI Bulletin, 20, 52--57.

Digital Library

[33]

Wenzel, E. M., Wightman, F. L., & Foster, S. H. (1988b) A virtual display system for conveying three-dimensional acoustic information. Proc. Hum. Fac. Soc., 32, 86--90.

[34]

Wenzel, E. M., Wightman, F. L., Kistler, D. J., & Foster, S. H. (1988c) Acoustic origins of individual differences in sound localization behavior. J. Acoust. Soc. Amer., 84, S79.

[35]

Wightman, F. L. & Kistler, D. J. (1989a) Headphone simulation of free-field listening I: stimulus synthesis. J. Acoust. Soc. Amer., 85, 858--867.

[36]

Wightman, F. L. & Kistler, D. J. (1989b) Headphone simulation of free-field listening II: psychophysical validation. J. Acoust. Soc. Amer., 85, 868--878

Cited By

Hirota KWatanabe YIkei Y(2007)Menu selection using auditory interfaceProceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments10.5555/1769590.1769599(70-75)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1769590.1769599
Kaper HWiebel ETipei S(1999)Data Sonification and Sound VisualizationComputing in Science and Engineering10.1109/5992.7748401:4(48-58)Online publication date: 1-Jul-1999
https://dl.acm.org/doi/10.1109/5992.774840
Volpe CGlinert EMoorhead RJohnston NRhyne THansen C(1997)Auralization of streamline vorticity in computational fluid dynamics dataProceedings of the 8th conference on Visualization '9710.5555/266989.267019(51-57)Online publication date: 1-Oct-1997
https://dl.acm.org/doi/10.5555/266989.267019
Show More Cited By

A system for three-dimensional acoustic "visualization" in a virtual environment workstation
1. Applied computing
  1. Arts and humanities
2. Human-centered computing

Recommendations

A Method for Virtual Acoustic Auralisation in VR
AM '18: Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion

In today's industry, the use of prediction software in architectural acoustics is universal. Programs such as Odeon, CATT and CadnaA have become an integral part of the design process. These programs combine general acoustic theory with CAD modelling ...
Software platform for real-time room acoustic visualization
VRST '08: Proceedings of the 2008 ACM symposium on Virtual reality software and technology

This paper presents a novel platform for interactive virtual room acoustics simulation and visualization. The platform is based on two autonomous modules: EVERTims for acoustic simulation and Audio2graphical for graphical rendering and interaction ...
Real-time digital of virtual acoustic environments
I3D '90: Proceedings of the 1990 symposium on Interactive 3D graphics

As with most research in information displays, virtual displays have generally emphasized visual information. Many investigators, however, have pointed out the importance of the auditory system as an information channel. We believe that a three-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VIS '90: Proceedings of the 1st conference on Visualization '90

October 1990

501 pages

ISBN:0818620838

Conference Chairs:
Bruce Eric Brown
Oracle Corporation, Belmont, CA
,
Gary Laguna
Lawerence Livermore National Laboratory, Livermore, CA
,
Editor:
Arie Kaufman
State University of New York, Stony Brook, New York
,
Program Chairs:
Larry Rosenblum
Naval Research Laboratory, Washington, DC
,
Gregory M. Nielson
Arizona State University, Tempe, AZ

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
IEEE Computer Society Technical Committee on Computer Graphics

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 23 October 1990

Check for updates

Qualifiers

Article

Conference

VIS90

Sponsor:

SIGGRAPH

VIS90: Visualization '90

October 23 - 26, 1990

California, San Francisco

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
450
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)3

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hirota KWatanabe YIkei Y(2007)Menu selection using auditory interfaceProceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments10.5555/1769590.1769599(70-75)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1769590.1769599
Kaper HWiebel ETipei S(1999)Data Sonification and Sound VisualizationComputing in Science and Engineering10.1109/5992.7748401:4(48-58)Online publication date: 1-Jul-1999
https://dl.acm.org/doi/10.1109/5992.774840
Volpe CGlinert EMoorhead RJohnston NRhyne THansen C(1997)Auralization of streamline vorticity in computational fluid dynamics dataProceedings of the 8th conference on Visualization '9710.5555/266989.267019(51-57)Online publication date: 1-Oct-1997
https://dl.acm.org/doi/10.5555/266989.267019
Rossiter DNg W(1996)A system for the complementary visualization of 3D volume images using 2D and 3D binaurally processed sonification representationsProceedings of the 7th conference on Visualization '9610.5555/244979.245632(351-354)Online publication date: 27-Oct-1996
https://dl.acm.org/doi/10.5555/244979.245632
Tominaga HYonekura TGreen MFairchild KZyda M(1996)Three dimensional input function using nonverbal voice interfaceProceedings of the ACM Symposium on Virtual Reality Software and Technology10.1145/3304181.3304219(185-190)Online publication date: 1-Jul-1996
https://dl.acm.org/doi/10.1145/3304181.3304219

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten