research-article

Creating Interactive Virtual Auditory Environments

Authors:

Riitta Väänänen,

Jyri Huopaniemi,

Tapio TakalaAuthors Info & Claims

IEEE Computer Graphics and Applications, Volume 22, Issue 4

Pages 49 - 57

https://doi.org/10.1109/MCG.2002.1016698

Published: 01 July 2002 Publication History

Abstract

Sound rendering is the analogue of graphics rendering to create virtual auditory environments. In graphics, images are created by calculating the distribution of light within a modeled environment. Illumination methods such as raytracing and radiosity are based on the physics of light propagation and reflection. Similarly, sound rendering is based on physical laws of sound propagation and reflection. In this article we aim to clarify real-time sound rendering techniques by comparing them to rendering of visual images. We also describe how sound rendering can be performed, based on the knowledge of sound source(s) and listener locations, radiation characteristics of sound sources, geometry of the 3D model, and material absorption data, in other words, the congruent data used for graphics rendering. In this context the term auralization, making audible, corresponds to visualization. Applications of sound rendering vary from film effects, computer games and other multimedia content to enhancing presence experience in virtual reality.

References

[1]

T. Takala and J. Hahn, "Sound Rendering," Computer Graphics (Proc. Siggraph 92), vol. 26, no. 2, ACM Press, New York, 1992, pp. 211-220.

Digital Library

[2]

L. Savioja, et al., "Creating Interactive Virtual Acoustic Environments," J. Audio Eng. Soc., vol. 47, no. 9, Sept. 1999, pp. 675-705.

[3]

M. Kleiner B.-I. Dalenbäck and P. Svensson, "Auralization: An Overview," J. Audio Eng. Soc., vol. 41, no. 11, Nov. 1993, pp. 861-875.

[4]

J.-M. Jot, "Real-Time Spatial Processing of Sounds for Music, Multimedia and Interactive Human-Computer Interfaces," Multimedia Systems, vol. 7, no. 1, Jan./Feb. 1999, pp. 55-69.

Digital Library

[5]

A. Appel, "Some Techniques for Shading Machine Renderings of Solids," AFIPS 1968 Spring Joint Computer Conf., Thompson Books, Washington, D.C., vol. 32, 1968, pp. 37-45.

[6]

A. Krokstad S. Strom and S. Sorsdal, "Calculating the Acoustical Room Response by the Use of a Ray Tracing Technique," J. Sound and Vibration, vol. 8, no. 1, 1968, pp. 118-125.

[7]

J.B. Allen and D.A. Berkley, "Image Method for Efficiently Simulating Small-Room Acoustics," J. Acoustical Soc. of America, vol. 65, no. 4, Apr. 1979, pp. 943-950.

[8]

V. Pulkki, "Virtual Sound Source Positioning Using Vector Base Amplitude Panning," J. Audio Eng. Soc., vol. 45, no. 6, Jun. 1997, pp. 456-466.

[9]

M. Gerzon, "Periphony: With-Height Sound Reproduction," J. Audio Eng. Soc., vol. 21, no. 1-2, Jan./Feb. 1973, pp. 2-10.

[10]

J. Blauert, Spatial Hearing: The Psychophysics of Human Sound Localization, 2nd ed., MIT Press, Cambridge, Mass., 1997.

[11]

N. Tsingos, et al., "Modeling Acoustics in Virtual Environments Using the Uniform Theory of Diffraction," Computer Graphics (Proc. Siggraph 2001), ACM Press, New York, 2001, pp. 545-552.

Digital Library

[12]

U.P. Svensson R.I. Fred and J. Vanderkooy, "Analytic Secondary Source Model of Edge Diffraction Impulse Responses," J. Acoustical Soc. of America, vol. 106, no. 5, Nov. 1999, pp. 2331-2344.

[13]

L. Savioja and V. Välimäki, "Interpolated 3-D Digital Waveguide Mesh with Frequency Warping," Proc. 2001 IEEE Int'l Conf. Acoustics, Speech, and Signal Processing (ICASSP 01), IEEE Press, Piscataway, N.J., vol. 5, 2001, pp. 3345-3348.

Digital Library

[14]

T. Lokki, et al., "Real-time Audiovisual Rendering and Contemporary Audiovisual Art," Organised Sound, vol. 3, no. 3, 1998, pp. 219-233.

Digital Library

[15]

T. Takala, et al., "Marienkirche - A Visual and Aural Demonstration Film," Electronic Art and Animation Catalog (Proc. Siggraph 98), ACM Press, New York, 1998, p. 149.

Digital Library

[16]

ISO/IEC 14496-1:1999, Coding of Audiovisual Objects, Int'l Organization for Standardization, Geneva, Dec. 1999.

[17]

E.D. Scheirer R. Väänänen and J. Huopaniemi, "AudioBIFS: Describing Audio Scenes with the MPEG-4 Multimedia Standard," IEEE Trans. Multimedia, vol. 1, no. 3, Sept. 1999, pp. 237-250.

Digital Library

Cited By

Speicher MGröber LHaluska JHegemann LHoffmann IGehring SKrüger AOjala TKostakos VMüller JMemarovic N(2016)The audience in the role of the conductorProceedings of the 5th ACM International Symposium on Pervasive Displays10.1145/2914920.2940335(235-236)Online publication date: 20-Jun-2016
https://dl.acm.org/doi/10.1145/2914920.2940335
Bai HRichard GDaudet L(2015)Late reverberation synthesisIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2015.247811623:12(2260-2271)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1109/TASLP.2015.2478116
Kimura KHoshuyama ONarumi TTanikawa THirose MRomão TCorreia NInami MDias EChambel TKato HPrada RTerada T(2011)Sound-power visualization system for real-world interaction based on ultrasonic power transmissionProceedings of the 8th International Conference on Advances in Computer Entertainment Technology10.1145/2071423.2071499(1-8)Online publication date: 8-Nov-2011
https://dl.acm.org/doi/10.1145/2071423.2071499
Show More Cited By

Index Terms

Creating Interactive Virtual Auditory Environments

Recommendations

The sense of presence within auditory virtual environments

Two studies were performed to investigate the sense of presence within stereoscopic virtual environments as a function of the addition or absence of auditory cues. The first study examined the presence or absence of spatialized sound, while the second ...
Interactive Virtual Relighting of Real Scenes

Computer augmented reality (CAR) is a rapidly emerging field which enables users to mix real and virtual worlds. Our goal is to provide interactive tools to perform common illumination, i.e., light interactions between real and virtual objects, ...
Dynamic radiosity shadows for interactive virtual environments

Current state-of-the-art virtual reality (VR) systems provide realistic illumination only for static scenes, since shadows are calculated off-line and cannot be updated at interactive rates. This paper presents a new method for incorporating realistic ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Computer Graphics and Applications

IEEE Computer Graphics and Applications Volume 22, Issue 4

July 2002

98 pages

ISSN:0272-1716

Issue’s Table of Contents

Copyright © Copyright © 2002 IEEE. All Rights Reserved.

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 July 2002

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Speicher MGröber LHaluska JHegemann LHoffmann IGehring SKrüger AOjala TKostakos VMüller JMemarovic N(2016)The audience in the role of the conductorProceedings of the 5th ACM International Symposium on Pervasive Displays10.1145/2914920.2940335(235-236)Online publication date: 20-Jun-2016
https://dl.acm.org/doi/10.1145/2914920.2940335
Bai HRichard GDaudet L(2015)Late reverberation synthesisIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2015.247811623:12(2260-2271)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1109/TASLP.2015.2478116
Kimura KHoshuyama ONarumi TTanikawa THirose MRomão TCorreia NInami MDias EChambel TKato HPrada RTerada T(2011)Sound-power visualization system for real-world interaction based on ultrasonic power transmissionProceedings of the 8th International Conference on Advances in Computer Entertainment Technology10.1145/2071423.2071499(1-8)Online publication date: 8-Nov-2011
https://dl.acm.org/doi/10.1145/2071423.2071499
Manocha DCalamia PLin MManocha DSavioja LTsingos N(2009)Interactive sound renderingACM SIGGRAPH 2009 Courses10.1145/1667239.1667254(1-338)Online publication date: 3-Aug-2009
https://dl.acm.org/doi/10.1145/1667239.1667254
Grelaud DBonneel NWimmer MAsselot MDrettakis GHaines EMcGuire MAliaga DOliveira M(2009)Efficient and practical audio-visual rendering for games using crossmodal perceptionProceedings of the 2009 symposium on Interactive 3D graphics and games10.1145/1507149.1507178(177-182)Online publication date: 27-Feb-2009
https://dl.acm.org/doi/10.1145/1507149.1507178
Lauterbach CChandak AManocha D(2007)Interactive sound rendering in complex and dynamic scenes using frustum tracingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2007.7056713:6(1672-1679)Online publication date: 1-Nov-2007
https://dl.acm.org/doi/10.1109/TVCG.2007.70567
James DBarbič JPai DFinnegan JDorsey J(2006)Precomputed acoustic transferACM SIGGRAPH 2006 Papers10.1145/1179352.1141983(987-995)Online publication date: 30-Jul-2006
https://dl.acm.org/doi/10.1145/1179352.1141983
James DBarbič JPai D(2006)Precomputed acoustic transferACM Transactions on Graphics10.1145/1141911.114198325:3(987-995)Online publication date: 1-Jul-2006
https://dl.acm.org/doi/10.1145/1141911.1141983
Kanada YFeng WMayer-Patel K(2005)Multi-context voice communication in a SIP/SIMPLE-based shared virtual sound room with early reflectionsProceedings of the international workshop on Network and operating systems support for digital audio and video10.1145/1065983.1065996(45-50)Online publication date: 13-Jun-2005
https://dl.acm.org/doi/10.1145/1065983.1065996
Mancini MBresin RPelachaud C(2005)From acoustic cues to an expressive agentProceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation10.1007/11678816_31(280-291)Online publication date: 18-May-2005
https://dl.acm.org/doi/10.1007/11678816_31
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents