Abstract
Sound and vibration perception are always coupled in live music experience. Just think of a rock concert or hearing (and feeling) a church organ sitting on a wooden pew. Even in classical concerts kettledrum and double bass are sensed not only with our ears. The air-borne sound causes seat vibrations or excites the skin surface directly. For some instruments (e.g. an organ) structure-borne sound is transmitted directly from the instrument to the listener.
If concert recordings are played back with multimedia hi-fi systems at home, these vibratory information is missing in the majority of cases. This is due to low reproduction levels or to the limited frequency range of conventional loudspeakers. The audio signal on todays DVDs contains an additional channel for low frequency effects (LFE), which is intended for reproduction using a subwoofer. The generation of tactile components is still very restricted. An enhancement of such a systems might be possible using an electrodynamical shaker which generates whole body vibration (WBV) for a seated person.
This paper describes a system implementing this approach. The generation of a vibrotactile signal from the existing audio channels is analyzed. Different parameters during this process (amplitude of the vibration, frequency range) are examined in relation to their perceptual consequences using psychophysical experiments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Jekosch: Voice and speech quality perception - Assessment and Evaluation. Springer, Berlin (2005)
Altinsoy, Blauert, Treier: Intermodal effects of non-simultaneous stimulus presentation. In: Proceedings of the 7th International Congress on Acoustics, Rome, Italy (2001)
Daub, Altinsoy: Audiotactile simultaneity of musical-produced whole-body vibrations. In: Proc. of the Joint Congress CFA/DAGA, Strasbourg, France (2004)
Martens, Woszczyk: Perceived Synchrony in a Bimodal Display: Optimal Delay for Coordinated Auditory and Haptic Reproduction. In: ICAD, Sydney, Australia (2004)
Walker, Martens, Kim: Perception of Simultaneity and Detection of Asynchrony Between Audio and Structural Vibration in Multimodal Music Reproduction. In: AES 120th Convention, Paris, France (2006)
Altinsoy: Auditory-Tactile Interaction in Virtual Environments. Shaker Verlag, Aachen (2006)
Walker, K., Martens, W.L.: Perception of audio-generated and custom motion programs in multimedia display of action-oriented DVD films. In: McGookin, D., Brewster, S. (eds.) HAID 2006. LNCS, vol. 4129, pp. 1–11. Springer, Heidelberg (2006)
Merchel, Altinsoy: 5.1 oder 5.2 Surround - Ist Surround taktil erweiterbar? In: DAGA, Dresden, Germany (2008)
ITU-R BS.775-1: Multichannel stereophonic sound system with and without accompanying picture (1992)
Altinsoy, Merchel: BRTF - Body Related Transfer Functions for Whole-Body Vibration Reproduction Systems. In: DAGA, Rotterdam, Netherlands (2009)
ITU-T P.800: Methods for objective and subjective assessment of quality (1996)
Rohrmann: Empirische Studien zur Entwicklung von Antwortskalen für die sozialwissenschaftliche Forschung. Zeitschrift für Sozialpsychologie 9, 222–245 (1978)
Bellman, Remmers, Mellert: Basic Experiments on the Perception of Vertical Whole-Body Vibrations. VDI-Tagung Humanschwingungen, Darmstadt (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Merchel, S., Altinsoy, M.E. (2009). Vibratory and Acoustical Factors in Multimodal Reproduction of Concert DVDs. In: Altinsoy, M.E., Jekosch, U., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2009. Lecture Notes in Computer Science, vol 5763. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04076-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-04076-4_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04075-7
Online ISBN: 978-3-642-04076-4
eBook Packages: Computer ScienceComputer Science (R0)