Abstract
Try this simple experiment one day: wear a couple of earplugs and try to conduct your regular everyday activities, for a couple of hours. How would you describe your feelings in that deafened state? You would probably feel a sense of isolation, from the world and from other people. So, absence of sound induces perceived isolation which may turn into felt oppression in some environments, such as an anechoic chamber. One may think that if silence induces isolation, sound induces presence, but unfortunately this is not the case. We know sensitive souls that have difficulties falling asleep because they live in noisy neighborhoods. One solution that may work in this case is to play loud noise through the hi-fi loudspeakers to mask the noise from the environment. Again, isolation (e.g. from street noise) is the result, but the means to achieve it is loud noise, the opposite of silence. And how would you describe all those people that experience modern city life being shielded by earphones that play music from their walkmans or mp3 players? They look rather isolated from each other, don’t they? In some circumstances there might be a need of concentration (e.g., in studying), or people want to tune their mood (Brodsky 2002). In all those cases sounds may be the appropriate mean, as it was well known even to Thomas Edison, who used to accompany commercialization of his phonograph with a “mood change chart” aimed at surveying users reactions to that new technology. So, it seems that sounds have the potential to modulate human engagement (from isolation to arousal) in everyday environments, and this is an aspect that should be seriously considered when designing the artefacts that will populate the environments of the future, likely to be pervaded by Ambient Intelligence (AmI) in its various facets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Avanzini, F., Rocchesso, D.: Controlling material properties in physical models of sounding objects. In: Schloss, A., Dannenberg, R., Driessen, P. (eds.) Proceedings International Computer Music Conference. ICMA, San Francisco, pp. 91–94. Instituto Cubano de la Musica, La Habana (2001)
Avanzini, F., Rath, M., Rocchesso, D., Ottavini, L.: Low-level models: resonators, interactions, and surface textures. In: Rocchesso, D., Fontana, F. (eds.) The Sounding Object, pp. 137–171. Mondo Estremo, Florence (2003)
Avanzini, F., Serafin, S., Rocchesso, D.: Friction sounds for sensory substitution. In: Barrass, S., Vickers, P. (eds.) Proceedings International Conference Auditory Display. ICAD, Sydney (July 2004)
Accot, J., Zhai, S.: Performance evaluation of input devices in trajectory-based tasks: An application of steering law. In: Proceedings of the SIGCHI conference on Human factors in computing systems. CHI ’99, Pittsburgh, PA, pp. 466–472. ACM Press, New York (1999)
Barrass, S.: Sonification design patterns. In: Brazil, E., Shinn-Cunningham, B. (eds.) Proceedings International Conference Auditory Display, Boston, MA, pp. 170–175 (2003)
Bresin, R., Dahl, S.: Experiments on gestures: walking, running, and hitting. In: Rocchesso, D., Fontana, F. (eds.) The Sounding Object, pp. 111–136. Mondo Estremo, Florence (2003)
Bresin, R., Friberg, A.: Emotional coloring of computer-controlled music performances. Computer Music Journal 24(4), 44–63 (2000)
Bresin, R., Friberg, A.: Expressive musical icons. In: Hiipakka, J., Zacharov, N., Takala, T. (eds.) Proceedings International Conference Auditory Display, Espoo, Finland, pp. 141–143 (2001)
Bregman, A.S.: Auditory scene analysis: the perceptual organization of sound. MIT Press, Cambridge (1990)
Brodsky, W.: The effects of music tempo on simulated driving performance and vehicular control. Transportation Research, Part F. Traffic Psychology and Behavior 4, 219–241 (2002)
Dahl, S.: Playing the accent - comparing striking velocity and timing in an ostinato rhythm performed by four drummers. Acta. Acustica united with Acustica 90(4), 762–776 (2004)
Dourish, P.: Where the action is: the foundations of embodied interaction. MIT Press, Cambridge (2001)
Dent, M.L., Tollin, D.J., Yin, T.C.T.: Cats exhibit the Franssen effect illusion. Journal of the Acoustical Society of America 116(6), 3070–3074 (2004)
Effenberg, A.: Using sonification to enhance perception and reproduction accuracy of human movement patterns. In: Hunt, A., Hermann, T. (eds.) Proceedings of International Workshop on Interactive Sonification (Human Interaction with Auditory Displays), CD-ROM. Bielefeld University, Germany (2004)
Eriksson, S., Fjellström, O., Grahn, J., Lundholm, P., Nilbrink, F., Shalit, T.: Gesture recorder demonstration (Paper presented at the Gesture Workshop 2003. Genoa, Italy, http://www.dh.umu.se/fprw/files/OSKAR/GestRecDemo.pdf ) (2003)
Fallman, D.: Wear, point, and tilt: Designing support for mobile service and maintenance in industrial settings. In: Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, London, UK, pp. 239–302. ACM Press, New York (2002)
Fernström, M., Brazil, E., Bannon, L.: Human-computer interaction design and interactive sonification an interface for fingers and ears. IEEE Multimedia 12(2) (2005)
Ferris, K., Bannon, L., Ciolfi, L., Gallagher, P., Hall, T., Lennon, M.: Shaping experiences in the Hunt museum: a design case study. In: Proceedings of the 2004 conference on Designing interactive systems: processes, practices, methods, and techniques, Cambridge, MA, pp. 205–214. ACM Press, New York (2004)
Fishkin, K.P., Gujar, A., Harrison, B.L., Moran, T.P., Want, R.: Embodied user interfaces for really direct manipulation. Communications of the ACM 43(9), 75–80 (2000)
Franssen, N.V.: Stereophony, (English Trans. 1964). Philips Tech. Library, Eindhoven, The Netherlands (1963)
Fajen, B.R., Warren, W.H.: Behavioral dynamics of steering, obstacle avoidance, and route selection. Journal of Experimental Psychology: Human. Perception and Performance 29(2), 343–362 (2003)
Gaver, W.W.: How do we hear in the world? Explorations in ecological acoustics. Ecological Psychology 5(4), 285–313 (1993a)
Gaver, W.W.: What in the world do we hear? An ecological approach to auditory event perception. Ecological Psychology 5(1), 1–29 (1993b)
Gaver, W.W.: Using and creating auditory icons. In: Kremer, G. (ed.) Auditory Display: Sonification, Audification, and Auditory Interfaces, pp. 417–446. Addison-Wesley, Reading (1994)
Gutwin, C., Greenberg, S.: A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work. 11(3), 411–446 (2002)
Gibson, J.J.: The Ecological Approach to Visual Perception. Lawrence Erlbaum Associates, Cambridge (1979)
Giordano, B.: Material categorization and hardness scaling in real and synthetic impact sounds. In: Rocchesso, D., Fontana, F. (eds.) The Sounding Object, pp. 73–93. Mondo Estremo, Florence (2003)
Giordano, B., Bresin, R.: Walking and playing: What’s the origin of emotional expressiveness in music? In: Baroni, M., Addessi, A.R., Caterina, R., Costa, M. (eds.) 9th International Conference on Music Perception and Cognition, ICMPC9, Bologna, Italy, p. 149 (Aug. 2006)
Gye, L.: Future longing. Real Time 58, 47–54 (Jan. 2004), http://www.realtimearts.net
Hansen, K.F., Bresin, R.: Analysis of a genuine scratch performance. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 519–528. Springer, Heidelberg (2004)
Hermann, T., Höner, O., Ritter, H.: AcouMotion - An Interactive Sonification System for Acoustic Motion Control. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 18–20. Springer, Heidelberg (2006)
Hunt, A., Hermann, T.: Special issue on Interactive Sonification. IEEE Multimedia 12(2) (2005)
Juslin, P.N., Laukka, P.: Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin 129(5), 770–814 (2003)
Johansson, G.: Visual perception of biological motion and a model for its analysis. Perception and Psychophysics 14, 201–211 (1973)
Kaltenbrunner, M., Geiger, G., Jorda, S.: Dynamic patches for live musical performance. In: Proceedings of the 4th Conference on New Interfaces for Musical Expression. NIME 04, Hamamatsu, Japan, pp. 19–22 (2004)
Klatzky RL, Lederman SJ (2002) Touch. In: Healy AF, Proctor RW (eds) Experimental Psychology. Wiley, New York, pp 147-176
Krumhansl, C.L.: An exploratory study of musical emotions and psychophysiology. Canadian Journal of Experimental Psychology 51(4), 336–352 (1997)
Kubovy, M., van Valkenburg, D.: Auditory and visual objects. Cognition 80, 97–126 (2001)
Lindström, E., Camurri, A., Friberg, A., Volpe, G., Rinman, M.-L.: Affect, attitude and evaluation of multi-sensory performances. Journal of New. Music. Research 34(1), 69–86 (2005)
Lécuyer, A., Coquillart, S., Kheddar, A., Richard, P., Coiffet, P.: Pseudo-haptic feedback: Can isometric input devices simulate force feedback? In: VR ’00 Proceedings of the IEEE Virtual Reality 2000 Conference, New Brunswick, US, pp. 83–90. IEEE Computer Society, Washington (2000)
Lindblom, B.: Explaining phonetic variation: a sketch of the H&H theory. In: Hardcastle, W.J., Marchal, A. (eds.) Speech production and speech modeling, pp. 403–439. Kluwer, Dordrecht (1990)
Li, X., Logan, R.J., Pastore, R.E.: Perception of acoustic source characteristics: Walking sounds. Journal of the Acoustical Society of America 90(6), 3036–3049 (1991)
Martin, S.: Theremin, an electronic odissey (Documentary on DVD). MGM (2001)
Michotte, A.: The perception of causality. (Orig., La perception de la causalité, 1946). Basic Books, New York (1963)
Massimino, M.J., Sheridan, T.B.: Sensory substitution for force feedback in teleoperation. Presence 2(4), 344–352 (1993)
van Mensvoort, K.: What you see is what you feel. In: DIS ’02: Proceedings of the conference on Designing interactive systems, London, UK, pp. 345–348. ACM Press, New York (2002)
Müller-Tomfelde, C., Streitz, N.A., Steinmetz, R.: Sounds@work - auditory displays for interaction in cooperative and hybrid environments. In: Stephanidis, C., Jacko, J. (eds.) Human-Computer Interaction: Theory and Practice (Part II), pp. 751–755. Lawrence Erlbaum Publishers, Mahwah (2003)
Ottavini, L.: Representation of Multi-Dimensional Data through Auditory Display. Ph.D. thesis, Università di Verona, Italy (2004)
Prante, T., Streitz, N.A., Tandler, P.: Roomware: Computers disappear and interaction evolves. IEEE Computer 37(12), 47–54 (2004)
Rasch, R.A.: Timing and synchronization in ensemble performance. In: Sloboda, J. (ed.) Generative processes in music: The psychology of performance, improvization, and composition, pp. 70–90. Oxford University Press, Oxford (1988)
Rath, M., Rocchesso, D.: Continuous sonic feedback from a rolling ball. IEEE Multimedia 12(2) (2005)
Schafer, R.M.: The Tuning of the World. McClelland and Stewart Limited, Toronto (1977)
Schaeffer, P.: Traité des Objets Musicaux. Éditions du Seuil, Paris, France (1966)
Schelleng, J.C.: The bowed string and the player. Journal of the Acoustical Society of America 53(1), 26–41 (1973)
Scherer, K.R., Banse, R., Wallbott, H.G.: Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross.-Cultural Psychology 32(1), 76–92 (2001)
Scheuren, J., Martner, O., Zerbs, C.: Practical aspects of product sound quality design. In: Proceedings Les Journés du Design Sonore, Paris, France (2004), http://www.design-sonore.org
Thomas, B.H., Calder, P.: Applying Cartoon Animation Techniques to Graphical User Interfaces. ACM Trans. on Computer-Human Interaction 8(3), 198–222 (2001)
Vicario, G.B.: On experimental phenomenology. In: Masin, S.C. (ed.) Foundations of Perceptual Theory, pp. 197–219. Elsevier Science Publishers, Amsterdam (1993)
Wilkie, R.M., Wann, J.P.: Controlling steering and judging heading: retinal flow, visual direction and extra-retinal information. Journal of Experimental Psychology: Human. Perception and Performance 29(2), 363–378 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this chapter
Cite this chapter
Rocchesso, D., Bresin, R. (2007). Emerging Sounds for Disappearing Computers. In: Streitz, N., Kameas, A., Mavrommati, I. (eds) The Disappearing Computer. Lecture Notes in Computer Science, vol 4500. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72727-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-72727-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72725-5
Online ISBN: 978-3-540-72727-9
eBook Packages: Computer ScienceComputer Science (R0)