Abstract
This paper presents novel interaction modes for Model-Based Sonification (MBS) via interactive surfaces. We first discuss possible interactions for MBS on a multi-touch surface. This is followed by a description of the Data Sonogram Sonification and the Growing Neural Gas Sonification Model and their implementation for the multi-touch interface. Modifications from the original sonification models such as the limited space scans are described and discussed with sonification examples. Videos showing interaction examples are provided. Furthermore, the presented system provides a basis for the implementation of known and novel sonification models. We discuss the available interaction modes with multi-touch surfaces and how these interactions can be profitably used to control spatial and non-spatial sonification models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bovermann, T., Hermann, T., Ritter, H.: A tangible environment for ambient data representation. In: First International Workshop on Haptic and Audio Interaction Design, August 2006, vol. 2, pp. 26–30 (2006)
Buxton, B.: Multi-touch systems that i have known and loved (2009), http://www.billbuxton.com/multitouchOverview.html
Dourish, P.: Where the action is: The foundation of embodied interaction. MIT Press, Cambridge (2001)
Forina, M.: Arvus - an extendible package for data exploration, Classification and Correlation, http://www.radwin.org/michael/projects/learning/about-wine.html
Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST 2005: Proceedings of the 18th annual ACM symposium on User interface software and technology, pp. 115–118. ACM Press, New York (2005)
Fisher, R.A.: UCI Repository of Maschine Learning Databases – Iris Data Set (1999)
Fry, B., Reas, C.: Processing programminig environment (2001), http://processing.org/
Heidegger, M.: Sein und Zeit. Niemeyer, Halle a. d. S. (1927)
Hermann, T.: Taxonomy and definitions for sonification and auditory display. In: Katz, B. (ed.) Proc. Int. Conf. Auditory Display (ICAD 2008), France (2008)
Hermann, T., Ritter, H.: Listen to your data: Model-based sonification for data analysis. In: Lasker, G.E. (ed.) Advances in intelligent computing and multimedia systems. Int. Inst. for Advanced Studies in System research and cybernetics, Baden-Baden, Germany, pp. 189–194 (1999)
Hermann, T.: Sonification for exploratory data analysis. PhD thesis, Bielefeld University (February 2002), http://www.techfak.uni-bielefeld.de/ags/ni/publications/media/Hermann2002-SFE.pdf
Hermann, T., Krause, J., Ritter, H.: Real-time control of sonification models with an audio-haptic interface. In: Nakatsu, R., Kawahara, H. (eds.) Proc. Int. Conf. Auditory Display (ICAD 2002), Kyoto, Japan, pp. 82–86 (2002)
Hermann, T., Milczynski, M., Ritter, H.: A malleable device with applications to sonification-based data exploration. In: Stockman, T. (ed.) Proc. Int. Conf. Auditory Display (ICAD 2006), pp. 69–76. University of London, London, UK (2006)
Hunt, A., Hermann, T., Pauletto, S.: Interacting with sonification systems: Closing the loop. In: Banissi, E., Börner, K. (eds.) IV 2004: Proceedings of the Information Visualisation, Eighth International Conference on (IV 2004), Washington, DC, USA, pp. 879–884. IEEE Computer Society, Los Alamitos (2004)
Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Quarterly of Applied Mathematics, 164–168 (1944)
Marquardt, D.: An algorithm for least-qquares estimation of nonlinear parameters. SIAM Journal on Applied Mathematics 11, 431–441 (1963)
Kramer, G. (ed.): Auditory display: sonification, audification, and auditory interfaces. Addison-Wesley, Reading (1994)
Kramer, G., Walker, B., Bonebright, T., Cook, P., Flower, J., Miner, N., Neuhoff, J., Bargar, R., Barrass, S., Berger, J., Evreinov, G., Fitch, W.T., Grohn, M., Handel, S., Kaper, H., Levkowitz, H., Lodha, S., Shinn-Cunningham, B., Simoni, M., Tipei, S.: Sonification report: Status of the field and research agenda (1997)
McCartney, J.: SuperCollider hub. (July 2004) http://supercollider.sourceforge.net/
Hermann, T., Ritter, H.: Neural gas sonification: Growing adaptive interfaces for interacting with data. In: Banissi, E., Börner, K. (eds.) IV 2004: Proceedings of the Information Visualisation, Eighth International Conference on (IV 2004), Washington, DC, USA, pp. 871–878. IEEE Computer Society, Los Alamitos (2004)
Fritzke, B.: A growing neural gas network learns topologies. In: Tesauro, G., Touretzky, D., Leen, T. (eds.) Advances in Neural Information Processing Systems, vol. 7, pp. 625–632. MIT Press, Cambridge (1995)
Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E.: TUIO: A protocol for table based tangible user interfaces. In: GW (2005)
Hansen, T., Hourcade, J.P., Virbel, M., Patali, S., Serra, T.: PyMT: A post-WIMP multi-touch user interface toolkit. In: Proceedings of the International Conference on Interactive Tabletops and Surfaces (ITS 2009), Banff, Canada (2009)
Zito, T., Wilbert, N., Wiskott, L., Berkes, P.: Modular toolkit for data processing (MDP): A python data processing frame work. Frontiers in Neuroinformics (2008), http://mdp-toolkit.sourceforge.net
Stinson, P.K.: SCOSC: SuperCollider OSC interface for python (October 2009), http://trac2.assembla.com/pkaudio/wiki/SuperCollider
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tünnermann, R., Kolbe, L., Bovermann, T., Hermann, T. (2010). Surface Interactions for Interactive Sonification. In: Ystad, S., Aramaki, M., Kronland-Martinet, R., Jensen, K. (eds) Auditory Display. CMMR ICAD 2009 2009. Lecture Notes in Computer Science, vol 5954. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12439-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-12439-6_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12438-9
Online ISBN: 978-3-642-12439-6
eBook Packages: Computer ScienceComputer Science (R0)