Abstract
This paper reports on “TOTEM” (TOuch ThE Music), a project aiming at finding inclusive solutions to foster the d/Deaf’s participation to live music concerts. In particular, the development of a portable device that transforms live music signals into symbolic vibrations is described. A co-construction, user-centered approach supplied a list of specifications adapted to the d/Deaf and hearing users’ needs. The specifications were iteratively implemented and discussed over the course of the project, alternating between developments in the lab and in situ tests during live music concerts.
This project was funded by the European Regional Development Funds through the Interreg FWVL program. The authors thank the users who tested the devices, the Aéronef’s crew and bands, Mur du Son, Gilles Hugo, and students who worked on earlier versions of the devices.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
We use the uppercase “Deaf” to refer to deaf people identifying themselves as belonging to the Deaf culture.
- 2.
E.g. Bassme: bassme.com, Buttkicker: thebuttkicker.com, Subpac: subpac.com, Basslet: lofelt.com, Woojer: woojer.com .
- 3.
“[T]he audience etiquette implies that concert-goers stand up and do not necessarily stay at fixed locations during the concert. For this type of settings, haptic wearables may be more suitable than seat-based solutions.” [20].
- 4.
Literally “Sound Barrier”, this musical band has only Deaf members (sign language singing, bass guitar, percussions) . Website: https://mur-du-son.fr/.
- 5.
Available online at https://aeronef.fr/totem/, in French.
- 6.
First specifications come with a “i” suffix; specifications from iterative user feedback come with a “u” suffix.
- 7.
Users stated that communication in sign language was not hindered by the manipulation of the actuators.
- 8.
The code is available at https://github.com/parthurp/TOTEM.
References
Best, K.: Musical belonging in a hearing-centric society: adapting and contesting dominant cultural norms through deaf hip hop. J. Am. Sign Lang. Lit. (2018)
Briceno, A.: La musique au-delà des réductionnismes sensoriels : l’expérience musicale des sourds comme fondement d’un nouveau paradigme. Journal de Recherches en Éducation musicale 12(2), 36–46 (2021)
Criton, P.: Listening otherwise: Playing with sound vibration. In: Proceedings of ICMC/SMC, pp. 1805–1808. Athens, Greece (2014)
Darrow, A.A.: The role of music in deaf culture: deaf students’ perception of emotion in music. J. Music Ther. 43(1), 2–15 (2006)
Giordano, M., et al.: Design and implementation of a whole-body haptic suit for “ilinx”, a multisensory art installation. In: Proceedings of SMC, pp. 169–175 (2015)
Holmes, J.A.: Expert listening beyond the limits of hearing. J. Am. Musicological Soc. 70(1), 171–220 (2017)
Hove, M.J., Martinez, S.A., Stupacher, J.: Feel the bass: music presented to tactile and auditory modalities increases aesthetic appreciation and body movement. J. Exp. Psychol. Gen. 149(6), 1137–1147 (2020)
Jack, R., McPherson, A., Stockman, T.: Designing tactile musical devices with and for deaf users: a case study. In: Proceedings of the International Conference on the Multimodal Experience of Music (ICMEM) (2015)
Karam, M., Russo, F.A., Fels, D.I.: Designing the model human cochlea: an ambient crossmodal audio-tactile display. IEEE Trans. Haptics 2(3), 160–169 (2009)
Lee, J., Choi, S.: Real-time perception-level translation from audio signals to vibrotactile effects. In: Proceedings of CHI, pp. 2567–2576. Paris, France (2013)
Merchel, S., Altinsoy, M.E.: Auditory-tactile music perception. In: Proceedings of the International Congress on Acoustics. Montreal, QC, Canada (2013)
Merchel, S., Altinsoy, M.E.: Psychophysical comparison of the auditory and tactile perception: a survey. J. Multimodal User Interfaces 14(3), 271–283 (2020). https://doi.org/10.1007/s12193-020-00333-z
Patiño-Lakatos, G., et al.: Music, vibrotactile mediation and bodily sensations in anorexia nervosa. Hum. Technol. 16(3), 372–405 (2020)
Peeters, G.: A large set of audio features for sound description. Technical Report, IRCAM, Paris, France (2004)
Petry, B., Illandara, T., Forero, J.P., Nanayakkara, S.: Ad-hoc access to musical sound for deaf individuals. In: Proceedings of ASSETS 2016, Reno, NV, USA (2016)
Pulkki, V.: Virtual sound source positioning using vector base amplitude panning. J. Audio Eng. Soc. 45(6), 456–466 (1997)
Remache-Vinueza, B., Trujillo-León, A., Zapata, M., Sarmiento-Ortiz, F., Fernando, V.V.: Audio-tactile rendering: a review on technology and methods to convey musical information through the sense of touch. Sensors 21(16), 6575 (2021)
Russo, F.A., Ammirante, P., Fels, D.I.: Vibrotactile discrimination of musical timbre. J. Exp. Psych. Hum. Percept. Perform. 32(4), 822–826 (2012)
Shim, S.-W., Tan, H.Z.: palmScape: calm and pleasant vibrotactile signals. In: Marcus, A., Rosenzweig, E. (eds.) HCII 2020. LNCS, vol. 12200, pp. 532–548. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49713-2_37
Turchet, L., West, T., Wanderley, M.M.: Touching the audience: musical haptic wearables for augmented and participatory live music performances. Pers. Ubiquit. Comput. 25(4), 749–769 (2020). https://doi.org/10.1007/s00779-020-01395-2
Verrillo, R.T.: Vibration sensation in humans. Music Percept. Interdisc. J. 9(3), 282–302 (1992)
Weber, M., Saitis, C.: Towards a framework for ubiquitous audio-tactile design. In: International Workshop on Haptic and Audio Interaction Design. Montreal, Canada (2020)
West, T.J., Bachmayer, A., Bhagwati, S., Berzowska, J., Wanderley, M.M.: The design of the body:suit:score, a full-body vibrotactile musical score. In: Yamamoto, S., Mori, H. (eds.) HCII 2019. LNCS, vol. 11570, pp. 70–89. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22649-7_7
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Paté, A., d’Alessandro, N., Gréciet, A., Bruggeman, C. (2022). TOuch ThE Music: Displaying Live Music into Vibration. In: Saitis, C., Farkhatdinov, I., Papetti, S. (eds) Haptic and Audio Interaction Design. HAID 2022. Lecture Notes in Computer Science, vol 13417. Springer, Cham. https://doi.org/10.1007/978-3-031-15019-7_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-15019-7_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15018-0
Online ISBN: 978-3-031-15019-7
eBook Packages: Computer ScienceComputer Science (R0)