research-article

Open access

Audible Imagery: Creative Contemplations on the Sounds of Home

Authors:

Katsuhiko KushiAuthors Info & Claims

C&C '23: Proceedings of the 15th Conference on Creativity and Cognition

Pages 150 - 161

https://doi.org/10.1145/3591196.3593366

Published: 19 June 2023 Publication History

Abstract

This pictorial paper explores domestic sounds’ capacity to evoke imagery of everyday inhabited spaces. In recent decades, accelerated digitalization has been transforming our everyday sonic environment, and new interactive possibilities, such as multimodal and embodied interaction, draw attention to sound as a communicative medium. In that context, how can artificial product sounds integrate into the present ecology heard at home?

This pictorial includes visual impressions of domestic sounds as documented in Japan through a sound diary experiment, and those drawn by their listeners during a participatory exhibition in Tel-Aviv. The drawings offer insight into the creative sense-making strategies that listeners employ to situate acousmatic sounds within the interrelated composition of their everyday auditory experience. Furthermore, they demonstrate drawing as a unique research tool for constructing and sharing meaning during the product sound design process.

By contemplating drawing as a creative output and a reflective cognition process, this initial multimodal exploration highlights the participatory nature of domestic sound interactions and the opportunities posed by drawing for designing future home soundscapes.

References

[1]

Manuella Blackburn. 2011. The Visual Sound-Shapes of Spectromorphology: an Illustrative Guide to Composition. Organised Sound 16, no. 1 (2011): 5–13.

Digital Library

[2]

Baptiste Caramiaux, Alessandro Altavilla, Scott G. Pobiner, and Atau Tanaka. 2015. Form Follows Sound: Designing Interactions from Sonic Memories. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ‘15). Association for Computing Machinery, New York, NY, USA, 3943–3952. https://doi.org/10.1145/2702123.2702515

Digital Library

[3]

Baptiste Caramiaux, Norbert Schnell, Jules Françoise, Frédéric Bevilacqua, Norbert Schnell, and Frédéric Bevilacqua. 2014. Mapping through listening. Computer Music Journal 38, 34–48 (2014)

Digital Library

[4]

Maxime Carron, Thomas Rotureau, Françoise Dubois, Nicolas Misdariis, and Patrick Susini. 2017. Speaking about sounds: a tool for communication on sound features. Journal of Design Research 15, 2 (2017), 85–109. https://doi.org/10.1504/JDR.2017.086749

[5]

Michel Chion. 1990. Audio-vision: sound on screen/Michel Chion; edited and translated by Claudia Gorbman; with a foreword by Walter Murch. Columbia University Press, New York, NY

[6]

Stefano Delle Monache, Nicolas Misdariis, and Elif Ozcan. 2021. Conceptualising sound-driven design: an exploratory discourse analysis. In Creativity and Cognition (C&C ‘21). Association for Computing Machinery, New York, NY, USA, Article 42, 1–8. https://doi.org/10.1145/3450741.3465258

Digital Library

[7]

Karmen Franinovic and Stefania Serafin. 2013. Sonic interaction design. Mit Press.

Digital Library

[8]

Emma Frid, Hans Lindetorp, Kjetil Falkenberg Hansen, Ludvig Elblaus, and Roberto Bresin. 2019. Sound Forest: Evaluation of an Accessible Multisensory Music Installation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ‘19). Association for Computing Machinery, New York, NY, USA, Paper 677, 1–12. https://doi.org/10.1145/3290605.3300907

Digital Library

[9]

William W. Gaver. 1993. What in the world do we hear? An ecological approach to auditory source perception. Ecological Psychology 5, 1 (1993), 1–29.

[10]

Bill Gaver, Tony Dunne, and Elena Pacenti. 1999. Design: Cultural probes. Interactions 6, 1 (Jan./Feb. 1999), 21–29. https://doi.org/10.1145/291224.291235

Digital Library

[11]

Gabriela Goldschmidt. 2017. Manual sketching: Why is it still relevant?. In The active image: Architecture and engineering in the age of modelling. Springer International Publishing Editors: Sabine Ammon & Remei Capdevila-Werning.

[12]

Gabriel Haas, Evgeny Stemasov, Michael Rietzler, and Enrico Rukzio. 2020. Interactive Auditory Mediated Reality: Towards User-defined Personal Soundscapes. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (DIS ‘20). Association for Computing Machinery, New York, NY, USA, 2035–2050. https://doi.org/10.1145/3357236.3395493

Digital Library

[13]

Maarten Houben, Rens Brankaert, Saskia Bakker, Gail Kenning, Inge Bongers, and Berry Eggen. 2020. The Role of Everyday Sounds in Advanced Dementia Care. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ‘20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376577

Digital Library

[14]

Olivier Houix, Stefano Delle Monache, Hélène Lachambre, Frédéric Bevilacqua, Davide Rocchesso, and Guillaume Lemaitre. 2016. Innovative Tools for Sound Sketching Combining Vocalizations and Gestures. In Proceedings of the Audio Mostly 2016 (AM ‘16). Association for Computing Machinery, New York, NY, USA, 12–19. https://doi.org/10.1145/2986416.2986442

Digital Library

[15]

Olivier Houix, Guillaume Lemaitre., Nicolas Misdariis, Patrick Susini, and Isabel Urdapilleta. 2012. A lexical analysis of environmental sound categories. Journal of Experimental Psychology: Applied 18, 1, 52–80.

[16]

Stine S. Johansen, Niels van Berkel, and Jonas Fritsch. 2022. Characterising Soundscape Research in Human-Computer Interaction. In Designing Interactive Systems Conference (DIS ‘22). Association for Computing Machinery, New York, NY, USA, 1394–1417. https://doi.org/10.1145/3532106.3533458

Digital Library

[17]

Lau Langeveld, René van Egmond, Reinier Jansen, and Elif Özcan. 2013. Product sound design: Intentional and consequential sounds. In Advances in industrial design engineering, Denis A. Coelho (Ed.). InTech Croatia, 45–73. https://doi.org/10.5772/55274

[18]

Maarit Anna Mäkelä, Nithikul Nimkulrat, Tero Heikkinen. 2014. Drawing as a Research Tool: Making and understanding in art and design practice. Studies in Material Thinking. AUT University. Vol 10 (February 2014)

[19]

Elisa D. Mekler and Kasper Hornbæk. 2019. A Framework for the Experience of Meaning in Human-Computer Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ‘19). Association for Computing Machinery, New York, NY, USA, Paper 225, 1–15. https://doi.org/10.1145/3290605.3300455

Digital Library

[20]

Gerard Oleksik, David Frohlich, Lorna M Brown, and Abigail Sellen. 2008. Sonic interventions: understanding and extending the domestic soundscape. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 1419–1428.

Digital Library

[21]

Jeni Paay, Jesper Kjeldskov, Michael Bønnerup, Thulasika Rasenthiran. 2023. Sketching and context: Exploring creativity in idea generation groups. In Design Studies, Volume 84. https://doi.org/10.1016/j.destud.2022.101159.

[22]

Laurel Pardue and S. M. Astrid Bin. 2022. The Other Hegemony: Effects of software development culture on music software, and what we can do about it. In NIME 2022. https://doi.org/10.21428/92fbeb44.0cc78aeb

[23]

Daniel L Schacter, and Donna Rose Addis. 2007. The cognitive neuroscience of constructive memory: remembering the past and imagining the future. Phil. Trans. R. Soc. B362773–786 http://doi.org/10.1098/rstb.2007.2087

[24]

Pierre Schaeffer. 1966. Traité des objets musicaux. Seuil, Paris.

[25]

R Murray Schafer. 1993. The soundscape: Our sonic environment and the tuning of the world. Simon and Schuster.

[26]

Mariana Seiça, Licínio Roque, Pedro Martins, and F. Amílcar Cardoso. 2022. Artefact, Participant and Interaction in Auditory Experiences. In Proceedings of the 27th International Conference on Auditory Display (ICAD 2022). Department of Computer and Information Sciences, Northumbria University.

[27]

Marjan Sikora, Mladen Russo, Jurica Ðerek, and Ante Jurčević. 2018. Soundscape of an Archaeological Site Recreated with Audio Augmented Reality. ACM Trans. Multimedia Comput. Commun. Appl. 14, 3, Article 74 (August 2018), 22 pages. https://doi.org/10.1145/3230652

Digital Library

[28]

Nina Simon. 2010. The Participatory Museum. Santa Cruz, California: Museum 2.0.

[29]

Denis Smalley. 1997. Spectromorphology: explaining sound-shapes. Organised Sound 2, 2: 107–126. http://doi.org/10.1017/S1355771897009059

Digital Library

[30]

Miriam Sturdee and Joseph Lindley. 2019. Sketching & Drawing as Future Inquiry in HCI. In Proceedings of the Halfway to the Future Symposium 2019 (HTTF 2019). Association for Computing Machinery, New York, NY, USA, Article 18, 1–10. https://doi.org/10.1145/3363384.3363402

Digital Library

[31]

Paulina Yurman. 2021. Fluid Speculations: Drawing Artefacts in Watercolour as Experimentation in Research Through Design. In Creativity and Cognition (C&C ‘21). Association for Computing Machinery, New York, NY, USA, Article 38, 1–13. https://doi.org/10.1145/3450741.3466777

Digital Library

[32]

Don H. Zimmerman and D. Lawrence Wieder. 1977. The Diary: “Diary-Interview Method”. Urban Life; Newbury Park, Calif., Vol. 5, 4 (Jan. 1977), 479–498. http://search.proquest.com/docview/1292940175/citation/A16505C-65BA645C4PQ/1

Cited By

Delle Monache SMoleman ROzcan E(2024)Soundstorm, a collaborative ideation game for sound-driven designProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678348(479-486)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678348
Zorea MKushi K(2024)All Is Heard: Reimagining The Sounds of Home With CareProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660686(2708-2718)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660686

Recommendations

All Is Heard: Reimagining The Sounds of Home With Care
DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference

As interactive sounds become embedded in our homes, we turn to the lens of care for exploring our audible relationships with home's nonhuman things, thereby revealing the potential of reimagining with care the design of domestic sound interactions. This ...
Comparisons of Auditory Impressions and Auditory Imagery Associated with Onomatopoeic Representation for Environmental Sounds

Humans represent sounds to others and receive information about sounds from others using onomatopoeia. Such representation is useful for obtaining and reporting the acoustic features and impressions of actual sounds without having to hear or emit them. ...
Making the Invisible Audible: Sonifying Qualitative Data
AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound

We describe how Embosonic Sketching, a novel approach to qualitative data sonification, was employed in the design of a sound art installation. The method was conceived to minimise designer bias in the creation of sound artworks which seek to faithfully ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

C&C '23: Proceedings of the 15th Conference on Creativity and Cognition

June 2023

564 pages

ISBN:9798400701801

DOI:10.1145/3591196

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2023

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

C&C '23

Sponsor:

SIGCHI

C&C '23: Creativity and Cognition

June 19 - 21, 2023

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
281
Total Downloads

Downloads (Last 12 months)195
Downloads (Last 6 weeks)27

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Delle Monache SMoleman ROzcan E(2024)Soundstorm, a collaborative ideation game for sound-driven designProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678348(479-486)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678348
Zorea MKushi K(2024)All Is Heard: Reimagining The Sounds of Home With CareProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660686(2708-2718)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660686

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents