Tableware: Social Coordination Through Computationally Augmented Everyday Objects Using Auditory Feedback
Pages 332 - 349
Abstract
This research develops a novel way of rethinking cultural and social behavior using computationally augmented artifacts. These ‘instruments’ provide various types of auditory feedback when manipulated by certain actions within social contexts, such as a bar or dining space. They foster affective social engagement through the habitual and explorative actions that they afford in everyday contexts, and their resulting auditory feedback. The goal is not only to observe how social interactions are affected by the manipulation of augmented artifacts, but also to observe how the sounds and manipulations affect psycho-sociological [1] changes towards more collaborative social relations during the processes of participatory sense-making [2]. In this paper, we present: a) a study of dynamic social interaction and how we instrumented tangible artifacts to reflect and induce engagement, b) a literature review that provides background for our design methodology, c) ‘vocal prototyping’–a responsive media technique for developing action-sonic mappings, d) our experimental prototype based on this design methodology.
References
[1]
Lemaitre G et al. Feelings elicited by auditory feedback from a computationally augmented artifact: the flops IEEE Trans. Affect. Comput. 2012 3 3 335-348
[2]
De Jaegher H and Di Paolo E Participatory Sense-Making Phenomenol. Cogn. Sci. 2007 6 4 485-507
[3]
De Jaegher, H., Di Paolo, E., Gallagher, S.: Can social interaction constitute social cognition? Trends Cogn. Sci. 14(10): 441–447 (2010). 10.1016/j.tocs
[4]
Hayes, L.: Beyond Skill Acquisition: Improvisation, Interdisciplinarity, and Enactive Music Cognition. Contemporary Music Review. Taylor & Francis, London (2019)
[5]
Coccia, E.: Reversing the New Global Monasticism. Fall Semester, 21, Apr. https://fallsemester.org/2020-1/2020/4/17/emanuele-coccia-escaping-the-global-monasticism (2020)
[6]
Fox, N.J.: Boundary Objects: Social Meanings and the Success of New Technologies. Sociology 45(1), 70–85 (2011)
[7]
Lyu, Y., Hayes, L.: Exploring social coordination through computationally augmented artifacts using auditory feedback. In: 26th International Symposium on Electronic, Montreal, Canada (accepted, 2020)
[8]
Tanaka S Intercorporeality and Aida: developing an interaction theory of social cognition Theory Psychol. 2017 27 3 337-353
[9]
Gendlin ET Experiencing and the Creation of Meaning: a philosophical and psychological approach to the subjective 1962 New York Free Press of Glencoe
[10]
Gendlin ET Thinking beyond patterns: Body, language and situations 1991 Spring Valley Focusing Institute
[11]
Gill SP Tacit engagement: beyond interaction AI & Soc. 2016 34 1 163
[12]
Sha, X. W.: The Atelier-Lab as a Transversal Machine. Revue rancaise d’etudes americaines, pp. 62–78 (2011)
[13]
Sha, X.W., Freed, A., Navab, N.: Sound design as human matter interaction. Extended Abstracts on Human Factors in Computing Systems, April 2013, pp. 2009–2018. 10.1145/2468356.2468718
[14]
Rafaeli A and Vilnai-Yavetz I Instrumentality, aesthetics and symbolism of physical artifacts as triggers of emotion Theoret. Issues Ergon. Sci. 2004 5 1 91-112
[15]
Johnston T, Van Reekum C, Hird K, Kirsner K, and Scherer KR Affective speech elicited with a computer game Emotion 2005 5 4 513-518
[16]
Van Reekum C, Johnston T, Banse R, Etter A, Wehrle T, and Scherer K Psychophysiological responses to appraisal dimensions in a computer game Cogn. Emot. 2004 18 5 663-668
[17]
Kaiser, S., Edwards, T.: Multimodal emotions measurement in an interactive computer game: a pilot-study. In: Proceedings of the VIIIth Conference of the International Society for Research on Emotions, vol. 13, no. 1, pp. 19–124 (1999)
[18]
Ravaja, N., Timo, S., Jani, L., Kari, K, Mikko.: The psychophysiology of video gaming: phase emotional response to game events. In Proceedings of the Digital Game Research Association (DiGra)conference: changing views -World in play (2005)
[19]
Ravaja N, Turpeinen M, Saari T, Puttonen S, and Jarvinen L The psychophysiology of games bond: phasic emotional response to violent video games Emotion 2008 8 1 114-120
[20]
Franinovic, K.: The Flops: Negotiating Between Habitual and Explorative Gestures. New Interfaces for Musical Expression (2011)
[21]
Polotti, P., Monache, S.D., Papetti, S., Rocchesso, D.: Gamelunch: forging a dining experience through sound. In: Proceeding of the Twenty- Sixth Annual CHI Conference Extended Abstracts on Human Factors in Computing Systems- CHI (2008). 10.1145/1358628.1358670
[22]
Shockley K, Richardson DC, and Dale R Conversation and coordinative structures Topics Cogn. Sci. 2009 1 2 305-319
[23]
Richardson MJ et al. Rocking together: dynamics of intentional and unintentional interpersonal coordination Hum. Movement Sci. 2007 26 6 867-891
[24]
Voss DDeleuze’s Rethinking of the Notion of SenseDeleuze Stud.2003711-252273691
[25]
Gilbert S On the Mode of Existence of Technical Objects 2015 Minnesota Translated by Cecile Malaspina and John Rogove
[26]
Kean, M.L.: Markedness. In International encyclopedia of linguistics, v. 2. Edited by W. Bright, pp. 390–391. Oxford University Press, Oxford (1992)
[27]
Fantauzza, J., Berzowska, J., Dow, S., Iachello, G., Sha, X.W.: Greeting Dynamics Using Expressive Softwear. Ubicomp (2003)
[28]
Barua, S., Lyu, Y.: Conviviality Cafe. Connectivity_Café (2020). http://synthesiscenter.net/projects/connectivity-cafe/(2019-2020)
[29]
Gaver, B., Dunne, T., Pacenti, E.: Cultural Probes. Interactions, Jan-Feb 21–29 (1999)
[30]
Graham, C., Rouncefield, M.: Probes and participation. In: Proceedings of the Tenth Anniversary Conference on Participatory Design, pp. 194–197(2008)
[31]
Sha, X.W., Johnson, G.L.: Rhythm and textural temporality: experience without subject and duration as effect. In: Crespi, P., Manghani, S. (eds.) Rhythm and Critique: Technics, Modalities, Practices,. Edinburgh (2020)
[32]
Rietveld E and Kiverstein J A rich landscape of affordances Ecol. Psychol. 2014 26 4 325-352
[33]
Hayes, L.: Enacting Musical Worlds: Common Approaches to using NIMEs within both Performance and Person-Centred Arts Practices. In: Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 299–302. Baton Rouge, USA (2015)
[34]
Leigh Star S Hubs M and Gasser L The structure of Ill-structured solutions: boundary objects and heterogeneous distributed problem solving Readings in Distributed Artificial Intelligence 3 1989 Menlo Park Morgan Kaufmann
[35]
Krzyzaniak, M., Anirudh, R., Venkataraman, V., Turaga, P., Sha, X.W.: Towards realtime measurement of connectedness in human movement. Movement and Computing (2015)
[36]
Sha, X.W.: Poiesis and Enchantment in Topological Matter. MIT Press, Hoboken (2013)
Recommendations
On the Role of Social Interaction in Individual Agency
Is an individual agent constitutive of or constituted by its social interactions? This question is typically not asked in the cognitive sciences, so strong is the consensus that only individual agents have constitutive efficacy. In this article we ...
A little more social enaction than that: comment on Arango (2019)
In his article “From Sensorimotor Dependencies to Perceptual Practices”, Alejandro Arango presents a case for socialising enactive perception. While noting the importance of understanding perception as embodied, he argues that addressing just the issues ...
Augmented Social Meal via Multi-sensory Feedback Modulated by Bodily-In-Coordinated Measures
Distributed, Ambient and Pervasive InteractionsAbstractWe study how people can affectively engage with one another, using the everyday social setting of an informal meal augmented by media fields sensitive to measurement of coordination. Our contributions are (1) to extend the study of social ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Jul 2020
622 pages
ISBN:978-3-030-59986-7
DOI:10.1007/978-3-030-59987-4
© Springer Nature Switzerland AG 2020.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 19 July 2020
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Dec 2024