Abstract
We study how people can affectively engage with one another, using the everyday social setting of an informal meal augmented by media fields sensitive to measurement of coordination. Our contributions are (1) to extend the study of social engagement from dyadic one-to-one interactions to ensemble activity, in which joint intention and coordinated activity of three or more people cannot be reduced to dyadic interaction, and (2) to create computational media techniques, social wearables, that enhance our bodily ability to communicate and empathize with others, to express with additional layers of social signaling that uses responsive haptic, sonic and visual media that are modulated by measures of ensemble togetherness such as group movement coordination. Our findings as design insights may inspire those particularly focused on the experimental design and development of technology intended to support co-located, embodied interaction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
See semblance typology of entrainments based on etymologies by Adrian Freed, cited by Sha and Johnson in “Rhythm and Textural Temporality”, in Rhythm and Critique: Technics, Modalities, Practices, eds. Paola Crespi and Sunil Manghani, 2014, p111.
- 2.
“By ‘thickness’ I refer not only to perceptual thickness—density of video and sound textures—but also to the rich magma of social, imaginative, and erotic fields within which people play even in ordinary situations, situations in which we perform without first analyzing and cutting up our experiences into analytic layers.…I say “thick” mindful of Clifford Geertz’s sociological and anthropological approach to describing culture in all of its rich social patterns and dynamics without orthogonalizing it a priori into categories and schemata that we would bring to bear on that culture.” ([33], p. 72).
- 3.
Topological Media Lab, http://topologicalmedialab.net/
- 4.
Synthesis Center, http://synthesis.ame.asu.edu/
References
Alavesa, P., Schmidt, J., Fedosov, A., Byrne, R., & Mueller, F. F. (2015). Air tandem: A collaborative bodily game exploring interpersonal synchronization. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, London, UK. https://doi.org/10.1145/2793107.2810311
Balaam, M., Fitzpatrick, G., Good, J., Harris, E.: Enhancing interactional synchrony with an ambient display. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 867–876 (2011)https://doi.org/10.1145/1978942.1979070
Barua, S; Lyu,Y.: Connectivity Café: Prototyping the Dining Event” EASST-4S virPrague (2020) https://vimeo.com/synthesiscenter/connectivitycafe (password: Synthesis)
Benford, S., Höök, K., Marshall, J., Mueller, F., Svanes, D.: Body-Centric Computing (Dagstuhl Reports 17392). In Dagstuhl Reports Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik 7(9). (2018)
Bernieri, F.J., Rosenthal, R.: Interpersonal coordination: Behavior matching and interactional synchrony. In: Feldman, R.S., Rimé, B. (eds.) Fundamentals of nonverbal behavior, pp. 401–432. Cambridge University Press; Editions de la Maison des Sciences de l’Homme (1991)
Borovoy, R., Martin, F., Resnick, M., Silverman, B. GroupWear: nametags that tell about relationships. In CHI 98 conference summary on Human factors in computing systems (pp. 329–330) (1998)
Burke, J., Prewett, M.S.: Comparing the effects of Visual-Auditory and visual-tactile feedback on user performance.
Hummels, C., Dijk, J.V.: Seven Principles to Design for Embodied Sensemaking. In: Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’14. ACM Press, Stanford, California, USA, 21–28.(2015) https://doi.org/10.1145/2677199.2680577
Colombetti, G.: The feeling body: Affective science meets the enactive mind. MIT press (2014)
Condon, W.S., Sander, L.W.: Neonate movement is synchronized with adult speech: Interactional participation and language acquisition. Science 183(4120), 99–101 (1974)
Degenaar, J., O’Regan, J.K.: Sensorimotor theory of consciousness. Scholarpedia 10(5), 4952 (2015)
Fantauzza, J., Berzowska, J., Dow, S., Iachello, G., Wei, S.X.: Greeting dynamics using expressive softwear. In Ubicomp 2003 Adjunct Proceedings.(2003)
Fitzpatrick, P., et al.: Social Motor Synchronization: Insights for Understanding Social Behavior in Autism. J. Autism Dev. Disord. 47(7), 2092–2107 (2017). https://doi.org/10.1007/s10803-017-3124-2
Gendlin, E.T.: Thinking Beyond Patterns.The Presence of Feeling in Thought. eds Ouden, B.D., Moen, M., New York: Peter Lang, 21–151 (1992)
Gibson, J.J.: The Ecological Approach to Visual Perception. Psychology Press, New York, N.Y. (2015)
Gill, Satinder. (2016). Tacit Engagement: beyond interaction. Springer International Pu
Isbister, K., Abe, K., Karlesky, M.: Interdependent Wearables (for Play): A Strong Concept for Design. In (2017)
Sha, X.W.: Writing in water: dense responsive media in place of relational interfaces. AI & Soc. , 1–9 (2021). https://doi.org/10.1007/s00146-021-01185-1
Krzyzaniak, M., Anirudh, R., Venkataraman, V., Turaga, P., Sha, X.W.: Towards realtime measurement of connectedness in human move- ment. In MOCO ’15 In: Proceedings of the 2nd International Workshop on Movement and Computing, pp. 120–123 (2015)
Lakin, J.L., Chartrand, T.L.: Using nonconscious behavioral mimicry to create affiliation and rapport. Psychol. Sci. 14(4), 334–339 (2003)
Leong, J., Wang, Y., Sayah, R., Pappa, S.R., Perteneder, F., Ishii, H.: SociaBowl: a Dynamic Table Centerpiece to Mediate Group Conversations. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–6 (2019)
Lyu, Y., Mechtley, B., Hayes, L., Sha, X.W.: Tableware: Social Coordination Through Computationally Augmented Everyday Objects Using Auditory Feedback. In HCI International 2020–Late Breaking Papers: Digital Human Modeling and Ergonomics, Mobility and Intelligent Environments: 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings 22, pp. 332–349 Springer International Publishing (2020). https://doi.org/10.1007/978-3-030-59987-4_24
Massumi, B.: Politics of Affect. Polity Press, Germany (2015)
Mullenbach, J., Shultz, C., Colgate, J.E., Piper, A. M.: Exploring affective communication through variable-friction surface haptics. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3963–3972 (2014)
Nakanishi, H., Tanaka, K., Wada, Y.: Remote handshaking: touch enhances video-mediated social telepresence. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp. 2143–2152 (2014)
O’Brien, S., Mueller, F.: Jogging the distance. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, San Jose, USA, pp. 523–526 (2007) https://doi.org/10.1145/1240624.1240708
O’Regan, J.K., Noë, A.: A sensorimotor account of vision and visual consciousness. In Behavioral and Brain Sciences 24 (5), pp. 883–917 (2001)
Polauyi, M.: The Tacit Dimension. Garden City, N.Y., Doubleday (1966)
Ramseyer, F., Tschacher, W.: Nonverbal synchrony in psychotherapy: coordinated body movement reflects relationship quality and outcome. J. Consult. Clin. Psychol. 79(3), 284 (2011)
Rinott, M., Tractinsky, N.: Designing for interpersonal motor synchronization. Human–computer interactions, 1–48.( 2021) https://doi.org/10.1080/07370024.2021.1912608
Robinson, R.B., Reid, E., Fey, J.C., Depping, A.E., Isbister, K., Mandryk, R.L.: April). Designing and Evaluating'in the Same Boat’, a Game of Embodied Synchronization for Enhancing Social Play. In Proceedings of the 2020 CHI conference on human factors in computing systems, pp. 1–14 (2020)
Scheflen, A.E.: The significance of posture in communication systems. Psychiatry 27, 316–331 (1964)
Sha., Johnson.: Rhythm and Textural Temporality. in Rhythm and Critique: Technics, Modalities, Practices, eds. Paola Crespi and Sunil Manghani, (2014)
Sha, X.W.: Poiesis and Enchantment in Topological Matter. MIT Press (2013)
Stepanova, E.R., Desnoyers-Stewart, J., Pasquier, P., & Riecke, B. E., JeL: Breathing together to connect with others and nature. DIS 2020 In: Proceedings of the 2020 ACM Designing Interactive Systems Conference, Eindhoven, Netherlands, pp. 641–654 (2020) https://doi.org/10.1145/3357236.3395532
Thompson, E.: Mind in life. Harvard University Press (2010)
Thorn, S.: Telematic Wearable Music: remote Ensembles and Inclusive Embodied Education. In Audio Mostly, pp. 188–195 (2021)
Valdesolo, P., Ouyang, J., Desteno, D., Ramseyer, F.: The rhythm of joint action: Synchrony promotes cooperative ability. 46, 693–695 (2010). https://doi.org/10.1016/j.jesp.2010.03.004.
Varela, F. J., Thompson, E., & Rosch, E. The embodied mind: Cognitive science and human experience. MIT, 1991
Acknowledgments
The authors thank Synthesis for hosting this work: Connor Rawls for support on the installing of the experimental workshop, and Andrew Robinson for technical assistance.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lyu, Y., Sha, X.W. (2023). Augmented Social Meal via Multi-sensory Feedback Modulated by Bodily-In-Coordinated Measures. In: Streitz, N.A., Konomi, S. (eds) Distributed, Ambient and Pervasive Interactions. HCII 2023. Lecture Notes in Computer Science, vol 14037. Springer, Cham. https://doi.org/10.1007/978-3-031-34609-5_30
Download citation
DOI: https://doi.org/10.1007/978-3-031-34609-5_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34608-8
Online ISBN: 978-3-031-34609-5
eBook Packages: Computer ScienceComputer Science (R0)