Feeling Data through Movement: Designing Somatic Data Experiences with Dancers
Article No.: 23, Pages 1 - 11
Abstract
The proliferation of data throughout society has produced an increased interest in novel ways to represent information to provide new insights, re-humanize data, or allow broader participation. Many novel data representations allow people to physically interact with information by picking up, touching, and manipulating artefacts that encode data through their material properties. In this paper, we draw on the arts to explore how we might design for deeper physical engagement with data. How can we feel data through movements, instead of through objects? We examine nine instructional movement sequences created by five dancers as part of a larger workshop on data and dance. Our findings shed light on promising design strategies for somatically-focused data representations including observations on the relational, layered, and emotionally engaged approaches taken by dancers. We also reflect on these approaches in relation to soma design and identify areas for future work in "data somatics."
References
[1]
Miquel Alfaras, Vasiliki Tsaknaki, Pedro Sanches, Charles Windlin, Muhammad Umair, Corina Sas, and Kristina Höök. 2020. From Biodata to Somadata. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–14. https://doi.org/10.1145/3313831.3376684
[2]
Yakama Native American. 2018. Yakama Time Ball. http://dataphys.org/list/yakama-time-ball/.
[3]
Janine Antoni. 1993. Slumber. http://www.janineantoni.net/slumber.
[4]
Birgir Rafn Baldursson, David Peterson, and Mafalda Gamboa. 2022. Nebula: Artistic Somaesthetic Appreciation with Biosignals in Virtual Reality. In Adjunct Proceedings of the 2022 Nordic Human-Computer Interaction Conference(NordiCHI ’22). Association for Computing Machinery, New York, NY, USA, 1–3. https://doi.org/10.1145/3547522.3547710
[5]
Irmgard Bartenieff and Dori Lewis. 1980. Body Movement: Coping with the Environment (1st edition ed.). Routledge, New York.
[6]
Janne Mascha Beuthel. 2020. Wearing the Invisible: Wearable Manifestations of Embodied Experiences. In Companion Publication of the 2020 ACM Designing Interactive Systems Conference(DIS’ 20 Companion). Association for Computing Machinery, New York, NY, USA, 485–489. https://doi.org/10.1145/3393914.3395828
[7]
Rahul Bhargava, Amanda Brea, Victoria Palacin, Laura Perovich, and Jesse Hinson. 2022. Data Theatre as an Entry Point to Data Literacy. Educational Technology & Society 25, 4 (2022), 93–108.
[8]
Rahul Bhargava and Catherine D’Ignazio. 2017. Data Sculptures as a Playful and Low-Tech Introduction to Working with Data. Presented at Designing Interactive Systems, Edinburgh, Scotland (2017).
[9]
Rahul Bhargava, Ricardo Kadouaki, Emily Bhargava, Guilherme Castro, and Catherine D’Ignazio. 2016. Data Murals: Using the Arts to Build Data Literacy. The Journal of Community Informatics 12, 3 (2016).
[10]
Anne Bogart and Tina Landau. 2004. The Viewpoints Book: A Practical Guide to Viewpoints and Composition. Theatre Communications Group.
[11]
Sophia Brueckner and Rachel Freire. 2018. Embodisuit: A Wearable Platform for Embodied Knowledge. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. 542–548.
[12]
Nadia Campo Woytuk, Marie Louise Juul Søndergaard, Marianela Ciolfi Felice, and Madeline Balaam. 2020. Touching and Being in Touch with the Menstruating Body. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
[13]
Lins Derry. 2023. Data Embodiment: Approaching the Body as a Choreographic Medium for Performing Abstract Data. International Journal of Performance Arts and Digital Media 19, 1 (2023), 60–82.
[14]
Audrey Desjardins, Oscar Tomico, Andrés Lucero, Marta E. Cecchinato, and Carman Neustaedter. 2021. Introduction to the Special Issue on First-Person Methods in HCI., 12 pages.
[15]
Catherine D’Ignazio and Lauren F. Klein. 2020. Data Feminism. Mit Press.
[16]
Kelly Dobson. 2016. The Energy Propagated. https://cargocollective.com/TheEnergyPropagated.
[17]
Paul Dourish. 2001. Where the Action Is. MIT press Cambridge.
[18]
Paul Dourish. 2013. Epilogue: Where the Action Was, Wasn’t, Should Have Been, and Might yet Be. ACM Transactions on Computer-Human Interaction (TOCHI) 20, 1 (2013), 1–4.
[19]
Martha Eddy. 2016. Mindful Movement: The Evolution of the Somatic Arts and Conscious Action. Intellect Books.
[20]
Moshe Feldenkrais. 2009. Awareness Through Movement: Easy-to-Do Health Exercises to Improve Your Posture, Vision, Imagination, and Personal Awareness (reprint edition ed.). HarperOne, San Francisco.
[21]
William Forsythe. 2022. Choreographic Objects. www.williamforsythe.com/installations.html.
[22]
Simone Forti. 1961. Simone Forti. Slant Board. 1961 | MoMA. https://www.moma.org/collection/works/200115.
[23]
Mafalda Gamboa, Mehmet Aydın Baytaş, Sjoerd Hendriks, and Sara Ljungblad. 2023. Wisp: Drones as Companions for Breathing. In Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction(TEI ’23). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3569009.3572740
[24]
Peggy Hackney. 2000. Making Connections: Total Body Integration Through Bartenieff Fundamentals (1st edition ed.). Routledge, New York (N.Y.).
[25]
Trevor Hogan, Uta Hinrichs, Yvonne Jansen, Samuel Huron, Pauline Gourlet, Eva Hornecker, and Bettina Nissen. 2017. Pedagogy & Physicalization: Designing Learning Activities around Physical Data Representations. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems. 345–347.
[26]
Trevor Hogan and Eva Hornecker. 2013. In Touch with Space: Embodying Live Data for Tangible Interaction. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction. 275–278.
[27]
Kristina Höök. 2018. Designing with the Body: Somaesthetic Interaction Design. MIT Press.
[28]
Kristina Höök. 2020. Soma Design-Intertwining Aesthetics, Ethics and Movement. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction. 1–1.
[29]
Kristina Höök, Steve Benford, Paul Tennent, Vasiliki Tsaknaki, Miquel Alfaras, Juan Martinez Avila, Christine Li, Joseph Marshall, Claudia Dauden Roquet, and Pedro Sanches. 2021. Unpacking Non-Dualistic Design: The Soma Design Case. ACM Transactions on Computer-Human Interaction (TOCHI) 28, 6 (2021), 1–36.
[30]
Kristina Höök, Baptiste Caramiaux, Cumhur Erkut, Jodi Forlizzi, Nassrin Hajinejad, Michael Haller, Caroline CM Hummels, Katherine Isbister, Martin Jonsson, and George Khut. 2018. Embracing First-Person Perspectives in Soma-Based Design. In Informatics, Vol. 5. MDPI, 8.
[31]
Kristina Höök, Sara Eriksson, Marie Louise Juul Søndergaard, Marianela Ciolfi Felice, Nadia Campo Woytuk, Ozgun Kilic Afsar, Vasiliki Tsaknaki, and Anna Ståhl. 2019. Soma Design and Politics of the Body. In Proceedings of the Halfway to the Future Symposium 2019. 1–8.
[32]
Kristina Höök, Martin P. Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic Appreciation Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3131–3142.
[33]
Noura Howell, John Chuang, Abigail De Kosnik, Greg Niemeyer, and Kimiko Ryokai. 2018. Emotional Biosensing: Exploring Critical Alternatives. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 1–25. https://doi.org/10.1145/3274338
[34]
Dianya Mia Hua, Jeffrey Bardzell, and Shaowen Bardzell. 2023. Embodied Embroidery: Somaesthetic Interaction Design for Women’s Masturbation. In Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction. 1–15.
[35]
Sarah Hughes, John Collins, Mark Hansen, Ben Rubin, and Jer Thorp. 2015. A Sort of Joy (Thousands of Exhausted Things). https://www.sarahcameronhughes.com/a-sort-of-joy.
[36]
Samuel Huron, Benjamin Bach, Uta Hinrichs, Mandy Keck, and Jonathan Roberts. 2020. IEEE VIS Workshop on Data Vis Activities to Facilitate Learning, Reflecting, Discussing, and Designing. In IEEE VIS 2020.
[37]
Jörn Hurtienne. 2018. Possibilities of Human Data Embodiment: 100% City. In Position Paper for the Workshop: Towards a Design Language for Data Physicalization at IEEE VIS, Vol. 6.
[38]
Yvonne Jansen and Pierre Dragicevic. 2018. List of Physical Visualizations.
[39]
Yvonne Jansen, Pierre Dragicevic, and Jean-Daniel Fekete. 2013. Evaluating the Efficiency of Physical Visualizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2593–2602.
[40]
Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbæk. 2015. Opportunities and Challenges for Data Physicalization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 3227.
[41]
Lee Jones, Greta Grip, and Sara Nabil. 2023. Wear Your Heart on Your Sleeve: Using Digital Knitting Machines to Craft Wearable Biodata Portraits. In Proceedings of the 2023 ACM Designing Interactive Systems Conference(DIS ’23). Association for Computing Machinery, New York, NY, USA, 547–563. https://doi.org/10.1145/3563657.3596007
[42]
Maria Karyda, Danielle Wilde, and Mette Gislev Kjærsgaard. 2020. Narrative Physicalization: Supporting Interactive Engagement with Personal Data. IEEE Computer Graphics and Applications 41, 1 (2020), 74–86.
[43]
Bongshin Lee, Petra Isenberg, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Transactions on Visualization and Computer Graphics 18, 12 (2012), 2689–2698.
[44]
Wonjun Lee, Youn-kyung Lim, and Richard Shusterman. 2014. Practicing Somaesthetics: Exploring Its Impact on Interactive Product Design Ideation. In Proceedings of the 2014 Conference on Designing Interactive Systems. 1055–1064.
[45]
Lian Loke and Thecla Schiphorst. 2018. The Somatic Turn in Human-Computer Interaction. Interactions 25, 5 (Aug. 2018), 54–5863. https://doi.org/10.1145/3236675
[46]
Claire O’Malley and Danae Stanton Fraser. 2004. Literature Review in Learning with Tangible Technologies. (2004).
[47]
Laura J. Perovich, Phoebe Cai, Amber Guo, Kristin Zimmerman, Katherine Paseman, Dayanna Espinoza Silva, and Julia G. Brody. 2020. Data Clothing and BigBarChart: Designing Physical Data Reports on Indoor Pollutants for Individuals and Communities. IEEE Computer Graphics & Applications 41, 1 (2020), 87.
[48]
Laura J. Perovich, Sara Ann Wylie, and Roseann Bongiovanni. 2020. Chemicals in the Creek: Designing a Situated Data Physicalization of Open Government Data with the Community. IEEE Transactions on Visualization and Computer Graphics (2020).
[49]
Aura Pon, Eric Pattison, Lawrence Fyfe, Laurie Radford, and Sheelagh Carpendale. 2017. Torrent: Integrating Embodiment, Physicalization and Musification in Music-Making. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. 209–216.
[50]
Annina Rüst. 2017. A Piece of the Pie Chart.
[51]
Kim Sauvé, Pierre Dragicevic, and Yvonne Jansen. 2023. Edo: A Participatory Data Physicalization on the Climate Impact of Dietary Choices. In Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction. 1–13.
[52]
Thecla Schiphorst. 2011. Self-Evidence: Applying Somatic Connoisseurship to Experience Design. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. 145–160.
[53]
Orit Shaer and Eva Hornecker. 2010. Tangible User Interfaces: Past, Present, and Future Directions. Now Publishers Inc.
[54]
Lawrence Shapiro. 2019. Embodied Cognition (2nd edition ed.). Routledge, London ; New York.
[55]
Anna Ståhl, Martin Jonsson, Johanna Mercurio, Anna Karlsson, Kristina Höök, and Eva-Carin Banka Johnson. 2016. The Soma Mat and Breathing Light. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 305–308.
[56]
Anna Ståhl, Vasiliki Tsaknaki, and Madeline Balaam. 2021. Validity and Rigour in Soma Design-Sketching with the Soma. ACM Transactions on Computer-Human Interaction (TOCHI) 28, 6 (2021), 1–36.
[57]
Simon Stusak, Moritz Hobe, and Andreas Butz. 2016. If Your Mind Can Grasp It, Your Hands Will Help. In Proceedings of the TEI’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. 92–99.
[58]
Dag Svanaes and Martin Solheim. 2016. Wag Your Tail and Flap Your Ears: The Kinesthetic User Experience of Extending Your Body. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 3778–3779.
[59]
Paul Tennent, Joe Marshall, Vasiliki Tsaknaki, Charles Windlin, Kristina Höök, and Miquel Alfaras. 2020. Soma Design and Sensory Misalignment. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.
[60]
Vasiliki Tsaknaki, Madeline Balaam, Anna Ståhl, Pedro Sanches, Charles Windlin, Pavel Karpashevich, and Kristina Höök. 2019. Teaching Soma Design. In Proceedings of the 2019 on Designing Interactive Systems Conference. 1237.
[61]
Vasiliki Tsaknaki, Kelsey Cotton, Pavel Karpashevich, and Pedro Sanches. 2021. “Feeling the Sensor Feeling You”: A Soma Design Exploration on Sensing Non-habitual Breathing. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3411764.3445628
[62]
Yun Wang, Adrien Segal, Roberta Klatzky, Daniel F. Keefe, Petra Isenberg, Jörn Hurtienne, Eva Hornecker, Tim Dwyer, and Stephen Barrass. 2019. An Emotional Response to the Value of Visualization. IEEE computer graphics and applications 39, 5 (2019), 8–17.
[63]
Jack Zhao and Andrew Vande Moere. 2008. Embodiment in Data Sculpture: A Model of the Physical Visualization of Information. In Proceedings of the 3rd International Conference on Digital Interactive Media in Entertainment and Arts. ACM, 343–350.
Index Terms
- Feeling Data through Movement: Designing Somatic Data Experiences with Dancers
Recommendations
Tagging with Movement: Somatic Strategies for Image Classification
MOCO '14: Proceedings of the 2014 International Workshop on Movement and ComputingMovement researchers in HCI have begun to utilize theories from the field of Somatics to support their investigations into tangible, ubiquitous, and wearable computing systems. Despite recent advances in integrating movement theory within HCI, the ...
Designing for movement experience
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsThe contribution of the phenomenological aspects of movement to the construction of user experience is relatively unknown. A better understanding of the characteristics of movement experience has the potential to transform the quality of interaction and ...
Biosignal Augmented Embodied Performance
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music ExperiencesWe explore the phenomenology of embodiment based on research through design and reflection on the design of artefacts for augmenting embodied performance. We present three designs for musicians and a dancer; the designs rely on the artists' mastery ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
February 2024
1058 pages
ISBN:9798400704024
DOI:10.1145/3623509
- General Chairs:
- Luigina Ciolfi,
- Trevor Hogan,
- Program Chairs:
- Tanja Döring,
- Tom Jenkins,
- Jelle van Dijk,
- Samuel Huron,
- Zhuying Li,
- Publications Chairs:
- David Coyle,
- Beat Signer
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 February 2024
Check for updates
Badges
Best Paper
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
TEI '24
Sponsor:
TEI '24: Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction
February 11 - 14, 2024
Cork, Ireland
Acceptance Rates
Overall Acceptance Rate 393 of 1,367 submissions, 29%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 538Total Downloads
- Downloads (Last 12 months)538
- Downloads (Last 6 weeks)40
Reflects downloads up to 14 Dec 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in