Abstract
Expressive interfaces that communicate human emotional state (e.g., level of arousal) are beneficial to many applications. In this work, we use a research-through-design approach to learn about the challenges and opportunities involved in physicalizing emotional data derived from biosignals in real-time. We present EmoClock, a physicalization that uses a clock as a metaphor to communicate arousal and valence derived from biosignal data and lessons learned from its evaluation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alfaras, M., et al.: From biodata to Somadata. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–14 (2020)
Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)
Choi, K.H., Kim, J., Kwon, O.S., Kim, M.J., Ryu, Y.H., Park, J.E.: Is heart rate variability (HRV) an adequate tool for evaluating human emotions?-a focus on the use of the international affective picture system (IAPS). Psychiatry Res. 251, 192–196 (2017)
Di Crosta, A., et al.: The Chieti affective action videos database, a resource for the study of emotions in psychology. Sci. Data 7(1), 32 (2020)
Hanna, T.: What is Somatics. Somat. Mag. J. Bodily Arts Sci. 5(4), 4–8 (1986)
Höök, K., et al.: Unpacking non-dualistic design The soma design case. ACM Trans. Comput. Human Interact. (TOCHI) 28(6), 1–36 (2021)
Höök, K., et al.: Embracing first-person perspectives in soma-based design. Informatics. 5, 8 (2018)
Höök, K., Jonsson, M.P., Ståhl, A., Mercurio, J.: Somaesthetic appreciation design. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 3131–3142 (2016)
Howell, N., et al.: BioSignals as social cues: ambiguity and emotional interpretation in social displays of skin conductance. In: Proceedings of the 2016 ACM Conference on Designing Interactive Systems, pp. 865–870 (2016)
Jansen, Y., et al.: Opportunities and challenges for data physicalization. In: Begole, B., Kim, J., Inkpen, K., Woo, W. (eds.) Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI 2015, pp. 3227–3236. ACM Press, Seoul, Korea (2015)
Khut, G.: Designing biofeedback artworks for relaxation. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 3859–3862 (2016)
Lee, S., El Ali, A., Wijntjes, M., Cesar, P.: Understanding and designing avatar biosignal visualizations for social virtual reality entertainment. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–15 (2022)
Liu, F., et al.: Significant otter: understanding the role of biosignals in communication. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–15 (2021)
van Loenhout, R., Ranasinghe, C., Degbelo, A., Bouali, N.: Physicalizing sustainable development goals data: An example with SDG 7 (affordable and clean energy). In: CHI Conference on Human Factors in Computing Systems Extended Abstracts, pp. 1–7 (2022)
Lund, A.M.: Measuring usability with the use questionnaire12. Usabil. Interface 8(2), 3–6 (2001)
Mahlke, S., Minge, M.: Consideration of multiple components of emotions in human-technology interaction. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868, pp. 51–62. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-85099-1_5
McDuff, D., Karlson, A., Kapoor, A., Roseway, A., Czerwinski, M.: Affectaura: an intelligent system for emotional memory. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 849–858 (2012)
Moge, C., Wang, K., Cho, Y.: Shared user interfaces of physiological data: systematic review of social biofeedback systems and contexts in HCI. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–16 (2022)
Pepping, J., Scholte, S., van Wijland, M., de Meij, M., Wallner, G., Bernhaupt, R.: Motiis: fostering parents’ awareness of their adolescents emotional experiences during gaming. In: Lamas, D., Sarapuu, H., Lárusdóttir, M., Stage, J., Ardito, C. (eds.) NordiCHI 2020: Shaping Experiences, Shaping Society, Proceedings of the 11th Nordic Conference on Human-Computer Interaction, pp. 58:1–58:11. ACM, Tallinn, Estonia (2020)
Ranasinghe, C., Degbelo, A.: Encoding variables, evaluation criteria and evaluation methods for data physicalizations: a review. Multimodal Technol. Interact. 7(73) (2023)
Sanches, P., et al.: Mind the body! designing a mobile stress management application encouraging personal reflection. In: Proceedings of the 8th ACM Conference on Designing Interactive Systems, pp. 47–56 (2010)
Schaefer, A., Nils, F., Sanchez, X., Philippot, P.: Assessing the effectiveness of a large database of emotion-eliciting films: a new tool for emotion researchers. Cogn. Emot. 24(7), 1153–1172 (2010)
Ståhl, A., Höök, K., Svensson, M., Taylor, A.S., Combetto, M.: Experiencing the affective diary. Pers. Ubiquit. Comput. 13, 365–378 (2009)
Umair, M., Sas, C., Alfaras, M.: Thermopixels: toolkit for personalizing arousal-based interfaces through hybrid crafting. In: Proceedings of the 2020 ACM Designing Interactive Systems conference. pp. 1017–1032 (2020)
Umair, M., Sas, C., Latif, M.H.: Towards affective chronometry: exploring smart materials and actuators for real-time representations of changes in arousal. In: Proceedings of the 2019 on Designing Interactive Systems Conference, pp. 1479–1494 (2019)
Wen, W., Liu, G., Cheng, N., Wei, J., Shangguan, P., Huang, W.: Emotion recognition based on multi-variant correlation of physiological signals. IEEE Trans. Affect. Comput. 5(2), 126–140 (2014)
Zimmerman, J., Forlizzi, J., Evenson, S.: Research through design as a method for interaction design research in HCI. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 493–502 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Peeters, D., Ranasinghe, C., Degbelo, A., Ahmed, F. (2023). EmoClock: Communicating Real-Time Emotional States Through Data Physicalizations. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14142. Springer, Cham. https://doi.org/10.1007/978-3-031-42280-5_26
Download citation
DOI: https://doi.org/10.1007/978-3-031-42280-5_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42279-9
Online ISBN: 978-3-031-42280-5
eBook Packages: Computer ScienceComputer Science (R0)