Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article
Open access

Animo: Sharing Biosignals on a Smartwatch for Lightweight Social Connection

Published: 29 March 2019 Publication History

Abstract

We present Animo, a smartwatch app that enables people to share and view each other's biosignals. We designed and engineered Animo to explore new ground for smartwatch-based biosignals social computing systems: identifying opportunities where these systems can support lightweight and mood-centric interactions. In our work we develop, explore, and evaluate several innovative features designed for dyadic communication of heart rate. We discuss the results of a two-week study (N=34), including new communication patterns participants engaged in, and outline the design landscape for communicating with biosignals on smartwatches.

Supplementary Material

liu (liu.zip)
Supplemental movie, appendix, image and software files for, Animo: Sharing Biosignals on a Smartwatch for Lightweight Social Connection

References

[1]
2018. Fitbit Community Grows to More Than 25 Million Active Users in 2017. Fitbit Community Grows to More Than 25 Million Active Users in 2017 (Jan 2018). https://www.businesswire.com/news/home/20180108005763/en/
[2]
Amir Mohammad Amiri, Nicholas Peltier, Cody Goldberg, Yan Sun, Anoo Nathan, Shivayogi V Hiremath, and Kunal Mankodiya. 2017. WearSense: detecting autism stereotypic behaviors through smartwatches. In Healthcare, Vol. 5. Multidisciplinary Digital Publishing Institute, 11.
[3]
Keith Anderson, Elisabeth André, Tobias Baur, Sara Bernardini, Mathieu Chollet, Evi Chryssafidou, Ionut Damian, Cathy Ennis, Arjan Egges, Patrick Gebhard, et al. 2013. The TARDIS framework: intelligent virtual agents for social coaching in job interviews. In Advances in computer entertainment. Springer, 476--491.
[4]
Elizabeth Bales, Kevin A Li, and William Griwsold. 2011. CoupleVIBE: mobile implicit communication to improve awareness for (long-distance) couples. In Proceedings of the ACM 2011 conference on Computer supported cooperative work. ACM, 65--74.
[5]
Thomas Beelen, Robert Blaauboer, Noraly Bovenmars, Bob Loos, Lukas Zielonka, Robby Van Delden, Gijs Huisman, and Dennis Reidsma. 2013. The art of tug of war: investigating the influence of remote touch on social presence in a distributed rope pulling game. In Advances in Computer Entertainment. Springer, 246--257.
[6]
Frank Biocca, Chad Harms, and Judee K Burgoon. 2003. Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence: Teleoperators & virtual environments 12, 5 (2003), 456--480.
[7]
Melissa A Birkett. 2011. The Trier Social Stress Test protocol for inducing psychological stress. Journal of visualized experiments: JoVE 56 (2011).
[8]
Moira Burke and Robert E Kraut. 2014. Growing closer on facebook: changes in tie strength through social network site use. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 4187--4196.
[9]
Daniel Buschek, Mariam Hassib, and Florian Alt. 2018. Personal Mobile Messaging in Context: Chat Augmentations for Expressiveness and Awareness. ACM Transactions on Computer-Human Interaction (TOCHI) 25, 4 (2018), 23.
[10]
Antonio Capodieci, Pascal Budner, Joscha Eirich, Peter Gloor, and Luca Mainetti. 2018. Dynamically Adapting the Environment for Elderly People Through Smartwatch-Based Mood Detection. Springer International Publishing, Cham, 65--73.
[11]
Angela Chang, Ben Resner, Brad Koerner, XingChen Wang, and Hiroshi Ishii. 2001. LumiTouch: an emotional communication device. In CHI'01 extended abstracts on Human factors in computing systems. ACM, 313--314.
[12]
Franco Curmi, Maria Angela Ferrario, Jen Southern, and Jon Whittle. 2013. HeartLink: open broadcast of live biometric data to social networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1749--1758.
[13]
Daantje Derks, Agneta H Fischer, and Arjan ER Bos. 2008. The role of emotion in computer-mediated communication: A review. Computers in Human Behavior 24, 3 (2008), 766--785.
[14]
Mark D Dunlop, Andreas Komninos, and Naveen Durga. 2014. Towards high quality text entry on smartwatches. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 2365--2370.
[15]
Daniel A Epstein, Bradley H Jacobson, Elizabeth Bales, David W McDonald, and Sean A Munson. 2015. From nobody cares to way to go!: A Design Framework for Social Sharing in Personal Informatics. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1622--1636.
[16]
Jérémy Frey, May Grabli, Ronit Slyper, and Jessica R Cauchard. 2018. Breeze: Sharing Biofeedback Through Wearable Technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 645.
[17]
Jun Gong, Zheer Xu, Qifan Guo, Teddy Seyed, Xiang 'Anthony' Chen, Xiaojun Bi, and Xing-Dong Yang. 2018. WrisText: One-handed Text Entry on Smartwatch Using Wrist Gestures. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 181, 14 pages.
[18]
Erin Griffiths, T Scott Saponas, and AJ Brush. 2014. Health chair: implicitly sensing heart and respiratory rate. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 661--671.
[19]
Charlotte N Gunawardena. 1995. Social presence theory and implications for interaction and collaborative learning in computer conferences. International journal of educational telecommunications 1, 2 (1995), 147--166.
[20]
Charlotte N Gunawardena and Frank J Zittle. 1997. Social presence as a predictor of satisfaction within a computer-mediated conferencing environment. American journal of distance education 11, 3 (1997), 8--26.
[21]
Mariam Hassib, Daniel Buschek, Paweł W Wozniak, and Florian Alt. 2017. HeartChat: Heart Rate Augmented Mobile Chat to Support Empathy and Awareness. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2239--2251.
[22]
Noura Howell, John Chuang, Abigail De Kosnik, Greg Niemeyer, and Kimiko Ryokai. 2018. Emotional Biosensing: Exploring Critical Alternatives. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 69.
[23]
Noura Howell, Laura Devendorf, Rundong Kevin Tian, Tomás Vega Galvez, Nan-Wei Gong, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. Biosignals as Social Cues: Ambiguity and Emotional Interpretation in Social Displays of Skin Conductance. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 865--870.
[24]
Noura Howell, Laura Devendorf, Tomás Alfonso Vega Gálvez, Rundong Tian, and Kimiko Ryokai. 2018. Tensions of Data-Driven Reflection: A Case Study of Real-Time Emotional Biosensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 431, 13 pages.
[25]
Sara H Hsieh and Timmy H Tseng. 2017. Playfulness in mobile instant messaging: Examining the influence of emoticons and text messaging on social interaction. Computers in Human Behavior 69 (2017), 405--414.
[26]
Wijnand IJsselsteijn, Joy van Baren, and Froukje van Lanen. 2003. Staying in touch: Social presence and connectedness through synchronous and asynchronous communication media. Human-Computer Interaction: Theory and Practice (Part II) 2, 924 (2003), e928.
[27]
Joris H Janssen, Jeremy N Bailenson, Wijnand A IJsselsteijn, and Joyce HDM Westerink. 2010. Intimate Heartbeats: Opportunities for Affective Communication Technology. IEEE Transactions on Affective Computing 2 (2010), 72--80.
[28]
Hayeon Jeong, Heepyung Kim, Rihun Kim, Uichin Lee, and Yong Jeong. 2017. Smartwatch wearing behavior analysis: a longitudinal study. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 60.
[29]
Naz Kaya and Helen H Epps. 2004. Relationship between Color and Emotion: A Study of College Students. College Student Journal 38, 3 (2004), 396.
[30]
Joseph'Jofish' Kaye, Mariah K Levitt, Jeffrey Nevins, Jessica Golden, and Vanessa Schmidt. 2005. Communicating intimacy one bit at a time. In CHI'05 extended abstracts on Human factors in computing systems. ACM, 1529--1532.
[31]
Minhwan Kim, Kyungah Choi, and Hyeon-Jeong Suk. 2016. Yo!: Enriching emotional quality of single-button messengers through kinetic typography. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 276--280.
[32]
Evdokimos I Konstantinidis, Magda Hitoglou-Antoniadou, Andrej Luneski, Panagiotis D Bamidis, and Maria M Nikolaidou. 2009. Using affective avatars and rich multimedia content for education of children with autism. In Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 58.
[33]
Sylvia D Kreibig. 2010. Autonomic nervous system activity in emotion: A review. Biological Psychology 84, 3 (2010), 394--421.
[34]
Ravi Kuber and Franklin P Wright. 2013. Augmenting the instant messaging experience through the use of brain--computer interface and gestural technologies. International Journal of Human-Computer Interaction 29, 3 (2013), 178--191.
[35]
Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E Hudson. 2006. Using kinetic typography to convey emotion in text-based interpersonal communication. In Proceedings of the 6th conference on Designing Interactive systems. ACM, 41--49.
[36]
Myungho Lee, Kangsoo Kim, Hyunghwan Rho, and Si Jung Kim. 2014. Empa talk: a physiological data incorporated human-computer interactions. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 1897--1902.
[37]
Fannie Liu, Laura Dabbish, and Geoff Kaufman. 2017. Can Biosignals be Expressive? How Visualizations Affect Impression Formation from Shared Brain Activity. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (2017), 71:1--71:21.
[38]
Fannie Liu, Laura Dabbish, and Geoff Kaufman. 2017. Supporting Social Interactions with an Expressive Heart Rate Sharing Application. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 77:1--77:26.
[39]
Danielle Lottridge, Nicolas Masson, and Wendy Mackay. 2009. Sharing empty moments: design for remote couples. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 2329--2338.
[40]
Xuan Lu, Wei Ai, Xuanzhe Liu, Qian Li, Ning Wang, Gang Huang, and Qiaozhu Mei. 2016. Learning from the ubiquitous language: an empirical analysis of emoji usage of smartphone users. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 770--780.
[41]
Paolo Massa, Chiara Leonardi, Bruno Lepri, Fabio Pianesi, and Massimo Zancanaro. 2015. If you are happy and you know it, say "I'm here": investigating parents' location-sharing preferences. In Human-Computer Interaction. Springer, 315--332.
[42]
Hannah Jean Miller, Jacob Thebault-Spieker, Shuo Chang, Isaac Johnson, Loren Terveen, and Brent Hecht. 2016. "Blissfully Happy" or "Ready to Fight": Varying Interpretations of Emoji. In Proceedings of the 10th International Conference on Web and Social Media.
[43]
Sandra Ohly, Sabine Sonnentag, Cornelia Niessen, and Dieter Zapf. 2010. Diary studies in organizational research. Journal of Personnel Psychology (2010).
[44]
Stephen Oney, Chris Harrison, Amy Ogan, and Jason Wiese. 2013. ZoomBoard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2799--2802.
[45]
Valentina Palladino. 2018. The $199 Fitbit Versa is the company's new "mass-appeal" smartwatch. Ars Technica (2018). https://arstechnica.com/gadgets/2018/03/the-199-fitbit-versa-is-the-companys-new-mass-appeal-smartwatch/
[46]
Pablo Pancardo, JA Hernández-Nolasco, Francisco D Acosta, and Miguel A Wister. 2016. Personalizing Physical Effort Estimation in Workplaces Using a Wearable Heart Rate Sensor. In Ubiquitous Computing and Ambient Intelligence: 10th International Conference, UCAmI 2016, San Bartolomé de Tirajana, Gran Canaria, Spain, November 29-December 2, 2016, Part II 10. Springer, 111--122.
[47]
Stefania Pizza, Barry Brown, Donald McMillan, and Airi Lampinen. 2016. Smartwatch in vivo. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5456--5469.
[48]
Jonathan Posner, James A Russell, and Bradley S Peterson. 2005. The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and psychopathology 17, 3 (2005), 715--734.
[49]
Raquel Robinson, Katherine Isbister, and Zachary Rubin. 2016. All the Feels: Introducing Biometric Data to Online Gameplay Streams. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. ACM, 261--267.
[50]
John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers Chalmers. 2014. Personal tracking as lived informatics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1163--1172.
[51]
Jonathan Rubin, Hoda Eldardiry, Rui Abreu, Shane Ahern, Honglu Du, Ashish Pattekar, and Daniel G Bobrow. 2015. Towards a mobile and wearable system for predicting panic attacks. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 529--533.
[52]
Lauren Scissors, Moira Burke, and Steven Wengrovitz. 2016. What's in a Like?: Attitudes and behaviors around receiving Likes on Facebook. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1501--1510.
[53]
Petr Slovák, Joris Janssen, and Geraldine Fitzpatrick. 2012. Understanding heart rate sharing: towards unpacking physiosocial space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 859--868.
[54]
Ian Smith, Sunny Consolvo, Anthony Lamarca, Jeffrey Hightower, James Scott, Timothy Sohn, Jeff Hughes, Giovanni Iachello, and Gregory D Abowd. 2005. Social disclosure of place: From location technology to communication practices. In Proceedings of the 3rd International Conference on Pervasive Computing. Springer, 134--151.
[55]
Statista. 2018. US Wearable Penetration by Age. https://www.npd.com/wps/portal/npd/us/news/press-releases/2017/us-smartwatch-ownership-expected-to-increase-nearly-60-percent-into-2019/
[56]
Chiew Seng Sean Tan, Johannes Schöning, Kris Luyten, and Karin Coninx. 2014. Investigating the effects of using biofeedback as visual stress indicator during video-mediated collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 71--80.
[57]
Karen P Tang, Jialiu Lin, Jason I Hong, Daniel P Siewiorek, and Norman Sadeh. 2010. Rethinking location sharing: exploring the implications of social-driven vs. purpose-driven location sharing. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing. ACM, 85--94.
[58]
Yonatan Vaizman, Katherine Ellis, and Gert Lanckriet. 2017. Recognizing detailed human context in the wild from smartphones and smartwatches. IEEE Pervasive Computing 16, 4 (2017), 62--74.
[59]
Jan BF Van Erp and Alexander Toet. 2015. Social touch in human--computer interaction. Frontiers in digital humanities 2 (2015), 2.
[60]
Wouter Walmink, Danielle Wilde, and Florian'Floyd' Mueller. 2014. Displaying heart rate data on a bicycle helmet to support social exertion experiences. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 97--104.
[61]
Hua Wang, Helmut Prendinger, and Takeo Igarashi. 2004. Communicating emotions in online chat using physiological sensors and animated text. In CHI'04 extended abstracts on Human factors in computing systems. ACM, 1171--1174.
[62]
Sarah Wiseman and Sandy JJ Gould. 2018. Repurposing Emoji for Personalised Communication: Why means âĂIJI love youâĂİ. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 152.
[63]
Pui Chung Wong, Kening Zhu, and Hongbo Fu. 2018. FingerT9: Leveraging Thumb-to-finger Interaction for Same-side-hand Text Entry on Smartwatches. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 178, 10 pages.
[64]
Bin Xu, Yang Qin, and Dan Cosley. 2017. De-emphasizing Content to Study the Relationship between Meaning, Messages, and Content in IM Systems. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 599--610.
[65]
Chao Xu, Parth H Pathak, and Prasant Mohapatra. 2015. Finger-writing with smartwatch: A case for finger and hand gesture recognition using smartwatch. In Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications. ACM, 9--14.
[66]
Rui Zhou, Jasmine Hentschel, and Neha Kumar. 2017. Goodbye text, hello emoji: mobile communication on wechat in China. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 748--759.

Cited By

View all
  • (2025)AniBalloons: Animated chat balloons as affective augmentation for social messaging and chatbot interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103365194(103365)Online publication date: Feb-2025
  • (2024)"Sharing, Not Showing Off": How BeReal Approaches Authentic Self-Presentation on Social Media Through Its DesignProceedings of the ACM on Human-Computer Interaction10.1145/36869098:CSCW2(1-32)Online publication date: 8-Nov-2024
  • (2024)Just a Breath Away: Investigating Interactions with and Perceptions of Mediated Breath via a Haptic CushionProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633384(1-19)Online publication date: 11-Feb-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 3, Issue 1
March 2019
786 pages
EISSN:2474-9567
DOI:10.1145/3323054
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 March 2019
Accepted: 01 January 2019
Received: 01 November 2018
Published in IMWUT Volume 3, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. biosignals
  2. heart rate
  3. interpersonal communication
  4. smartwatches

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)312
  • Downloads (Last 6 weeks)36
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2025)AniBalloons: Animated chat balloons as affective augmentation for social messaging and chatbot interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103365194(103365)Online publication date: Feb-2025
  • (2024)"Sharing, Not Showing Off": How BeReal Approaches Authentic Self-Presentation on Social Media Through Its DesignProceedings of the ACM on Human-Computer Interaction10.1145/36869098:CSCW2(1-32)Online publication date: 8-Nov-2024
  • (2024)Just a Breath Away: Investigating Interactions with and Perceptions of Mediated Breath via a Haptic CushionProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633384(1-19)Online publication date: 11-Feb-2024
  • (2024)EmoWear: Exploring Emotional Teasers for Voice Message Interaction on SmartwatchesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642101(1-16)Online publication date: 11-May-2024
  • (2024)Wrist-bound Guanxi, Jiazu, and Kuolie: Unpacking Chinese Adolescent Smartwatch-Mediated SocializationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642044(1-21)Online publication date: 11-May-2024
  • (2024)Heart Rate-Based Emotion Recognition and Adaptive Emotion Regulation Support with Wrist-Worn Wearables: A Systematic Literature ReviewInformation Systems and Neuroscience10.1007/978-3-031-58396-4_31(355-366)Online publication date: 26-Jul-2024
  • (2024)Seeing Is Feeling: Emotional Cues in Others’ Heart Rate VisualizationsInformation Systems and Neuroscience10.1007/978-3-031-58396-4_21(243-252)Online publication date: 26-Jul-2024
  • (2023)Ambiguity for Social Self-tracking Practices: Exploring an Emerging Design SpaceCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3606989(144-148)Online publication date: 14-Oct-2023
  • (2023)BreatheWithMe: Exploring Visual and Vibrotactile Displays for Social Breath Awareness during Colocated, Collaborative TasksExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585589(1-8)Online publication date: 19-Apr-2023
  • (2023)Mood in Experience Design: A Scoping ReviewShe Ji: The Journal of Design, Economics, and Innovation10.1016/j.sheji.2023.09.0019:3(330-378)Online publication date: Nov-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media