research-article

Emotion sharing via self-composed melodies on mobile phones

Authors:

Alireza Sahami Shirazi,

Florian Alt,

Albrecht Schmidt,

Ari-Heikki Sarjanoja,

Lotta Hynninen,

Jonna Häkkilä,

Paul HolleisAuthors Info & Claims

MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 30, Pages 1 - 4

https://doi.org/10.1145/1613858.1613897

Published: 15 September 2009 Publication History

Get Access

Abstract

In their role as personal communication devices, mobile phones are a natural choice for sharing and communicating emotions. However, their functionalities are currently very limited in power to express affective messages. In this paper, we describe the design of a system that allows users to easily compose melodies and share them via mobile phones. We show that by using these melodies information about the current emotional state of the sender can be expressed and recognized synchronously by the receiver in a simple, quick, and unobtrusive way. Further, we reveal that self-composed melodies have a stronger impact than pre-composed or downloaded messages, similar to crafted pieces of art offered to a beloved person. We then present findings from a user study that assesses the implementation of a functional prototype and the adequacy of the system for emotional communication.

References

[1]

Brave, S., Ishii, H., and Dahley, A. 1998. Tangible interfaces for remote collaboration and communication. In Proc. CSCW 1998. New York, 169--178.

Digital Library

Google Scholar

[2]

Byrne, R. and Findlay, B. Preference for SMS versus Telephone Calls in Initiating Romantic Relationships. Australian Journal of Emerging Technologies and Society, Issue 2, 2004

Google Scholar

[3]

Chang, A., Resner, B., Koerner, B., Wang, X., Ishii, H. LumiTouch: an emotional communication device. In Proc. CHI 2001, Seattle, 313--314.

Digital Library

Google Scholar

[4]

Chung, H., Lee, C-H., and Selker, T. Lovers' Cup: Drinking interfaces as new communication channels. In Proc. CHI 2006, 375--380.

Digital Library

Google Scholar

[5]

Goodman, E.&Misilim, M. The Sensing Bed. In Proc. Ubi-Comp 2003 Workshop.

Google Scholar

[6]

Grinter, R. E. and Eldrige, M. A. Y Do Tngrs Luv 2 Txt Msg? Proc. ECSCW '01, Kluwer Academic, 2001, 219--238.

Digital Library

Google Scholar

[7]

King, S. and Forlizzi, J. Slow messaging: Intimate communications for couples living at a distance. In Proc. DPPI 2007, 451--454.

Digital Library

Google Scholar

[8]

Nettamo, E., Nirhamo, M., Häkkilä, J. A Cross-Cultural Study of Mobile Music -- Retrieval, Management and Consumption. In Proc. OZCHI, 2006, 87--94.

Digital Library

Google Scholar

[9]

Ventä, L., Ahtinen, A., Ramiah, S., Isomursu, M. "My phone is a part of my soul" - How People Bond with Their Mobile Phones. In Proc. UBICOMM 2008.

Digital Library

Google Scholar

[10]

Voida, A., Grinter, R. E., Ducheneaut, N., Edwards, W. K., Newman, M. W. In: Practices Surrounding iTunes Music Sharing. In Proc. CHI 2005, 191--200.

Digital Library

Google Scholar

[11]

Werner, J., Wettach, R., Hornecker, E. United-Pulse: feeling your partner's pulse: In Proc. MobileHCI 2008, 535--538.

Digital Library

Google Scholar

Cited By

View all

Huber SStötter K(2024)Emotion Sonification As Opportunity For Inclusive Texting: Replacing Emoji With Vocal Bursts And Prosodic VoicesProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685403(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685403
Cauchard JEpps JGoncalves JHäkkilä JHerdel VPerusquia-Hernandez M(2024)Affective Computing for Mobile TechnologiesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680459(1-5)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680459
Li HHäkkilä JVäänänen K(2020)Towards a Conceptual Design Framework for Emotional Communication Systems for Long-Distance RelationshipsInteractivity, Game Creation, Design, Learning, and Innovation10.1007/978-3-030-53294-9_8(103-123)Online publication date: 28-Jul-2020
https://doi.org/10.1007/978-3-030-53294-9_8
Show More Cited By

Index Terms

Emotion sharing via self-composed melodies on mobile phones
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools

Recommendations

Emotion Actuator: Embodied Emotional Feedback through Electroencephalography and Electrical Muscle Stimulation
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

The human body reveals emotional and bodily states through measurable signals, such as body language and electroencephalography. However, such manifestations are difficult to communicate to others remotely. We propose EmotionActuator, a proof-of-concept ...
Design, Realization, and Evaluation of xShare for Impromptu Sharing of Mobile Phones

Mobile phones are truly personal devices loaded with personal data such as photos, contacts, and call history. Yet it is often necessary or desirable to share our phones with others. This is especially true as mobile phones are integrating features ...
Affiliations, Emotion and the Mobile Phone
Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions

Over half of the world's population is expected to be using mobile phones by 2009 and many have become attached to and even dependent on this small electronic communications device. Drawing on seven years of research into the affective aspects of mobile ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2009

473 pages

ISBN:9781605582818

DOI:10.1145/1613858

Conference Chair:
Reinhard Oppermann
Fraunhofer FIT
,
Program Chairs:
Markus Eisenhauer
Fraunhofer FIT
,
Matthias Jarke
RWTH Aachen + Fraunhofer FIT
,
Volker Wulf
University of Siegen + Fraunhofer FIT

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '09

MobileHCI '09: 11th International Conference on Human Computer Interaction with Mobile Devices and Services

September 15 - 18, 2009

Bonn, Germany

Acceptance Rates

MobileHCI '09 Paper Acceptance Rate 23 of 95 submissions, 24%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
351
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Huber SStötter K(2024)Emotion Sonification As Opportunity For Inclusive Texting: Replacing Emoji With Vocal Bursts And Prosodic VoicesProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685403(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685403
Cauchard JEpps JGoncalves JHäkkilä JHerdel VPerusquia-Hernandez M(2024)Affective Computing for Mobile TechnologiesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680459(1-5)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680459
Li HHäkkilä JVäänänen K(2020)Towards a Conceptual Design Framework for Emotional Communication Systems for Long-Distance RelationshipsInteractivity, Game Creation, Design, Learning, and Innovation10.1007/978-3-030-53294-9_8(103-123)Online publication date: 28-Jul-2020
https://doi.org/10.1007/978-3-030-53294-9_8
Baishya UNeustaedter CLee CPoltrock SBarkhuus LBorges MKellogg W(2017)In Your EyesProceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing10.1145/2998181.2998200(84-97)Online publication date: 25-Feb-2017
https://dl.acm.org/doi/10.1145/2998181.2998200
Saadatian ESamani HToudeshki ANakatsu R(2013)Technologically Mediated Intimate Communication: An Overview and Future DirectionsEntertainment Computing – ICEC 201310.1007/978-3-642-41106-9_11(93-104)Online publication date: 2013
https://doi.org/10.1007/978-3-642-41106-9_11
Neustaedter CGreenberg SKonstan JChi EHöök K(2012)Intimacy in long-distance relationships over video chatProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2207785(753-762)Online publication date: 5-May-2012
https://dl.acm.org/doi/10.1145/2207676.2207785
Yim JShaw CTan DBegole BKellogg W(2011)Design considerations of expressive bidirectional telepresence robotsCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979633(781-790)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1979742.1979633
Church KHoggan EOliver NHvannberg ELárusdóttir MBlandford AGulliksen J(2010)A study of mobile mood awareness and communication through MobiMoodProceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries10.1145/1868914.1868933(128-137)Online publication date: 16-Oct-2010
https://dl.acm.org/doi/10.1145/1868914.1868933
Yim JChun SJung KShaw C(2010)Development of Communication Model for Social Robots Based on Mobile ServiceProceedings of the 2010 IEEE Second International Conference on Social Computing10.1109/SocialCom.2010.18(57-64)Online publication date: 20-Aug-2010
https://dl.acm.org/doi/10.1109/SocialCom.2010.18

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Emotion Actuator: Embodied Emotional Feedback through Electroencephalography and Electrical Muscle Stimulation

Design, Realization, and Evaluation of xShare for Impromptu Sharing of Mobile Phones

Affiliations, Emotion and the Mobile Phone