Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3472307.3484168acmconferencesArticle/Chapter ViewAbstractPublication PageshaiConference Proceedingsconference-collections
research-article
Open access

Robot Mediated Handholding Combined with a Mobile Video Call Makes the Users Feel Nearer and Closer

Published: 09 November 2021 Publication History

Abstract

Combining a device that mediates social touch between people in remote locations with a video call can be expected to enhance the feeling of being in the same space (sense of space sharing) and social bonding with the remote partner. However, when the device is combined with a mobile phone video call, size inconsistency could occur between the device that acts as a substitute for the body part and the reduced video of the partner. In addition, when the device operates separately from a mobile phone in wireless communication, positional inconsistency also happens. This study developed a robotic hand-type social touch device and investigated whether it enhances the sense of space sharing and social bonding even though these inconsistencies occur. Experimental results revealed that the user's belief that the finger movements of the device were the partner's hand movement contributed to the sense of space sharing. The movements of the device according to the flow of conversation facilitated this belief; hence, the sense of space sharing increased in spite of the inconsistencies. Positional inconsistency was also found to have an adverse effect on social bonding. Positional consistency contributes to enhance social bonding because it visually facilitates the user's belief that the device is a substitute for the partner's body. Basically, the functions of the device, such as skin softness, body temperature, finger movements, and grip force, which enhance the reality of the touch sensation, could be effective in facilitating the user's beliefs. However, it was suggested that awareness of temperature does not always make positive contribution to the reality and could lead to eeriness.

References

[1]
Angela Prussog, Lothar Muhlbach, Martin Bocker. 1994. Telepresence in Videocommunications. Proc. Annual Meeting of Human Factors and Ergonomics Society. Vol.38, No.3, pp.180-184. https://doi.org/10.1177/154193129403800302
[2]
Vittorio Caggiano, Leonardo Fogassi, Giacomo Rizzolatti, Peter Thier. 2009. Antonino Casile: Mirror Neurons Differentially Encode the Peripersonal and Extrapersonal Space of Monkeys. Science. Vol.324, No.5925, pp.403-406. https://doi.org/10.1126/science.1166818
[3]
Hideyuki Nakanishi, Kazuaki Tanaka and Yuya Wada. 2014. Remote Handshaking: Touch Enhances Video-Mediated Social Telepresence. Proc. CHI2014. pp.2143-2152. https://doi.org/10.1145/2556288.2557169
[4]
Angela Chang, Sile O'Modhrain, Rob Jacob, Eric Gunther, Hiroshi Ishii. 2002. ComTouch: A Vibrotactile Communication Device. Proc. DIS2002. pp.312–320. https://doi.org/10.1145/778712.778755
[5]
Kazi Masudul Alam, Abdulmotaleb El Saddik, Sandro Hardy, Aysha Akther. 2011. SMS Text Based Affective Haptic Application. Proc. VRIC2011.
[6]
Masahiro Furukawa, Hiroyuki Kajimoto, Susumu Tachi. 2012. KUSUGURI: A Shared Tactile Interface for Bidirectional Tickling. Proc. AH2012. https://doi.org/10.1145/2160125.2160134
[7]
Jocelyn Smith, Karon MacLean. 2007. Communicating emotion through a haptic link: Design space and methodology. International Journal of Human-Computer Studies. Vol.65, No.4, pp.376-387. https://doi.org/10.1016/j.ijhcs.2006.11.006
[8]
Scott Brave, Hiroshi Ishii, Andrew Dahley. 1998. Tangible Interfaces for Remote Collaboration and Communication. Proc.CSCW1998, pp.169-178. https://doi.org/10.1145/289444.289491
[9]
Katja Suhonen, Kaisa Vaananen-Vainio-Mattila, Kalle Makela. 2012. User Experiences and Expectations of Vibrotactile, Thermal and Squeeze Feedback in Interpersonal Communication. Proc. BCS-HCI2012. pp.205-214. https://doi.org/10.14236/ewic/HCI2012.26
[10]
Rongrong Wang, Francis Quek. 2010. Touch & Talk: Contextualizing Remote Touch for Affective Interaction. Proc. TEI2010. pp.13-20. https://doi.org/10.1145/1709886.1709891
[11]
Young-Woo Park, Kyoung-Min Baek, Tek-Jin Nam. 2013. The Roles of Touch during Phone Conversations: Long-Distance Couples’ Use of POKE in Their Homes. Proc. CHI2013. pp.1679-1688. https://doi.org/10.1145/2470654.2466222
[12]
Jeremy N. Bailenson, Nick Yee, Scott Brave, Dan Merget, David Koslow. 2007. Virtual Interpersonal Touch: Expressing and Recognizing Emotions Through Haptic Devices. Human-Computer Interaction. Vol.22, No.3, pp.325–353. https://doi.org/10.1080/07370020701493509
[13]
Matthew J Hertenstein, Rachel Holmes, Margaret McCullough, Dacher Keltner. 2009. The Communication of Emotion via Touch. Emotion. Vol.9, No.4, pp.566-573. https://doi.org/10.1037/a0016108
[14]
Svetlana Yarosh, Kenya Mejia, Baris Unver, Xizi Wang, Yuan Yao, Akin Campbell, Brad Holschuh. 2017. SqueezeBands: Mediated Social Touch Using Shape Memory Alloy Actuation. Proc. ACM on Human-Computer Interaction. https://doi.org/10.1145/3134751
[15]
Hooman Aghaebrahimi Samani, Rahul Parsani, Lenis Tejada Rodriguez, Elham Saadatian, Kumudu Harshadeva Dissanayake, Adrian David Cheok. 2012. Kissenger: Design of a Kiss Transmission Device. Proc. DIS2012. pp.48-57. https://doi.org/10.1145/2317956.2317965
[16]
Adrian David Cheok, Emma Yann Zhang. Electrical machine for remote kissing, and engineering measurement of its remote communication effects, including modified Turing test. Journal of Future Robot Life. Vol.1, No.1, pp.111-134. 2020. https://doi.org/10.3233/FRL-200006
[17]
Frank Vetere, eMartin R. Gibbs, Jesper Kjeldskov, Steve Howard, Florian F. Mueller, Sonja Pedell, Karen Mecoles, Marcus Bunyan. 2005. Mediating Intimacy: Designing Technologies to Support Strong-Tie Relationships. Proc. CHI2005. pp.471-480. https://doi.org/10.1145/1054972.1055038
[18]
Osamu Morikawa, Sayuri Hashimoto, Tsunetsugu Munakata, Junzo Okunaka. 2006. Embrace System for Remote Counseling. Proc. ICMI2006. pp.318-325. https://doi.org/10.1145/1180995.1181055
[19]
James Keng Soon Teh, Adrian David Cheok, Roshan L. Peiris, Yongsoon Choi, Vuong Thuong, Sha Lai: Huggy Pajama. 2008. A Mobile Parent and Child Hugging Communication System. Proc. IDC2008. pp.250-257. https://doi.org/10.1145/1463689.1463763
[20]
Longyu Zhang, Jamal Saboune, Abdulmotaleb El Saddik. 2015. Development of a haptic video chat system. Multimed Tools Appl 74. pp.5489–5512. https://doi.org/10.1007/s11042-014-1865-x
[21]
Hidenobu Sumioka, Aya Nakae, Ryota Kanai, Hiroshi Ishiguro. 2013. Huggable communication medium decreases cortisol levels. Scientific Reports. Vol.3, No.1. https://doi.org/10.1038/srep03034
[22]
Sara E. Rimm-Kaufman, Jerome Kagan. 1996. The Psychological Significance of Changes in Skin Temperature. Motivation and Emotion. Vol.20, pp.63-78. https://doi.org/10.1007/BF02251007
[23]
Sari M. van Anders, Katherine L. Goldey, Patty X. Kuo. 2011. The Steroid/Peptide Theory of Social Bonds: Integrating Testosterone and Peptide Responses for Classifying Social Behavioral Contexts. Psychoneuroendocrinology. Vol.36, No.9, pp.1265-1275. https://doi.org/10.1016/j.psyneuen.2011.06.001
[24]
Valerian J. Derlega, Robin J. Lewis, Scott Harrison, Barbara A. Winstead, Robert Costanza. 1989. Gender differences in the initiation and attribution of tactile intimacy. Journal of Nonverbal Behavior. Vol.13, No.2, pp.83-96. https://doi.org/10.1007/BF00990792
[25]
James C. McCroskey, J. Elaine Baer. 1985. Willingness to Communicate: The Construct and Its Measurement. Proc. the Annual Meeting of the Speech Communication Association.
[26]
Naoki Koyama, Kazuaki Tanaka, Kohei Ogawa, Hiroshi Ishiguro. 2017. Emotional or Social?: How to Enhance Human-Robot Social Bonding. Proc. HAI2017. pp.203–211. https://doi.org/10.1145/3125739.3125742
[27]
Kazuaki Tanaka, Hideyuki Nakanishi, Hiroshi Ishiguro. 2015. Physical Embodiment Can Produce Robot Operator's Pseudo Presence. Frontiers in ICT. Vol.2, No.8. https://doi.org/10.3389/fict.2015.00008
[28]
Masahiro Mori, Karl F. MacDorman, Norri Kageki. 2012. The Uncanny Valley. IEEE Robotics and Automation Magazine. Vol.19, No.2, pp.98-100. https://doi.org/10.1109/MRA.2012.2192811

Cited By

View all
  • (2024)ChiParCo and ParChiCo: Connecting Children and Parents Remotely With Tailored Tangible Communication ToolsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655803(424-435)Online publication date: 17-Jun-2024

Index Terms

  1. Robot Mediated Handholding Combined with a Mobile Video Call Makes the Users Feel Nearer and Closer
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    HAI '21: Proceedings of the 9th International Conference on Human-Agent Interaction
    November 2021
    447 pages
    ISBN:9781450386203
    DOI:10.1145/3472307
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 November 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Handholding
    2. Robotic hand
    3. Social bonding
    4. Social touch
    5. Telepresence

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    HAI '21
    Sponsor:
    HAI '21: International Conference on Human-Agent Interaction
    November 9 - 11, 2021
    Virtual Event, Japan

    Acceptance Rates

    Overall Acceptance Rate 121 of 404 submissions, 30%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)134
    • Downloads (Last 6 weeks)28
    Reflects downloads up to 10 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)ChiParCo and ParChiCo: Connecting Children and Parents Remotely With Tailored Tangible Communication ToolsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655803(424-435)Online publication date: 17-Jun-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media