article

Free access

The role of verbal and nonverbal communication in a two-person, cooperative manipulation task

Authors:

Sarangi P. Parikh,

Joel M. Esposito,

Jeremy SearockAuthors Info & Claims

Advances in Human-Computer Interaction, Volume 2014

Article No.: 9, Page 9

https://doi.org/10.1155/2014/375105

Published: 01 January 2014 Publication History

PDF eReader Publisher Site

Abstract

Motivated by the differences between human and robot teams, we investigated the role of verbal communication between human teammates as they work together to move a large object to a series of target locations. Only one member of the group was told the target sequence by the experimenters, while the second teammate had no target knowledge. The two experimental conditions we compared were haptic-verbal (teammates are allowed to talk) and haptic only (no talking allowed). The team's trajectory was recorded and evaluated. In addition, participants completed a NASA TLX-style postexperimental survey which gauges workload along 6 different dimensions. In our initial experiment we found no significant difference in performance when verbal communication was added. In a follow-up experiment, using a different manipulation task, we did find that the addition of verbal communication significantly improved performance and reduced the perceived workload. In both experiments, for the haptic-only condition, we found that a remarkable number of groups independently improvised common haptic communication protocols (CHIPs). We speculate that such protocols can be substituted for verbal communication and that the performance difference between verbal and nonverbal communication may be related to how easy it is to distinguish the CHIPs from motions required for task completion.

References

[1]

J. Y. S. Luh and Y. F. Zheng, "Constrained relations between two coordinated industrial robots for motion control," International Journal of Robotics Research, vol. 6, no. 3, pp. 60-70, 1987.

Digital Library

[2]

Y. Kume, Y. Hirata, Z.-D. Wang, and K. Kosuge, "Decentralized control of multiple mobile manipulators handling a single object in coordination," in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 2758-2763, October 2002.

[3]

V. Hayward, O. R. Astley, M. Cruz-Hernandez, D. Grant, and G. Robles-De-La-Torre, "Haptic interfaces and devices," Sensor Review, vol. 24, no. 1, pp. 16-29, 2004.

[4]

A. M. Okamura, C. Richard, and M. R. Cutkosky, "Feeling is believing: using a force-feedback joystick to teach dynamic systems," Journal of Engineering Education, vol. 91, no. 3, pp. 345-349, 2002.

[5]

C. Schäfer and R. Dillmann, "Haptic display for human interaction with virtual dynamic environments," Journal of Robotic Systems, vol. 18, no. 12, pp. 769-783, 2001.

[6]

T. G. Sugar and V. Kumar, "Control of cooperating mobile manipulators," IEEE Transactions on Robotics and Automation, vol. 18, no. 1, pp. 94-103, 2002.

[7]

J. Moll and E. L. Sallnas, "Communicative functions of haptic feedback," in Proceedings of the 4th International Conference on Haptic and Audio Interaction Design, pp. 1-10, Dresden, Germany, September 2009.

Digital Library

[8]

E. L. Sallnas, K. Rassmus-Grohn, and D. C. Sjostrom, "Supporting presence in collaborative environments by haptic force feedback," ACM Transactions on Computer-Human Interaction, vol. 7, no. 4, pp. 461-476, 2000.

Digital Library

[9]

E. L. Sallnas, "Improved precision in mediated collaborative manipulation of objects by haptic force feedback," Proceedings of the 1st International Workshop on Haptic Human-Computer Interaction, pp. 69-75, 2001.

Digital Library

[10]

S. J. Glynn, R. Fekieta, and R. A. Henning, "Use of force-feedback joysticks to promote teamwork in virtual teleoperation," in Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, pp. 1911-1915, October 2001.

[11]

R. Groten, D. Feth, R. L. Klatzky, and A. Peer, "The role of haptic feedback for the integration of intentions in shared task execution," IEEE Transactions on Haptics, vol. 6, no. 1, pp. 94-105, 2013.

Digital Library

[12]

K. Reed, "Cooperative physical human-human and human-robot interaction," in Immersive Multimodal Interactive Presence, A. Peer and C. Giachritsis, Eds., Springer Series on Touch and Haptic Systems, pp. 105-127, Springer, 2012.

[13]

R. Ikeura and H. Inooka, "Cooperative force control in carrying an object by two humans," in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, pp. 2307-2311, October 1995.

[14]

C. Bubb-Lewis and M. W. Scerbo, "The effects of communication modes on performance and discourse organization with an adaptive interface," Applied Ergonomics, vol. 33, no. 1, pp. 15-26, 2002.

[15]

L. Le Bigot, J. Rouet, and E. Jamet, "Effects of speech-and text-based interaction modes in natural language human-computer dialogue," Human Factors, vol. 49, no. 6, pp. 1045-1053, 2007.

[16]

E. L. Sallnas and S. Zhai, "Collaboration meets fitts law: passing virtual objects with and without haptic force feedback," in Proceedings of IFIP Conference on Human-Computer Interaction (INTERACT '03), pp. 97-104, 2003.

[17]

R. Groten, J. Hölldampf, A. Peer, and M. Buss, "Predictability of a human partner in a pursuit tracking task without haptic feedback," in Proceedings of the 2nd International Conferences on Advances in Computer-Human Interactions (ACHI '09), pp. 63-68, Cancún, Mexico, February 2009.

Digital Library

[18]

C. Basdogan, C. H. Ho, and M. A. Srinivasan, "An experimental study on the role of touch in shared virtual environments," ACM Transactions on Computer-Human Interaction, vol. 7, no. 4, pp. 443-460, 2000.

Digital Library

[19]

K. B. Reed and M. A. Peshkin, "Physical collaboration of human-human and human-robot teams," IEEE Transactions on Haptics, vol. 1, no. 2, pp. 108-120, 2008.

Digital Library

[20]

S. Gentry, E. Feron, and R. Murray-Smith, "Human-human haptic collaboration in cyclical Fitts' tasks," in Proceedings of the IEEE IRS/RSJ International Conference on Intelligent Robots and Systems, pp. 3402-3407, August 2005.

[21]

M. M. Rahman, R. Ikeura, and K. Mizutani, "Control characteristics of two humans in cooperative task and its application to robot control," in Proceedings of the 26th Annual Conference of the IEEE Electronics Society (IECON '00), pp. 1773-1778, Nagoya, Japan, October 2000.

[22]

Y. Y. Huang, J. Moll, E. Sallnäs, and Y. Sundblad, "Auditory feedback in haptic collaborative interfaces," International Journal of Human Computer Studies, vol. 70, no. 4, pp. 257-270, 2012.

Digital Library

[23]

D. A. Kenny, C. D. Mohr, and M. J. Levesque, "A social relations variance partitioning of dyadic behavior," Psychological Bulletin, vol. 127, no. 1, pp. 128-141, 2001.

[24]

R. Groten, D. Feth, H. Goshy, A. Peer, D. A. Kenny, and M. Buss, "Experimental analysis of dominance in haptic collaboration," in Proceedings of the 18th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN'09), pp. 723-729, Toyama, Japan, October 2009.

[25]

S. S. Nudehi, R. Mukherjee, and M. Ghodoussi, "A shared-control approach to haptic interface design for minimally invasive telesurgical training," IEEE Transactions on Control Systems Technology, vol. 13, no. 4, pp. 588-592, 2005.

[26]

B. Khademian and K. Hashtrudi-Zaad, "Performance issues in collaborative haptic training," in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'07), pp. 3257-3262, Roma, Italy, April 2007.

[27]

K. Kosuge, H. Yoshida, and T. Fukuda, "Dynamic control for robot-human collaboration," in Proceedings of the IEEE International Workshop on Robot and Human Communication, pp. 398-401, 1993.

[28]

R. Ikeura and H. Inooka, "Variable impedance control of a robot for cooperation with a human," in Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3097-3102, May 1995.

[29]

H. Arai, T. Takubo, Y. Hayashibara, and K. Tanie, "Human-robot cooperative manipulation using a virtual nonholonomic constraint," in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '00), pp. 4063-4069, April 2000.

[30]

S. Abu Bakar, R. Ikeura, Y. Handa, T. Yano, K. Mizutani, and H. Sawai, "Communication during the cooperative motion in the task of carrying an object between two humans," Journal of Biomechanical Science and Engineering, vol. 5, no. 2, pp. 104-118, 2010.

[31]

S. G. Hart and L. E. Staveland, "Development of NASA-TLX (Task Load Index): results of empirical and theoretical research," Advances in Psychology, vol. 52, pp. 139-183, 1988.

[32]

K. Ogata, Modern Control Engineering, Prentice Hall, Upper Saddle River, NJ, USA, 3rd edition, 1997.

Digital Library

Cited By

Camarillo-Abad HSánchez JStarostenko O(2020)An environment for motor skill transfer based on wearable haptic communicationPersonal and Ubiquitous Computing10.1007/s00779-020-01425-z25:2(411-435)Online publication date: 29-Jun-2020
https://dl.acm.org/doi/10.1007/s00779-020-01425-z
Nikolaidis SKwon MForlizzi JSrinivasa S(2018)Planning with Verbal Communication for Human-Robot CollaborationACM Transactions on Human-Robot Interaction10.1145/32033057:3(1-21)Online publication date: 16-Nov-2018
https://dl.acm.org/doi/10.1145/3203305

The role of verbal and nonverbal communication in a two-person, cooperative manipulation task
1. Human-centered computing

Recommendations

Verbal communication during cooperative object manipulation
CVE '02: Proceedings of the 4th international conference on Collaborative virtual environments

Cooperation between multiple users in a virtual environment (VE) can take place at one of three levels, but it is only at the highest level that users can simultaneously interact with the same object. This paper describes a study in a straightforward ...
Changes in verbal and nonverbal conversational behavior in long-term interaction
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction

We present an empirical investigation of conversational behavior in dyadic interaction spanning multiple conversations, in the context of a developing interpersonal relationship between a health counselor and her clients. Using a longitudinal video ...
Multimodal Collaboration in Expository Discourse: Verbal and Nonverbal Moves Alignment
Speech and Computer
Abstract
The paper explores multimodal collaboration in expository discourse considering verbal and nonverbal moves used by the participants in turn-taking. It reports the results of an experiment which tested speech, gesture and gaze alignment as affected ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Advances in Human-Computer Interaction

Advances in Human-Computer Interaction Volume 2014, Issue

January 2014

212 pages

ISSN:1687-5893

EISSN:1687-5907

Issue’s Table of Contents

Publisher

Hindawi Limited

London, United Kingdom

Publication History

Accepted: 22 May 2014

Revised: 22 May 2014

Published: 01 January 2014

Received: 30 December 2013

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
107
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)6

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Camarillo-Abad HSánchez JStarostenko O(2020)An environment for motor skill transfer based on wearable haptic communicationPersonal and Ubiquitous Computing10.1007/s00779-020-01425-z25:2(411-435)Online publication date: 29-Jun-2020
https://dl.acm.org/doi/10.1007/s00779-020-01425-z
Nikolaidis SKwon MForlizzi JSrinivasa S(2018)Planning with Verbal Communication for Human-Robot CollaborationACM Transactions on Human-Robot Interaction10.1145/32033057:3(1-21)Online publication date: 16-Nov-2018
https://dl.acm.org/doi/10.1145/3203305

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents