research-article

Effects of changing reliability on trust of robot systems

Authors:

Mikhail Medvedev,

Marynel Vázquez,

Sofia Gadea-Omelchenko,

Christian Bruggeman,

Aaron Steinfeld,

Holly YancoAuthors Info & Claims

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

Pages 73 - 80

https://doi.org/10.1145/2157689.2157702

Published: 05 March 2012 Publication History

Abstract

Prior work in human-autonomy interaction has focused on plant systems that operate in highly structured environments. In contrast, many human-robot interaction (HRI) tasks are dynamic and unstructured, occurring in the open world. It is our belief that methods developed for the measurement and modeling of trust in traditional automation need alteration in order to be useful for HRI. Therefore, it is important to characterize the factors in HRI that influence trust. This study focused on the influence of changing autonomy reliability. Participants experienced a set of challenging robot handling scenarios that forced autonomy use and kept them focused on autonomy performance. The counterbalanced experiment included scenarios with different low reliability windows so that we could examine how drops in reliability altered trust and use of autonomy. Drops in reliability were shown to affect trust, the frequency and timing of autonomy mode switching, as well as participants' self-assessments of performance. A regression analysis on a number of robot, personal, and scenario factors revealed that participants tie trust more strongly to their own actions rather than robot performance.

References

[1]

H. Atoyan, J. Duquet, and J. Robert. Trust in new decision aid systems. In Proceedings of the 18th Int'l Conference of the Association Francophone d'Interaction Homme-Machine, page 122. ACM, 2006.

Digital Library

[2]

I. Dassonville, D. Jolly, and A. Desodt. Trust between man and machine in a teleoperation system. Reliability Engineering & Systems Safety, 53(3):319--325, 1996.

[3]

P. deVries, C. Midden, and D. Bouwhuis. The effects of errors on system trust, self-confidence, and the allocation of control in route planning. Int'l Journal of Human-Computer Studies, 58(6):719--735, 2003.

Digital Library

[4]

M. Dzindolet, S. Peterson, R. Pomranky, L. Pierce, and H. Beck. The role of trust in automation reliance. Int'l Journal of Human-Computer Studies, 58(6):697--718, 2003.

Digital Library

[5]

M. Dzindolet, L. Pierce, H. Beck, and L. Dawe. The perceived utility of human and automated aids in a visual detection task. Human Factors: The Journal of the Human Factors and Ergonomics Society, 44(1):79, 2002.

[6]

A. Freedy, E. DeVisser, and G. Weltman. Measurement of trust in human-robot collaboration. Collaborative Technologies and Systems, Jan 2007.

[7]

P. Hancock, D. Billings, K. Schaefer, J. Chen, E. de Visser, and R. Parasuraman. A meta-analysis of factors affecting trust in human-robot interaction. Human Factors: The Journal of the Human Factors and Ergonomics Society, 53(5):517--527, 2011.

[8]

D. Harville. Maximum likelihood approaches to variance component estimation and to related problems. Journal of the American Statistical Association, pages 320--338, 1977.

[9]

J. Jian, A. Bisantz, and C. Drury. Foundations for an empirically determined scale of trust in automated systems. Int'l Journal of Cognitive Ergonomics, 4(1):53--71, 2000.

[10]

J. Lee and N. Moray. Trust, self-confidence and supervisory control in a process control simulation. IEEE Int'l Conference on Systems, Man, and Cybernetics, pages 291--295, 1991.

[11]

J. Lee and N. Moray. Trust, control strategies and allocation of function in human-machine systems. Ergonomics, 1992.

[12]

J. Lee and N. Moray. Trust, self-confidence, and operators' adaptation to automation. Int'l Journal of Human-Computer Studies, 40(1):153--184, 1994.

Digital Library

[13]

J. Lee and K. See. Trust in automation: designing for appropriate reliance. Human Factors, 46:50--80, 2004.

[14]

C. Liu and S. Hwang. Evaluating the effects of situation awareness and trust with robust design in automation. Int'l Journal of Cognitive Ergonomics, 4(2):125--144, 2000.

[15]

D. H. McKnight, V. Choudhury, and C. Kacmar. The impact of initial consumer trust on intentions to transact with a web site: a trust building model. Journal of Strategic Information Systems, 11(3--4):297--323, 2002.

[16]

B. Muir. Trust between humans and machines, and the design of decision aids. Int'l Journal of Man-Machine Studies, 27(5--6):527--539, 1987.

Digital Library

[17]

B. Muir. Operators' trust in and use of automatic controllers in a supervisory process control task. PhD thesis, University of Toronto, 1990.

[18]

B. Mutlu and J. Forlizzi. Robots in organizations: the role of workflow, social, and environmental factors in human-robot interaction. In HRI '08: Proceedings of the 3rd ACM/IEEE Int'l Conference on Human Robot Interaction, pages 287--294, New York, NY, USA, 2008. ACM.

Digital Library

[19]

R. Parasuraman and V. Riley. Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2):230--253, 1997.

[20]

M. Rehak, L. Foltyn, M. Pechoucek, and P. Benda. Trust model for open ubiquitous agent systems. In IEEE/WIC/ACM Int'l Conference on Intelligent Agent Technology, pages 536--542, 2005.

Digital Library

[21]

V. Riley. Operator reliance on automation: Theory and data. Automation and Human Performance: Theory and Applications, pages 19--35, 1996.

[22]

J. Sanchez. Factors that affect trust and reliance on an automated aid. PhD thesis, Georgia Institute of Technology, 2006.

[23]

W. Song, V. Phoha, and X. Xu. An adaptive recommendation trust model in multiagent system. Published by the IEEE Computer Society, 2004.

Digital Library

Cited By

Stower RGautier AWozniak MJensfelt PTumova JLeite IJohal WLemaignan SBrščić DVázquez MCharisi V(2025)Take a Chance on Me: How Robot Performance and Risk Behaviour Affects Trust and Risk-takingProceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3721488.3721539(391-399)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.5555/3721488.3721539
Becker DBraach LClasmeier LKaufmann TOng OAhrens KGäde CStrahl EFu DWermter S(2025)Influence of Robots’ Voice Naturalness on Trust and ComplianceACM Transactions on Human-Robot Interaction10.1145/370606614:2(1-25)Online publication date: 28-Jan-2025
https://dl.acm.org/doi/10.1145/3706066
Siqueira AYao HBloch-Elkouby SRogers MLawrence OPeterkin DZheng SFeeney KMusser EGalynker ILok B(2024)Effects of Nonsensical Responses in Virtual Human Simulations on Clinicians’ Empathic Communication and Emotional ResponsesJournal of the Brazilian Computer Society10.5753/jbcs.2024.466530:1(554-568)Online publication date: 28-Oct-2024
https://doi.org/10.5753/jbcs.2024.4665
Show More Cited By

Index Terms

Effects of changing reliability on trust of robot systems
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Would You Trust a (Faulty) Robot?: Effects of Error, Task Type and Personality on Human-Robot Cooperation and Trust
HRI '15: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction

How do mistakes made by a robot affect its trustworthiness and acceptance in human-robot collaboration? We investigate how the perception of erroneous robot behavior may influence human interaction choices and the willingness to cooperate with the robot ...
Toward an Understanding of Trust Repair in Human-Robot Interaction: Current Research and Future Directions

Gone are the days of robots solely operating in isolation, without direct interaction with people. Rather, robots are increasingly being deployed in environments and roles that require complex social interaction with humans. The implementation of human-...
Human-Robot Trust: Just a Button Press Away
HRI '17: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction

Many of the benefits promised by human-robot interaction require successful continued interaction between a human and a robot; trust is a key component of such interaction. We investigate whether having a person "n the loop" with a robot---i.e., the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

March 2012

518 pages

ISBN:9781450310635

DOI:10.1145/2157689

General Chairs:
Holly Yanco
University of Massachusetts Lowell, USA
,
Aaron Steinfeld
Carnegie Mellon University, USA
,
Program Chairs:
Vanessa Evers
University of Amsterdam, The Netherlands
,
Odest Chadwicke Jenkins
Brown University, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

IEEE-RAS: Robotics and Automation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI'12

Sponsor:

HRI'12: International Conference on Human-Robot Interaction

March 5 - 8, 2012

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

140
Total Citations
View Citations
1,105
Total Downloads

Downloads (Last 12 months)176
Downloads (Last 6 weeks)14

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Stower RGautier AWozniak MJensfelt PTumova JLeite IJohal WLemaignan SBrščić DVázquez MCharisi V(2025)Take a Chance on Me: How Robot Performance and Risk Behaviour Affects Trust and Risk-takingProceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3721488.3721539(391-399)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.5555/3721488.3721539
Becker DBraach LClasmeier LKaufmann TOng OAhrens KGäde CStrahl EFu DWermter S(2025)Influence of Robots’ Voice Naturalness on Trust and ComplianceACM Transactions on Human-Robot Interaction10.1145/370606614:2(1-25)Online publication date: 28-Jan-2025
https://dl.acm.org/doi/10.1145/3706066
Siqueira AYao HBloch-Elkouby SRogers MLawrence OPeterkin DZheng SFeeney KMusser EGalynker ILok B(2024)Effects of Nonsensical Responses in Virtual Human Simulations on Clinicians’ Empathic Communication and Emotional ResponsesJournal of the Brazilian Computer Society10.5753/jbcs.2024.466530:1(554-568)Online publication date: 28-Oct-2024
https://doi.org/10.5753/jbcs.2024.4665
Rahman S(2024)Dynamic Affect-Based Motion Planning of a Humanoid Robot for Human-Robot Collaborative Assembly in ManufacturingElectronics10.3390/electronics1306104413:6(1044)Online publication date: 11-Mar-2024
https://doi.org/10.3390/electronics13061044
Lukovics MPrónay SNagy B(2024)Segmented Trust Assessment in Autonomous Vehicles via Eye-TrackingJournal of Intelligent and Connected Vehicles10.26599/JICV.2023.92100377:2(151-161)Online publication date: Jun-2024
https://doi.org/10.26599/JICV.2023.9210037
Bayer EKühl S(2024)To trust or not to trust? Trust landscape of organic animal husbandry: Mapping consumer attitudes and information demands in GermanyPLOS Sustainability and Transformation10.1371/journal.pstr.00001023:2(e0000102)Online publication date: 29-Feb-2024
https://doi.org/10.1371/journal.pstr.0000102
Holland CPerry GNeyedli H(2024)Calibrating Trust, Reliance and Dependence in Variable-Reliability AutomationProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324127753168:1(604-610)Online publication date: 2-Sep-2024
https://doi.org/10.1177/10711813241277531
Rittenberg BHolland CBarnhart GGaudreau SNeyedli H(2024)Trust with increasing and decreasing reliabilityHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/00187208241228636Online publication date: 6-Mar-2024
https://doi.org/10.1177/00187208241228636
Campagna GRehm M(2024)A Systematic Review of Trust Assessments in Human–Robot InteractionACM Transactions on Human-Robot Interaction10.1145/370612314:2(1-35)Online publication date: 29-Nov-2024
https://dl.acm.org/doi/10.1145/3706123
Hinrichs MBui TSchneegass S(2024)Exploring the Effects of User Input and Decision Criteria Control on Trust in a Decision Support Tool for Spare Parts Inventory ManagementProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701585(313-323)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701585
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten