research-article

Public Access

“I just shared your responses”: Extending Communication Privacy Management Theory to Interactions with Conversational Agents

Authors:

Dominic DiFranzo,

Natalya N. BazarovaAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 4, Issue GROUP

Article No.: 08, Pages 1 - 18

https://doi.org/10.1145/3375188

Published: 04 January 2020 Publication History

Abstract

Conversational agents are increasingly becoming integrated into everyday technologies and can collect large amounts of data about users. As these agents mimic interpersonal interactions, we draw on communication privacy management theory to explore people's privacy expectations with conversational agents. We conducted a 3x3 factorial experiment in which we manipulated agents' social interactivity and data sharing practices to understand how these factors influence people's judgments about potential privacy violations and their evaluations of agents. Participants perceived agents that shared response data with advertisers more negatively compared to agents that shared such data with only their companies; perceptions of privacy violations did not differ between agents that shared data with their companies and agents that did not share information at all. Participants also perceived the socially interactive agent's sharing practices less negatively than those of the other agents, highlighting a potential privacy vulnerability that users are exposed to in interactions with socially interactive conversational agents.

References

[1]

Walid A Afifi and Sandra Metts. 1998. Characteristics and consequences of expectation violations in close relationships. Journal of Social and Personal Relationships, Vol. 15, 3 (1998), 365--392.

[2]

Anis Allagui and Jean-Francc ois Lemoine. 2007. Web interface and consumers buying intention in e-tailing: Results from an online experiment. ACR European Advances (2007).

[3]

David Atkinson, Peter Hancock, Robert R Hoffman, John D Lee, Ericka Rovira, Charlene Stokes, and Alan R Wagner. 2012. Trust in computers and robots: The uses and boundaries of the analogy to interpersonal trust. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 56. SAGE Publications Sage CA: Los Angeles, CA, 303--307.

[4]

Kelly Caine, Selma vS abanovic, and Mary Carter. 2012. The effect of monitoring by cameras and robots on the privacy enhancing behaviors of older adults. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction. ACM, 343--350.

Digital Library

[5]

Colleen M Carpinella, Alisa B Wyman, Michael A Perez, and Steven J Stroessner. 2017. The robotic social attributes scale (rosas): Development and validation. In Proceedings of the 2017 ACM/IEEE International Conference on human-robot interaction. ACM, 254--262.

Digital Library

[6]

Jeffrey T Child and Sandra Petronio. 2011. Unpacking the paradoxes of privacy in CMC relationships: The challenges of blogging and relational communication on the internet. Computer-mediated communication in personal relationships (2011), 21--40.

[7]

Kate Darling. 2015. 'Who's Johnny?'Anthropomorphic Framing in Human-Robot Interaction, Integration, and Policy. Anthropomorphic Framing in Human-Robot Interaction, Integration, and Policy (March 23, 2015). ROBOT ETHICS, Vol. 2 (2015).

[8]

Ewart J de Visser, Samuel S Monfort, Ryan McKendrick, Melissa AB Smith, Patrick E McKnight, Frank Krueger, and Raja Parasuraman. 2016. Almost human: Anthropomorphism increases trust resilience in cognitive agents. Journal of Experimental Psychology: Applied, Vol. 22, 3 (2016), 331.

[9]

Eun Go. 2015. Does message interactivity help or hinder the effects of anthropomorphic online chat agents? Compensation vs. expectation effects in organizational websites. (2015).

[10]

D. Gowda, K. Cook-Shultz, and E. Mierzwinski. 2018. Trouble In Toyland. https://uspirgedfund.org/sites/pirg/files/cpn/USN-112117-A1-REPORT/trouble-in-toyland-32.html

[11]

Annabell Ho, Jeff Hancock, and Adam S Miner. 2018. Psychological, relational, and emotional effects of self-disclosure after conversations with a chatbot. Journal of Communication, Vol. 68, 4 (2018), 712--733.

[12]

Yifeng Hu and S Shyam Sundar. 2010. Effects of online health sources on credibility and behavioral intentions. Communication research, Vol. 37, 1 (2010), 105--132.

[13]

Ming-Hui Huang. 2003. Designing website attributes to induce experiential encounters. computers in Human Behavior, Vol. 19, 4 (2003), 425--442.

[14]

Jiun-Yin Jian, Ann M Bisantz, and Colin G Drury. 2000. Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics, Vol. 4, 1 (2000), 53--71.

[15]

L Crystal Jiang, Natalya N Bazarova, and Jeffrey T Hancock. 2013. From perception to behavior: Disclosure reciprocity and the intensification of intimacy in computer-mediated communication. Communication Research, Vol. 40, 1 (2013), 125--143.

[16]

Malte F Jung, Jin Joo Lee, Nick DePalma, Sigurdur O Adalgeirsson, Pamela J Hinds, and Cynthia Breazeal. 2013. Engaging robots: easing complex human-robot teamwork using backchanneling. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 1555--1566.

Digital Library

[17]

Peter H Kahn Jr, Takayuki Kanda, Hiroshi Ishiguro, Brian T Gill, Jolina H Ruckert, Solace Shen, Heather E Gary, Aimee L Reichert, Nathan G Freier, and Rachel L Severson. 2012. Do people hold a humanoid robot morally accountable for the harm it causes?. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction. ACM, 33--40.

Digital Library

[18]

Ruogu Kang, Stephanie Brown, Laura Dabbish, and Sara Kiesler. 2014. Privacy attitudes of mechanical turk workers and the us public. In 10th Symposium On Usable Privacy and Security ($$SOUPS$$ 2014). 37--49.

[19]

Matthias U Keysermann, Henriette SM Cramer, Ruth Aylett, Carsten Zoll, Sibylle Enz, and Patr'icia Amâncio Vargas. 2012. Can I trust you?: sharing information with artificial companions. In AAMAS . 1197--1198.

[20]

Jong-Eun Roselyn Lee and Clifford I Nass. 2010. Trust in computers: The computers-are-social-actors (CASA) paradigm and trustworthiness perception in human-computer communication. In Trust and technology in a ubiquitous modern environment: Theoretical and methodological perspectives . IGI Global, 1--15.

[21]

Jin Joo Lee, Fei Sha, and Cynthia Breazeal. 2019. A Bayesian Theory of Mind Approach to Nonverbal Communication. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 487--496.

[22]

SeoYoung Lee and Junho Choi. 2017. Enhancing user experience with conversational agent for movie recommendation: Effects of self-disclosure and reciprocity. International Journal of Human-Computer Studies, Vol. 103 (2017), 95--105.

Digital Library

[23]

Daniel T Levin, Caroline Harriott, Natalie A Paul, Tao Zhang, and Julie A Adams. 2013. Cognitive dissonance as a measure of reactions to human-robot interaction. Journal of Human-Robot Interaction, Vol. 2, 3 (2013), 3--17.

Digital Library

[24]

Daniel T Levin, Stephen S Killingsworth, and Megan M Saylor. 2008. Concepts about the capabilities of computers and robots: A test of the scope of adults' theory of mind. In 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 57--63.

Digital Library

[25]

Laura H Lind, Michael F Schober, Frederick G Conrad, and Heidi Reichert. 2013. Why do survey respondents disclose more when computers ask the questions? Public opinion quarterly, Vol. 77, 4 (2013), 888--935.

[26]

Bingjie Liu and S Shyam Sundar. 2018. Should Machines Express Sympathy and Empathy? Experiments with a Health Advice Chatbot. Cyberpsychology, Behavior, and Social Networking, Vol. 21, 10 (2018), 625--636.

[27]

Max M Louwerse, Arthur C Graesser, Shulan Lu, and Heather H Mitchell. 2005. Social cues in animated conversational agents. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition, Vol. 19, 6 (2005), 693--704.

[28]

Gale M Lucas, Jonathan Gratch, Aisha King, and Louis-Philippe Morency. 2014. It's only a computer: Virtual humans increase willingness to disclose. Computers in Human Behavior, Vol. 37 (2014), 94--100.

Digital Library

[29]

Christoph Lutz and Aurelia Tamò. 2015. RoboCode-Ethicists: Privacy-friendly robots, an ethical responsibility of engineers?. In Proceedings of the ACM Web Science Conference . ACM, 21.

Digital Library

[30]

Aleecia M McDonald and Lorrie Faith Cranor. 2008. The cost of reading privacy policies. ISJLP, Vol. 4 (2008), 543.

[31]

Yasunori Morishima, Hiroshi Nakajima, Scott Brave, Ryota Yamada, Heidy Maldonado, Clifford Nass, and Shigeyasu Kawaji. 2004. The role of affect and sociality in the agent-based collaborative learning system. In Tutorial and Research Workshop on Affective Dialogue Systems. Springer, 265--275.

[32]

Clifford Nass, Jonathan Steuer, Ellen Tauber, and Heidi Reeder. 1993. Anthropomorphism, agency, and ethopoeia: computers as social actors. In INTERACT'93 and CHI'93 conference companion on Human factors in computing systems. ACM, 111--112.

Digital Library

[33]

Clifford Nass, Jonathan Steuer, and Ellen R Tauber. 1994. Computers are social actors. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 72--78.

Digital Library

[34]

Clifford Nass, Leila Takayama, and Scott Brave. 2006. Advances in Management Information Systems, chapter Socializing Consistency: From Technical Homogeneity to Human Epitome. (2006).

[35]

Amy Ogan, Vincent Aleven, Julia Kim, and Christopher Jones. 2010. Developing interpersonal relationships with virtual agents through social instructional dialog. In International Conference on Intelligent Virtual Agents. Springer, 236--249.

[36]

S Petronio. 2002. Boundaries of Privacy: Dialectics of Disclosure (State University of New York Press, Albany, NY). (2002).

[37]

Sheizaf Rafaeli. 1988. Interactivity: From new media to communication. Advancing communication science: Sage annual review of communication research, Vol. 16 (1988), 110--134.

[38]

L Raine. 2016. The state of privacy in post- Snowden America. http://www.pewresearch.org/

[39]

Paul Robinette, Wenchen Li, Robert Allen, Ayanna M Howard, and Alan R Wagner. 2016. Overtrust of robots in emergency evacuation scenarios. In The Eleventh ACM/IEEE International Conference on Human Robot Interaction. IEEE Press, 101--108.

Digital Library

[40]

Oscar J Romero, Ran Zhao, and Justine Cassell. 2017. Cognitive-Inspired Conversational-Strategy Reasoner for Socially-Aware Agents. In IJCAI . 3807--3813.

[41]

Shruti Sannon and Dan Cosley. 2019. Privacy, Power, and Invisible Labor on Amazon Mechanical Turk. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 282.

Digital Library

[42]

S Shyam Sundar. 2008. The MAIN model: A heuristic approach to understanding technology effects on credibility. Digital media, youth, and credibility, Vol. 73100 (2008).

[43]

Dag Sverre Syrdal, Michael L Walters, Nuno Otero, Kheng Lee Koay, and Kerstin Dautenhahn. 2007. He knows when you are sleeping-privacy and the personal robot companion. In Proc. Workshop Human Implications of Human-Robot Interaction, Association for the Advancement of Artificial Intelligence (AAAI'07). 28--33.

[44]

Roger Tourangeau, Mick P Couper, and Darby M Steiger. 2003. Humanizing self-administered surveys: experiments on social presence in web and IVR surveys. Computers in Human Behavior, Vol. 19, 1 (2003), 1--24.

[45]

Vivian Tsai, Timo Baumann, Florian Pecune, and Justine Cassell. 2019. Faster responses are better responses: Introducing incrementality into sociable virtual personal assistants. In 9th International Workshop on Spoken Dialogue System Technology. Springer, 111--118.

[46]

Astrid M Von der Puetten, Nicole C Kr"amer, Jonathan Gratch, and Sin-Hwa Kang. 2010. It doesn't matter what you are! Explaining social effects of agents and avatars. Computers in Human Behavior, Vol. 26, 6 (2010), 1641--1650.

Digital Library

[47]

Liz C Wang, Julie Baker, Judy A Wagner, and Kirk Wakefield. 2007. Can a retail web site be social? Journal of marketing, Vol. 71, 3 (2007), 143--157.

[48]

Yang Wang, Pedro Giovanni Leon, Alessandro Acquisti, Lorrie Faith Cranor, Alain Forget, and Norman Sadeh. 2014. A field trial of privacy nudges for facebook. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2367--2376.

Digital Library

[49]

Susan Waters and James Ackerman. 2011. Exploring privacy management on Facebook: Motivations and perceived consequences of voluntary disclosure. Journal of Computer-Mediated Communication, Vol. 17, 1 (2011), 101--115.

[50]

Suzanne Weisband and Sara Kiesler. 1996. Self disclosure on computer forms: Meta-analysis and implications. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 3--10.

Digital Library

[51]

Heng Xu, Hock-Hai Teo, and Bernard Tan. 2005. Predicting the adoption of location-based services: the role of trust and perceived privacy risk. ICIS 2005 proceedings (2005), 71.

[52]

Ran Zhao, Alexandros Papangelis, and Justine Cassell. 2014. Towards a dyadic computational model of rapport management for human-virtual agent interaction. In International Conference on Intelligent Virtual Agents. Springer, 514--527.

[53]

Youyou Zhou. 2018. An Oregon family's encounter with Amazon Alexa exposes the privacy problem of smart home devices. https://qz.com/1288743/amazon-alexa-echo-spying-on-users-raises-a-data-privacy-problem/

Cited By

Chen JLu XDu YRejtig MBagley RHorn MWilensky U(2024)Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo ChatProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642377(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642377
Asthana SIm JChen ZBanovic N(2024)"I know even if you don't tell me": Understanding Users' Privacy Preferences Regarding AI-based Inferences of Sensitive Information for PersonalizationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642180(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642180
Chen YWu XJia FYang JBai XYu R(2024)Exploring the Impact of Social Robot Design Characteristics on Users’ Privacy Concerns: Evidence from PLS-SEM and FsQCAInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2402126(1-22)Online publication date: 17-Sep-2024
https://doi.org/10.1080/10447318.2024.2402126
Show More Cited By

Index Terms

“I just shared your responses”: Extending Communication Privacy Management Theory to Interactions with Conversational Agents
1. Security and privacy
  1. Human and societal aspects of security and privacy

Recommendations

What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Conversational agents promise conversational interaction but fail to deliver. Efforts often emulate functional rules from human speech, without considering key characteristics that conversation must encapsulate. Given its potential in supporting long-...
Preserving Genomic Privacy via Selective Sharing
WPES'20: Proceedings of the 19th Workshop on Privacy in the Electronic Society

Although genomic data has significant impact and widespread usage in medical research, it puts individuals' privacy in danger, even if they anonymously or partially share their genomic data. To address this problem, we present a framework that is ...
Privacy-preserving data sharing in cloud computing

Storing and sharing databases in the cloud of computers raise serious concern of individual privacy. We consider two kinds of privacy risk: presence leakage, by which the attackers can explicitly identify individuals in (or not in) the database, and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 4, Issue GROUP

GROUP

January 2020

405 pages

EISSN:2573-0142

DOI:10.1145/3378060

Editors:
Cliff Lampe
University of Michigan
,
Jeff Nichols
Google
,
Karrie Karahalios
University of Illinois Urbana-Champaign
,
Geraldine Fitzpatrick
Vienna University of Technology
,
Uichin Lee
KAIST
,
Andres Monroy-Hernandez
Microsoft Research
,
Wolfgang Stuerzlinger
Simon Fraser University, Canada

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 January 2020

Published in PACMHCI Volume 4, Issue GROUP

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
1,672
Total Downloads

Downloads (Last 12 months)362
Downloads (Last 6 weeks)40

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen JLu XDu YRejtig MBagley RHorn MWilensky U(2024)Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo ChatProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642377(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642377
Asthana SIm JChen ZBanovic N(2024)"I know even if you don't tell me": Understanding Users' Privacy Preferences Regarding AI-based Inferences of Sensitive Information for PersonalizationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642180(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642180
Chen YWu XJia FYang JBai XYu R(2024)Exploring the Impact of Social Robot Design Characteristics on Users’ Privacy Concerns: Evidence from PLS-SEM and FsQCAInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2402126(1-22)Online publication date: 17-Sep-2024
https://doi.org/10.1080/10447318.2024.2402126
Dubiel MBarghouti YKudryavtseva KLeiva L(2024)On-device query intent prediction with lightweight LLMs to support ubiquitous conversationsScientific Reports10.1038/s41598-024-63380-614:1Online publication date: 3-Jun-2024
https://doi.org/10.1038/s41598-024-63380-6
Cai RWang YSun J(2024)Customers’ intention to compliment and complain via AI-enabled platforms: A self-disclosure perspectiveInternational Journal of Hospitality Management10.1016/j.ijhm.2023.103628116(103628)Online publication date: Jan-2024
https://doi.org/10.1016/j.ijhm.2023.103628
Gumusel E(2024)A literature review of user privacy concerns in conversational chatbots: A social informatics approach: An Annual Review of Information Science and Technology (ARIST) paperJournal of the Association for Information Science and Technology10.1002/asi.24898Online publication date: 9-May-2024
https://doi.org/10.1002/asi.24898
Seymour WZhan XCoté MSuch J(2023)A Systematic Review of Ethical Concerns with Voice AssistantsProceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society10.1145/3600211.3604679(131-145)Online publication date: 8-Aug-2023
https://dl.acm.org/doi/10.1145/3600211.3604679
Seymour WSuch J(2023)Ignorance is Bliss? The Effect of Explanations on Perceptions of Voice AssistantsProceedings of the ACM on Human-Computer Interaction10.1145/35794977:CSCW1(1-24)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579497
Windl MWinterhalter VSchmidt AMayer S(2023)Understanding and Mitigating Technology-Facilitated Privacy Violations in the Physical WorldProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580909(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580909
Liu YYan WHu BLin ZSong Y(2023)Chatbots or Humans? Effects of Agent Identity and Information Sensitivity on Users’ Privacy Management and Behavioral Intentions: A Comparative Experimental Study between China and the United StatesInternational Journal of Human–Computer Interaction10.1080/10447318.2023.223897440:19(5632-5647)Online publication date: 14-Aug-2023
https://doi.org/10.1080/10447318.2023.2238974
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents