research-article

Social Boundaries for Personal Agents in the Interpersonal Space of the Home

Authors:

Bennett Huffman,

Shuangni Huang,

John Zimmerman,

Jodi ForlizziAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 12

https://doi.org/10.1145/3313831.3376311

Published: 23 April 2020 Publication History

Abstract

The presence of voice activated personal assistants (VAPAs) in people's homes rises each year [31]. Industry efforts are invested in making interactions with VAPAs more personal by leveraging information from messages and calendars, and by accessing user accounts for 3rd party services. However, the use of personal data becomes more complicated in interpersonal spaces, such as people's homes. Should a shared agent access the information of many users? If it does, how should it navigate issues of privacy and control? Designers currently lack guidelines to help them design appropriate agent behaviors. We used Speed Dating to explore inchoate social mores around agent actions within a home, including issues of proactivity, interpersonal conflict, and agent prevarication. Findings offer new insights on how more socially sophisticated agents might sense, make judgements about, and navigate social roles and individuals. We discuss how our findings might impact future research and future agent behaviors.

Supplementary Material

ZIP File (paper184aux.zip)

The material includes the final set of storyboards used in the study in PDF.

Download
6.35 MB

MP4 File (a184-luria-presentation.mp4)

Download
35.43 MB

References

[1]

Amazon. accessed September 9, 2019. Making Alexa More Friction-Free. https://developer.amazon.com/blogs/alexa/post/ 60e1f011--3236--4162-b0f6--509205d354ca/ making-alexa-more-friction-free

[2]

Emily P Bernier and Brian Scassellati. 2010. The similarity-attraction effect in human-robot interaction. In 2010 IEEE 9th International Conference on Development and Learning. IEEE, 286--290.

[3]

Timothy W Bickmore and Rosalind W Picard. 2005. Establishing and maintaining long-term human-computer relationships. ACM Transactions on Computer-Human Interaction (TOCHI) 12, 2 (2005), 293--327.

Digital Library

[4]

Barry Brown, Alex S Taylor, Shahram Izadi, Abigail Sellen, Joseph Jo'sh'Kaye, and Rachel Eardley. 2007. Locating family values: A field trial of the Whereabouts Clock. In International Conference on Ubiquitous Computing. Springer, 354--371.

[5]

AJ Bernheim Brush and Kori M Inkpen. 2007. Yours, mine and ours? Sharing and use of technology in domestic environments. In International Conference on Ubiquitous Computing. Springer, 109--126.

Digital Library

[6]

Phil Cohen, Adam Cheyer, Eric Horvitz, Rana El Kaliouby, and Steve Whittaker. 2016. On the future of personal assistants. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1032--1037.

Digital Library

[7]

Scott Davidoff, Min Kyung Lee, Anind K Dey, and John Zimmerman. 2007. Rapidly exploring application design through speed dating. In International Conference on Ubiquitous Computing. Springer, 429--446.

Digital Library

[8]

Scott Davidoff, Min Kyung Lee, Charles Yiu, John Zimmerman, and Anind K Dey. 2006. Principles of smart home control. In International conference on ubiquitous computing. Springer, 19--34.

Digital Library

[9]

Maartje MA de Graaf, S Ben Allouch, and JAGM van Dijk. 2015. What makes robots social?: A user's perspective on characteristics for social human-robot interaction. In International Conference on Social Robotics. Springer, 184--193.

Digital Library

[10]

Maartje MA de Graaf, Somaya Ben Allouch, and Jan AGM van Dijk. 2016. Long-term evaluation of a social robot in real homes. Interaction studies 17, 3 (2016), 462--491.

[11]

Stefania Druga, Randi Williams, Cynthia Breazeal, and Mitchel Resnick. 2017. Hey Google is it OK if I eat you?: Initial explorations in child-agent interaction. In Proceedings of the 2017 Conference on Interaction Design and Children. ACM, 595--600.

Digital Library

[12]

W Keith Edwards and Rebecca E Grinter. 2001. At home with ubiquitous computing: Seven challenges. In International conference on ubiquitous computing. Springer, 256--272.

Digital Library

[13]

David Frohlich and Robert Kraut. 2003. The social context of home computing. In Inside the smart home. Springer, 127--162.

[14]

Michael Golembewski and Mark Selby. 2010. Ideation decks: a card-based design ideation tool. In Proceedings of the 8th ACM Conference on Designing Interactive Systems. ACM, 89--92.

Digital Library

[15]

Isabelle Granlund, Sita Aukje Vriend, Julia Benz, Roisatul Azizah, Mikael Laaksoharju, and Mohammad Obaid. 2018. A User-Centered Storytelling Approach to Design a Language Companion Robotic Agent. In Proceedings of the 6th International Conference on Human-Agent Interaction. ACM, 29--35.

Digital Library

[16]

Jane Gruning and Siân Lindley. 2016. Things we own together: Sharing possessions at home. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM.

Digital Library

[17]

Alina Hang, Emanuel Von Zezschwitz, Alexander De Luca, and Heinrich Hussmann. 2012. Too much information!: user attitudes towards smartphone sharing. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. ACM, 284--287.

Digital Library

[18]

Guy Hoffman, Oren Zuckerman, Gilad Hirschberger, Michal Luria, and Tal Shani Sherman. 2015. Design and evaluation of a peripheral robotic conversation companion. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. ACM, 3--10.

Digital Library

[19]

Katherine Isbister, Hideyuki Nakanishi, Toru Ishida, and Cliff Nass. 2000. Helper agent: Designing an assistant for human-human interaction in a virtual meeting space. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 57--64.

Digital Library

[20]

Malte F Jung, Nikolas Martelaro, and Pamela J Hinds. 2015. Using robots to moderate team con?ict: the case of repairing violations. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. ACM, 229--236.

Digital Library

[21]

Min Kyung Lee, Sara Kiesler, Jodi Forlizzi, Siddhartha Srinivasa, and Paul Rybski. 2010. Gracefully mitigating breakdowns in robotic services. In 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 203--210.

[22]

Dan Lockton, Devika Singh, Saloni Sabnis, Michelle Chou, Sarah Foley, and Alejandro Pantoja. 2019. New Metaphors: A Workshop Method for Generating Ideas and Reframing Problems in Design and Beyond. In Proceedings of the 2019 on Creativity and Cognition. ACM, 319--332.

Digital Library

[23]

Pamela J Ludford, Reid Priedhorsky, Ken Reily, and Loren Terveen. 2007. Capturing, sharing, and using local place information. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 1235--1244.

Digital Library

[24]

Ewa Luger and Abigail Sellen. 2016. Like having a really bad PA: the gulf between user expectation and experience of conversational agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5286--5297.

Digital Library

[25]

Michal Luria, Samantha Reig, Xiang Zhi Tan, Aaron Steinfeld, Jodi Forlizzi, and John Zimmerman. 2019. Re-Embodiment and Co-Embodiment: Exploration of social presence for robots and conversational agents. In Proceedings of the 2019 on Designing Interactive Systems Conference. ACM, 633--644.

Digital Library

[26]

Tara Matthews, Kerwell Liao, Anna Turner, Marianne Berkovich, Robert Reeder, and Sunny Consolvo. 2016. She'll just grab any device that's closer: A Study of Everyday Device & Account Sharing in Households. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5921--5932.

Digital Library

[27]

Nick Merrill, John Chuang, and Coye Cheshire. 2019. Sensing is Believing: What People Think Biosensors Can Reveal About Thoughts and Feelings. In Proceedings of the 2019 on Designing Interactive Systems Conference. ACM, 413--420.

Digital Library

[28]

Youngme Moon and Clifford Nass. 1996. How "real" are computer personalities? Psychological responses to personality types in human-computer interaction. Communication research 23, 6 (1996), 651--674.

[29]

Clifford Nass, Jonathan Steuer, Ellen Tauber, and Heidi Reeder. 1993. Anthropomorphism, agency, and ethopoeia: computers as social actors. In INTERACT'93 and CHI'93 conference companion on Human factors in computing systems. ACM, 111--112.

Digital Library

[30]

Clifford Ivar Nass and Scott Brave. 2005. Wired for speech: How voice activates and advances the human-computer relationship. MIT press Cambridge, MA.

Digital Library

[31]

NPR. accessed September 9, 2019. The Smart Audio Report. https://www.nationalpublicmedia.com/ smart-audio-report/latest-report

[32]

James Pierce. 2019. Smart Home Security Cameras and Shifting Lines of Creepiness: A Design-Led Inquiry. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 45.

Digital Library

[33]

Laura R Pina, Sang-Wha Sien, Teresa Ward, Jason C Yip, Sean A Munson, James Fogarty, and Julie A Kientz. 2017. From personal informatics to family informatics: Understanding family practices around health monitoring. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2300--2315.

Digital Library

[34]

Amanda Purington, Jessie G Taft, Shruti Sannon, Natalya N Bazarova, and Samuel Hardman Taylor. 2017. Alexa is my new BFF: social roles, user satisfaction, and personification of the amazon echo. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2853--2859.

Digital Library

[35]

Byron Reeves and Clifford Ivar Nass. 1996. The media equation: How people treat computers, television, and new media like real people and places. Cambridge university press.

Digital Library

[36]

Samantha Reig, Michal Luria, Janet Wang, Danielle Oltman, Elizabeth J. Carter, Aaron Steinfeld, Jodi Forlizzi, and John Zimmerman. 2020. Not Some Random Agent: Multi-person interaction with a personalizing service robot. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. ACM/IEEE.

Digital Library

[37]

ABI Research. accessed September 13, 2019. Smart Home Robotics. https://www.abiresearch.com/ market-research/product/1033498-smart-home-robotics/ ?utm_source=media&utm_medium=email

[38]

Jon Rogers, Loraine Clarke, Martin Skelly, Nick Taylor, Pete Thomas, Michelle Thorne, Solana Larsen, Katarzyna Odrozek, Julia Kloiber, Peter Bihr, and others. 2019. Our Friends Electric: Reflections on Advocacy and Design Research for the Voice Enabled Internet. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 114.

Digital Library

[39]

Stuart Schechter. 2013. The user is the enemy, and (s)he keeps reaching for that bright shiny power button. In Workshop on Home Usable Privacy and Security (HUPS).

[40]

Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I Hong. 2018. Hey Alexa, What's Up?: A mixed-methods studies of in-home conversational agent usage. In Proceedings of the 2018 Designing Interactive Systems Conference. ACM, 857--868.

Digital Library

[41]

Solace Shen, Petr Slovak, and Malte F Jung. 2018. Stop. I see a conflict happening.: A robot mediator for young children's interpersonal confict resolution. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 69--77.

Digital Library

[42]

Allison Woodruff, Sally Augustin, and Brooke Foucault. 2007. Sabbath day home automation: it's like mixing technology and religion. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 527--536.

Digital Library

[43]

Svetlana Yarosh, Stryker Thompson, Kathleen Watson, Alice Chase, Ashwin Senthilkumar, Ye Yuan, and AJ Brush. 2018. Children asking questions: speech interface reformulations and personification preferences. In Proceedings of the 17th ACM Conference on Interaction Design and Children. ACM, 300--312.

Digital Library

[44]

John Zimmerman and Jodi Forlizzi. 2017. Speed dating: providing a menu of possible futures. The Journal of Design, Economics, and Innovation 3, 1 (2017), 30--50.

Cited By

Kim SHo JLi YFan BYang WRamey JFox SZhu HZimmerman JEslami M(2024)Integrating Equity in Public Sector Data-Driven Decision Making: Exploring the Desired Futures of Underserved StakeholdersProceedings of the ACM on Human-Computer Interaction10.1145/36869058:CSCW2(1-39)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686905
Dubiel MLeiva LBongard-Blanchy KSergeeva A(2024)“Hey Genie, You Got Me Thinking about My Menu Choices!” Impact of Proactive Feedback on User Perception and Reflection in Decision-making TasksACM Transactions on Computer-Human Interaction10.1145/368527431:5(1-30)Online publication date: 29-Jul-2024
https://dl.acm.org/doi/10.1145/3685274
Dietrich MPohle J(2024)Robot Design for Social IntervenabilityProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685392(1-9)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685392
Show More Cited By

Index Terms

Social Boundaries for Personal Agents in the Interpersonal Space of the Home
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Re-Embodiment and Co-Embodiment: Exploration of social presence for robots and conversational agents
DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference

Interactions with multiple conversational agents and social robots are becoming increasingly common. This raises new design challenges: Should agents and robots be modeled after humans, presenting their entity (i.e., social presence) as bound to a ...
Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people's loneliness in human-robot interaction

Two experiments were conducted to investigate the effects of physical embodiment in human-agent interaction. Experiment 1 (N=32) shows positive effects of physical embodiment on the feeling of an agent's social presence, the evaluation of the agent, the ...
Designing Chatbots as Community-Owned Agents
CUI '20: Proceedings of the 2nd Conference on Conversational User Interfaces

This work investigates how social agents can be designed to create a sense of ownership over them within a group of users. Social agents, such as conversational agents and chatbots, currently interact with people in impersonal, isolated, and often one-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 Owner/Author.

This work is licensed under a Creative Commons Attribution-NoDerivatives International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
1,346
Total Downloads

Downloads (Last 12 months)194
Downloads (Last 6 weeks)19

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim SHo JLi YFan BYang WRamey JFox SZhu HZimmerman JEslami M(2024)Integrating Equity in Public Sector Data-Driven Decision Making: Exploring the Desired Futures of Underserved StakeholdersProceedings of the ACM on Human-Computer Interaction10.1145/36869058:CSCW2(1-39)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686905
Dubiel MLeiva LBongard-Blanchy KSergeeva A(2024)“Hey Genie, You Got Me Thinking about My Menu Choices!” Impact of Proactive Feedback on User Perception and Reflection in Decision-making TasksACM Transactions on Computer-Human Interaction10.1145/368527431:5(1-30)Online publication date: 29-Jul-2024
https://dl.acm.org/doi/10.1145/3685274
Dietrich MPohle J(2024)Robot Design for Social IntervenabilityProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685392(1-9)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685392
Hahn SAl-Amrani NAllagah SHuang HKircher ERehs CVogt JMarky KGerber N(2024)How to Respect Bystanders' Privacy in Smart Homes - A Co-Creation StudyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685340(1-19)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685340
van Den broek MMoeslund T(2024)What is Proactive Human-Robot Interaction? - A Review of a Progressive Field and Its DefinitionsACM Transactions on Human-Robot Interaction10.1145/365011713:4(1-30)Online publication date: 23-Apr-2024
https://dl.acm.org/doi/10.1145/3650117
Chang MLee AHan NHuang ASimão HReig SMohammad Ali AMartinez RKhanuja NZimmerman JForlizzi JSteinfeld A(2024)Dynamic Agent Affiliation: Who Should the AI Agent Work for in the Older Adult's Care Network?Proceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661500(1774-1788)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661500
Rey BSakamoto YSin JIrani P(2024)Understanding User Preferences of Voice Assistant Answer Structures for Personal Health Data QueriesProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665552(1-15)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665552
Oh JKim WKim SIm HLee S(2024)Better to Ask Than Assume: Proactive Voice Assistants’ Communication Strategies That Respect User Agency in a Smart Home EnvironmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642193(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642193
Levinson LDietrich MSarkisian ASabanovic SSmart WGrollman DBroadbent EJu WSoh HWilliams T(2024)Privacy Aware RoboticsCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3638161(1335-1337)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3638161
Jin SIm KYoo MRoll ISeo K(2023)Supporting students’ self-regulated learning in online learning using artificial intelligence applicationsInternational Journal of Educational Technology in Higher Education10.1186/s41239-023-00406-520:1Online publication date: 26-Jun-2023
https://doi.org/10.1186/s41239-023-00406-5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents