research-article

May I Interrupt? Diverging Opinions on Proactive Smart Speakers

Authors:

Leon Reicherts,

Michael Bonfert,

Rainer MalakaAuthors Info & Claims

CUI '21: Proceedings of the 3rd Conference on Conversational User Interfaces

Article No.: 34, Pages 1 - 10

https://doi.org/10.1145/3469595.3469629

Published: 27 July 2021 Publication History

Abstract

Although smart speakers support increasingly complex multi-turn dialogues, they still play a mostly reactive role, responding to user’s questions or requests. With rapid technological advances, they are becoming more capable of initiating conversations by themselves. However, before developing such proactive features, it is important to understand how people perceive different types of agent-initiated interactions. We conducted an online survey in which participants () rated 8 scenarios around proactive smart speakers on different aspects. Despite some controversy around proactive systems, we found that participants’ ratings were surprisingly positive. However, they also commented on potential issues around user privacy and agency as well as undesirable interference with ongoing (social) activities. We discuss these findings and their implications for future avenues of research on proactive smart speakers.

References

[1]

Herman Aguinis and Kyle J. Bradley. 2014. Best Practice Recommendations for Designing and Implementing Experimental Vignette Methodology Studies. Organizational Research Methods 17, 4 (2014), 351–371. https://doi.org/10.1177/1094428114547952

[2]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300233

Digital Library

[3]

Tawfiq Ammari, Jofish Kaye, Janice Y. Tsai, and Frank Bentley. 2019. Music, Search, and IoT: How People (Really) Use Voice Assistants. ACM Trans. Comput.-Hum. Interact. 26, 3, Article 17 (April 2019), 28 pages. https://doi.org/10.1145/3311956

Digital Library

[4]

Daisuke Asai, Jarrod Orszulak, Richard Myrick, Chaiwoo Lee, Joseph F Coughlin, and Olivier L De Weck. 2011. Context-aware reminder system to support medication compliance. In 2011 IEEE international conference on systems, man, and cybernetics. IEEE, New York, USA, 3213–3218.

[5]

André Berton, Dirk Bühler, and Wolfgang Minker. 2006. SmartKom-Mobile Car: User Interaction with Mobile Services in a Car Environment. In SmartKom: Foundations of Multimodal Dialogue Systems, Wolfgang Wahlster(Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 523–537. https://doi.org/10.1007/3-540-36678-4_33

[6]

Ian Carlos Campbell. 2021. Amazon’s Alexa can now act on its own hunches to turn off lights and more. https://www.theverge.com/2021/1/25/22249044/amazon-alexa-update-proactive-hunches-guard-plus-subscription

[7]

John M. Carroll. 1999. Five Reasons for Scenario-Based Design. In Proceedings of the Thirty-Second Annual Hawaii International Conference on System Sciences-Volume 3 - Volume 3(HICSS ’99). IEEE Computer Society, USA, 3051.

[8]

Narae Cha, Auk Kim, Cheul Young Park, Soowon Kang, Mingyu Park, Jae-Gil Lee, Sangsu Lee, and Uichin Lee. 2020. Hello There! Is Now a Good Time to Talk? Opportune Moments for Proactive Interactions with Smart Speakers. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 74 (Sept. 2020), 28 pages. https://doi.org/10.1145/3411810

Digital Library

[9]

Kristiina Jokinen and Michael McTear. 2009. Spoken dialogue systems. Synthesis Lectures on Human Language Technologies 2, 1(2009), 1–151.

[10]

Mitsuki Komori, Yuichiro Fujimoto, Jianfeng Xu, Kazuyuki Tasaka, Hiromasa Yanagihara, and Kinya Fujita. 2019. Experimental Study on Estimation of Opportune Moments for Proactive Voice Information Service Based on Activity Transition for People Living Alone. In Human-Computer Interaction. Perspectives on Design, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 527–539.

Digital Library

[11]

Matthias Kraus, Marvin Schiller, Gregor Behnke, Pascal Bercher, Michael Dorna, Michael Dambier, Birte Glimm, Susanne Biundo, and Wolfgang Minker. 2020. ”Was That Successful?” On Integrating Proactive Meta-Dialogue in a DIY-Assistant Using Multimodal Cues. In Proceedings of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20). Association for Computing Machinery, New York, NY, USA, 585–594. https://doi.org/10.1145/3382507.3418818

Digital Library

[12]

Josephine Lau, Benjamin Zimmerman, and Florian Schaub. 2018. Alexa, Are You Listening? Privacy Perceptions, Concerns and Privacy-Seeking Behaviors with Smart Speakers. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 102 (Nov. 2018), 31 pages. https://doi.org/10.1145/3274371

Digital Library

[13]

Uichin Lee, Kyungsik Han, Hyunsung Cho, Kyong Mee Chung, Hwajung Hong, Sung Ju Lee, Youngtae Noh, Sooyoung Park, and John M. Carroll. 2019. Intelligent positive computing with mobile, wearable, and IoT devices: Literature review and research directions. Ad Hoc Networks 83 (Feb. 2019), 8–24. https://doi.org/10.1016/j.adhoc.2018.08.021

[14]

O. Miksik, I. Munasinghe, J. Asensio-Cubero, S. Reddy Bethi, S-T. Huang, S. Zylfo, X. Liu, T. Nica, A. Mitrocsak, S. Mezza, R. Beard, R. Shi, R. Ng, P. Mediano, Z. Fountas, S-H. Lee, J. Medvesek, H. Zhuang, Y. Rogers, and P. Swietojanski. 2020. Building Proactive Voice Assistants: When and How (not) to Interact. arxiv:2005.01322 [cs.HC]

[15]

Maria Schmidt and Patricia Braunger. 2018. A Survey on Different Means of Personalized Dialog Output for an Adaptive Personal Assistant. In Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization (Singapore, Singapore) (UMAP ’18). Association for Computing Machinery, New York, NY, USA, 75–81. https://doi.org/10.1145/3213586.3226198

Digital Library

[16]

Maria Schmidt, Wolfgang Minker, and Steffen Werner. 2020. User Acceptance of Proactive Voice Assistant Behavior. In Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung 2020, Andreas Wendemuth, Ronald Böck, and Ingo Siegert (Eds.). TUDpress, Dresden, Germany, 18–25.

[17]

Maria Schmidt, Daniela Stier, Steffen Werner, and Wolfgang Minker. 2019. Exploration and assessment of proactive use cases for an in-car voice assistant. In Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung 2019, Peter Birkholz and Simon Stone (Eds.). TUDpress, Dresden, Germany, 148–155.

[18]

Candace L. Sidner, Timothy Bickmore, Bahador Nooraie, Charles Rich, Lazlo Ring, Mahni Shayganfar, and Laura Vardoulakis. 2018. Creating New Technologies for Companionable Agents to Support Isolated Older Adults. ACM Trans. Interact. Intell. Syst. 8, 3, Article 17 (July 2018), 27 pages. https://doi.org/10.1145/3213050

Digital Library

[19]

Timothy Sohn, Kevin A. Li, Gunny Lee, Ian Smith, James Scott, and William G. Griswold. 2005. Place-Its: A Study of Location-Based Reminders on Mobile Phones. In Proceedings of the 7th International Conference on Ubiquitous Computing (Tokyo, Japan) (UbiComp’05). Springer-Verlag, Berlin, Heidelberg, 232–250. https://doi.org/10.1007/11551201_14

Digital Library

[20]

Petra-Maria Strauss and Wolfgang Minker. 2010. Proactive spoken dialogue interaction in multi-party environments. Springer, Heidelberg, Germany.

[21]

Madiha Tabassum, Tomasz Kosiński, and Heather Richter Lipford. 2019. ”I Don’t Own the Data”: End User Perceptions of Smart Home Device Data Practices and Risks. In Proceedings of the Fifteenth USENIX Conference on Usable Privacy and Security (Santa Clara, CA, USA) (SOUPS’19). USENIX Association, USA, 435–450.

[22]

Sarah Theres Völkel, Daniel Buschek, Malin Eiband, Benjamin R. Cowan, and Heinrich Hussmann. 2021. Eliciting and Analysing Users’ Envisioned Dialogues with Perfect Voice Assistants. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445536

Digital Library

Cited By

Seaborn KSawa YWatanabe M(2024)Coimagining the Future of Voice Assistants with Cultural SensitivityHuman Behavior and Emerging Technologies10.1155/2024/32387372024(1-21)Online publication date: 25-Mar-2024
https://doi.org/10.1155/2024/3238737
Zargham NDubiel MDesai SMildner TBelz H(2024)Designing AI Personalities: Enhancing Human-Agent Interaction Through Thoughtful Persona DesignProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701608(490-494)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701608
S. Jha SGhielmini NGarcia KMayer S(2024)The Spectrum of Proactive Functioning in Digital CompanionsProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701606(331-337)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701606
Show More Cited By

Recommendations

What Could Possibly Go Wrong When Interacting with Proactive Smart Speakers? A Case Study Using an ESM Application
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Voice user interfaces (VUIs) have made their way into people’s daily lives, from voice assistants to smart speakers. Although VUIs typically just react to direct user commands, increasingly, they incorporate elements of proactive behaviors. In ...
Understanding Circumstances for Desirable Proactive Behaviour of Voice Assistants: The Proactivity Dilemma
CUI '22: Proceedings of the 4th Conference on Conversational User Interfaces

The next major evolutionary stage for voice assistants will be their capability to initiate interactions by themselves. However, to design proactive interactions, it is crucial to understand whether and when this behaviour is considered useful and how ...
Understanding User Perceptions of Proactive Smart Speakers

Voice assistants, such as Amazon's Alexa and Google Home, increasingly find their way into consumer homes. Their functionality, however, is currently limited to being passive answer machines rather than proactively engaging users in conversations. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

CUI '21: Proceedings of the 3rd Conference on Conversational User Interfaces

July 2021

262 pages

ISBN:9781450389983

DOI:10.1145/3469595

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CUI '21

CUI '21: CUI 2021 - 3rd Conference on Conversational User Interfaces

July 27 - 29, 2021

Bilbao (online), Spain

Acceptance Rates

Overall Acceptance Rate 34 of 100 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
461
Total Downloads

Downloads (Last 12 months)126
Downloads (Last 6 weeks)13

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Seaborn KSawa YWatanabe M(2024)Coimagining the Future of Voice Assistants with Cultural SensitivityHuman Behavior and Emerging Technologies10.1155/2024/32387372024(1-21)Online publication date: 25-Mar-2024
https://doi.org/10.1155/2024/3238737
Zargham NDubiel MDesai SMildner TBelz H(2024)Designing AI Personalities: Enhancing Human-Agent Interaction Through Thoughtful Persona DesignProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701608(490-494)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701608
S. Jha SGhielmini NGarcia KMayer S(2024)The Spectrum of Proactive Functioning in Digital CompanionsProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701606(331-337)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701606
Mathis LBubeck CPeissner M(2024)When to Approach the User: Investigating Suitable Context Factors for Proactive Voice Assistance in Automated CarsProceedings of Mensch und Computer 202410.1145/3670653.3670672(299-309)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670672
Zargham NAvanesi VMildner TJavanmardi KPorzel RMalaka R(2024)HASI: A Model for Human-Agent Speech InteractionProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665885(1-8)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665885
Ahire SOthman SRohs M(2024)Dual-Mode Interventions: Giving Agency to Knowledge Workers in Proactive Health InterventionsProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665578(1-7)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665578
Ahire SSimon BRohs M(2024)WorkFit: Designing Proactive Voice Assistance for the Health and Well-Being of Knowledge WorkersProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665561(1-14)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665561
Ma YZiegler JBoratto LGena CMarras MGermanakos PPopescus E(2024)The Effect of Proactive Cues on the Use of Decision Aids in Conversational Recommender SystemsAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3665186(305-315)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3665186
Kim MLee JKoh YLee CLee UKim A(2024)Interrupting for Microlearning: Understanding Perceptions and Interruptibility of Proactive Conversational Microlearning ServicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642778(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642778
Oh JKim WKim SIm HLee S(2024)Better to Ask Than Assume: Proactive Voice Assistants’ Communication Strategies That Respect User Agency in a Smart Home EnvironmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642193(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642193
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten