Abstract
This research evaluates the user experience of an audio feature called “Quick Commands” that is used to control a virtual Assistant with natural invocation phrases. The feature is an application of NLP (Natural Language Processing) that removes hotwords such as “Hey Google”, “Hey Siri”, and “Alexa”, allowing for natural voice interactions. The primary research goal is to validate the value proposition of Quick Commands for VUI (voice user interface) interactions in terms of usability defined as: feature helpfulness, naturalness, and comfort using the feature in public and private spaces. The study design included recruiting a group of over 80 users to test Quick Commands in different contexts, followed by a focus group of 18 users to provide detailed feedback. The study ran 1 week and encouraged users to test Quick Commands in scenarios with a range of ambient audio conditions (ranging from 50–80 dBA). During the week of testing participants completed check-in surveys at the mid-week point, at the end of the week, and then some participants in a focus group to debrief the study. These methods can be replicated to validate future NLP advances and Assistant features before implementing public facing applications. Results of this study demonstrate the value proposition for Quick Commands and user comfort with voice interactions in a range of audio environments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Shashank, A., Michael, R.: Tired of wake words? Moving towards seamless conversations with intelligent personal assistants. In: Proceedings of the 2nd Conference on Conversational User Interfaces, pp. 1–3 (2020)
Ammari, T., Kaye, J., Tsai, J.Y., Bentley, F.: Music, search, and IoT: how people (really) use voice assistants. ACM Trans. Comput. Hum. Interact. 26, 17 (2019)
Bolton, T., Dargahi, T., Belguith, S., AlRakhami, M.S., Sodhro, A.H.: On the security and privacy challenges of virtual assistants. Sensors 21(7), 2312 (2021)
Andrew Herndon Bret Kinsella. Smartphone Voice Assistant Consumer Report. Tech. rep. (2022)
Deibel, D., Evanhoe, R.: Conversations with Things: UX Design for Chat and Voice. Rosenfeld Media (2021)
Subhash, S., Srivatsa, P.N., Siddesh, S., Ullas, A., Santhosh, B.: Artificial intelligence-based voice assistant. In: 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4), pp. 593–596. IEEE (2020)
Nathan, S., Christopher, N.: Make it so: Interaction Design Lessons from Science Fiction. Rosenfeld Media (2012)
Madiha, T., et al.: Investigating users’ preferences and expectations for always listening voice assistants. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 3.4, pp. 1–23 (2019)
Siri Team: Hey siri: An on-device dnn-powered voice trigger for apple’s personal assistant. Apple Machine Learning J. 1(6) (2017)
Nick, Z.: Sensory Evaluation of Sound. CRC Press (2018)
Noise Sources and Their Effects: Noise comparisons. (n.d.). https://www.chem.purdue.edu/chemsafety/Training/PPETrain/dblevels.htm. Retrieved 25 Feb 2022
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Cackett, M., Fulton, L., Pearl, D. (2023). Sound as an Interface, Methods to Evaluate Voice User Interface (VUI) Experiences in Various Contexts. In: Arai, K. (eds) Proceedings of the Future Technologies Conference (FTC) 2022, Volume 2. FTC 2022 2022. Lecture Notes in Networks and Systems, vol 560. Springer, Cham. https://doi.org/10.1007/978-3-031-18458-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-18458-1_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-18457-4
Online ISBN: 978-3-031-18458-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)