Abstract
Although voice user interfaces (VUIs) are widely available, they currently face challenges such as low adoption rates and user concerns. Users assess products through user experience (UX) aspects. Thus, knowing UX aspects for VUIs and their prioritization will improve UX and reduce challenges. In this study, we use a user-centered mixed-methods approach to identify and prioritize UX aspects of VUIs. Thereby, we identified 32 VUI UX aspects from the perspective of intensive users. We then applied the Kano model to categorize these UX aspects for which we analyzed \(N=195\) VUI users. One thing we found was that 21 VUI UX aspects are distinctively prioritized, such as privacy, data security, and ad-free as must-be, and simplicity, comprehension, and error-free as one-dimensional. These findings can help VUI developers to prioritize specific UX aspects according to their target group’s needs, enabling them to create VUIs that benefit and excite their users.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Biermann, M., Schweiger, E., Jentsch, M.: Talking to Stupid?!? Improving voice user interfaces. In: Fischer, H., Hess, S. (eds.) Mensch und Computer 2019 - Usability Professionals. pp. 53–61. Gesellschaft für Informatik e.V. Und German UPA e.V., Bonn (2019). https://doi.org/10.18420/muc2019-up-0253
Bogner, A., Littig, B., Menz, W.: Interviews mit experten: eine praxisorientierte Einführung (Interviewing experts: a practice-oriented introduction). Springer Fachmedien Wiesbaden, Wiesbaden (2014). https://doi.org/10.1007/978-3-531-19416-5
Cohen, M.H., Giangola, J.P., Balogh, J.: Voice User Interface Design. Addison-Wesley, Boston (2004)
Dresing, T., Pehl, T.: Praxisbuch interview, transkription & analyse, audiotranskription. Anleitungen und Regelsysteme für qualitativ Forschende. (Manual on interviewing, transcription and analysis, audio transcription. Software Guides and Practical Hints for Qualitative Researchers.). Dr. Dresing und Pehl, Marburg (2018)
Feng, Y.L., Huang, C.H.: Study on user experience of live streaming sales based on ISM and kano quality model. J. Phys.: Conf. Ser. 1748(4) (2021). https://doi.org/10.1088/1742-6596/1748/4/042046
Fong, D.: Using the self-stated importance questionnaire to interpret Kano questionnaire results. Center Q. Manage. J. 5(3), 21–23 (1996)
Hassenzahl, M., Tractinsky, N.: User experience a research agenda. Behav. Inf. Technol. 25(2), 91–97 (2006). https://doi.org/10.1080/01449290500330331
Hone, K.S., Graham, R.: Towards a tool for the subjective assessment of speech system interfaces (SASSI). Natl. Lang. Eng. 6(3 &4), 287–303 (2000). https://doi.org/10.1017/S1351324900002497
Iniesto, F., Coughlan, T., Lister, K.: Implementing an accessible conversational user interface: applying feedback from university students and disability support advisors. In: Vazquez, S.R., Drake, T., Ahmetovic, D., Yaneva, V. (eds.) Proceedings of the 18th International Web for All Conference, pp. 1–5. ACM, New York, NY, USA (2021). https://doi.org/10.1145/3430263.3452431
International Requirements Engineering Board (IREB): IREB certified professional for requirements engineering - foundation level - syllabus version 3.1.0. Tech. rep., https://www.ireb.org/en/about/ireb/l (2022). https://www.ireb.org/content/downloads/2-cpre-foundation-level-syllabus-3-0/cpre_foundationlevel_syllabus_en_v.3.1.pdf
ISO 9241–210: Ergonomics of human-system interaction Part 210: humancentred design for interactive systems. Tech. rep., https://www.iso.org/committee/53372.html (2019). https://www.iso.org/standard/77520.html
Kano, N., Seraku, N., Takahashi, F., Tsuji, S.i.: (attractive quality and must-be quality). J. Jpn. Soc. Q. Control 31(4), 147–156 (1984). https://cir.nii.ac.jp/crid/1572261550744179968
Kinsella, B.: Voice assistant adoption clustering around 50% of the population (2022), https://voicebot.ai/2022/04/15/voice-assistant-adoption-clustering-around-50-of-the-population/
Klein, A.M., Kölln, K., Deutschländer, J., Rauschenberger, M.: Design and evaluation of voice user interfaces: what should one consider? In: Design, Operation and Evaluation of Mobile Communications: 4th International Conference, MOBILE 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, 23–28 July 2023, Proceedings, pp. 167–190 (2023). https://doi.org/10.1007/978-3-031-35921-7_12
Klein, A.M., Hinderks, A., Rauschenberger, M., Thomaschewski, J.: Exploring voice assistant risks and potential with technology-based users. In: Proceedings of the 16th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, pp. 147–154. INSTICC, SciTePress, Portugal (2020). https://doi.org/10.5220/0010150101470154
Klein, A.M., Hinderks, A., Schrepp, M., Thomaschewski, J.: Construction of UEQ+ scales for voice quality. In: Proceedings of the Conference on Mensch Und Computer, pp. 1–5. MuC ’20, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3404983.3410003
Klein, A.M., Hinderks, A., Schrepp, M., Thomaschewski, J.: Measuring user experience quality of voice assistants. In: 2020 15th Iberian Conference on Information Systems and Technologies (CISTI), pp. 1–4. IEEE, Seville, Spain (2020). https://doi.org/10.23919/CISTI49556.2020.9140966
Klein, A.M., Rauschenberger, M., Thomaschweski, J., Escalona, M.J.: Comparing voice assistant risks and potential with technology-based users: a study from Germany and Spain. J. Web Eng. 7(16), 1991–2016 (2021). https://doi.org/10.13052/jwe1540-9589.2071
Kocaballi, A.B., Laranjo, L., Coiera, E.: Understanding and measuring user experience in conversational interfaces. Interact. Comput. 31(2), 192–207 (2019). https://doi.org/10.1093/iwc/iwz015
Kölln, K., Deutschländer, J., Klein, A.M., Rauschenberger, M., Winter, D.: Identifying user experience aspects for voice user interfaces with intensive users. In: Proceedings of the 18th International Conference on Web Information Systems and Technologies, pp. 385–393. SCITEPRESS - Science and Technology Publications (2022). https://doi.org/10.5220/0011383300003318
Kölln, K., Deutschländer, J., Klein, A.M., Rauschenberger, M., Winter, D.: Protocol for identifying user experience aspects for voice user interfaces with intensive users (2022). https://doi.org/10.13140/RG.2.2.26828.49287
Kölln, K., Klein, A.M., Deutschländer, J., Winter, D., Rauschenberger, M.: Protocol for categorizing UX aspects for voice user interfaces using the kano model (2023). https://doi.org/10.13140/RG.2.2.32565.55528
Langevin, R., Lordon, R.J., Avrahami, T., Cowan, B.R., Hirsch, T., Hsieh, G.: Heuristic evaluation of conversational agents. In: Kitamura, Y., Quigley, A., Isbister, K., Igarashi, T., Bjørn, P., Drucker, S. (eds.) Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–15. ACM, New York, NY, USA (2021). https://doi.org/10.1145/3411764.3445312
Li, X., You, Y.: Kano model analysis required in app interactive design based on mobile user experience. Int. J. Multimedia Ubiquitous Eng. 11(11), 247–258 (2016). https://doi.org/10.14257/ijmue.2016.11.11.21
Matzler, K., Hinterhuber, H.H.: How to make product development projects more successful by integrating kano’s model of customer satisfaction into quality function deployment. Technovation 18(1), 25–38 (1998). https://doi.org/10.1016/S0166-4972(97)00072-2, https://www.sciencedirect.com/science/article/pii/S0166497297000722
Mayring, P.: Qualitative Content Analysis, vol. 1994. UVK Univ.-Verl, Konstanz (1994)
McKim, C.A.: The value of mixed methods research: a mixed methods study. J. Mixed Methods Res. 11(2), 202–222 (2017). https://doi.org/10.1177/1558689815607096
Palan, S., Schitter, C.: Prolific.ac a subject pool for online experiments. J. Behav. Exper. Finance 17, 22–27 (2018). https://doi.org/10.1016/j.jbef.2017.12.004, https://linkinghub.elsevier.com/retrieve/pii/S2214635017300989
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., Damer, E.: Data quality of platforms and panels for online behavioral research. Behav. Res. Methods 54, 1643–1662 (2021). https://doi.org/10.3758/s13428-021-01694-3
Preece, J., Rogers, Y., Sharp, H.: Interaction design: beyond human-computer interaction. In: Interaction Design: Beyond Human-Computer Interaction. J. Wiley & Sons, New York (2002)
Primrose, M.C.: User experience grading via kano categories. In: 2010 18th IEEE International Requirements Engineering Conference, pp. 331–336 (2010). https://doi.org/10.1109/RE.2010.47
Prolific Academic Ltd.: https://www.prolific.co. Accessed 06 Mar 2023
Rauschenberger, M.: Acceptance by Design: voice assistants. In: 1st AI-DEbate Workshop: workshop establishing An InterDisciplinary pErspective on speech-BAsed TEchnology, p. 27.09.2021. OvGU, Magdeburg, Germany (2021). https://doi.org/10.25673/38476, https://opendata.uni-halle.de//handle/1981185920/38717
Schrepp, M., et al..: On the importance of UX quality aspects for different product categories. IJIMAI (International Journal of Interactive Multimedia and Artificial Intelligence) (2022)
Schrepp, M., Thomaschewski, J.: Construction and first validation of extension scales for the user experience questionnaire (UEQ) (2019). https://doi.org/10.13140/RG.2.2.19260.08325
Schrepp, M., Thomaschewski, J.: Design and validation of a framework for the creation of user experience questionnaires. Int. J. Interact. Multimedia Artif. Intell. 5(7), 88–95 (2019). https://doi.org/10.9781/ijimai.2019.06.006
Seaborn, K., Urakami, J.: Measuring voice UX quantitatively. In: Kitamura, Y., Quigley, A., Isbister, K., Igarashi, T. (eds.) Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–8. ACM, New York, NY, USA (2021). https://doi.org/10.1145/3411763.3451712
Song, X.: User experience design of elderly-oriented social apps based on kano model–the case of wechat. In: Duffy, V.G., Gao, Q., Zhou, J., Antona, M., Stephanidis, C. (eds.) HCI International 2022 - Late Breaking Papers: HCI for Health, Well-being, Universal Access and Healthy Aging, pp. 546–558. Springer Nature Switzerland, Cham (2022). https://doi.org/10.1007/978-3-031-17902-0_39
Tas, S., Hildebrandt, C., Arnold, R.: Voice assistants in Germany. WIK Wissenschaftliches Institut für Infrastruktur und Kommunikationsdienste GmbH, Bad Honnef, Germany (2019). https://www.wik.org/en/publications/publication/no-441-voice-assistants-in-germany, nr.441
Vacher, M., Caffiau, S., Portet, F., Meillon, B., Roux, C., Elias, E., Lecouteux, B., Chahuara, P.: Evaluation of a context-aware voice interface for ambient assisted living: qualitative user study vs. quantitative system evaluation. ACM Trans. Access. Comput. 7, 1–36 (5 2015). https://doi.org/10.1145/2738047
Wei, Z., Landay, J.A.: Evaluating speech-based smart devices using new usability heuristics. IEEE Pervasive Comput. 17(2), 84–96 (2018). https://doi.org/10.1109/MPRV.2018.022511249
Winter, D., Hinderks, A., Schrepp, M., Thomaschewski, J.: Welche UX Faktoren sind für mein Produkt wichtig? (Which UX factors are important for my product?). In: Hess, S., Fischer, H. (eds.) Mensch und Computer MuC 2017. Gesellschaft für Informatik e. V. und die German UPA e.V. (2017). https://doi.org/10.18420/muc2017-up-0002
Witell, L., Löfgren, M., Dahlgaard, J.J.: Theory of attractive quality and the Kano methodology the past, the present, and the future. Total Q. Manage. Bus. Excellence 24, 1241 – 1252 (2013). https://doi.org/10.1080/14783363.2013.791117
Acknowledgements
This is an extension of the previously published conference paper from WEBIST’22: Proceedings of the 18th International Conference on Web Information Systems and Technologies. First, we would like to thank all participants for their time and the insights they provided. We also want to thank Anna Weigand for the tremendous support in finalizing the paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kölln, K., Klein, A.M., Deutschländer, J., Winter, D., Rauschenberger, M. (2023). Categorizing UX Aspects for Voice User Interfaces Using the Kano Model. In: Marchiori, M., Domínguez Mayo, F.J., Filipe, J. (eds) Web Information Systems and Technologies. WEBIST 2022. Lecture Notes in Business Information Processing, vol 494. Springer, Cham. https://doi.org/10.1007/978-3-031-43088-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-43088-6_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43087-9
Online ISBN: 978-3-031-43088-6
eBook Packages: Computer ScienceComputer Science (R0)