Abstract
Conversational Agent Voting Advice Applications (CAVAAs) are chatbot-based information retrieval systems for citizens who aim to inform themselves about the political issues at stake in times of political elections. Previous studies investigating these relatively young tools primarily focused on the effects of CAVAAs that include a text-based chatbot. In order to further optimize their design, current research compared the effects of CAVAAs with a text, voice, and combined chatbot. In an experimental lab study among young voters (N = 60) these three modalities have been compared on usage measures (the amount of information retrieved from the chatbot, and miscommunication), evaluation measures (ease of use, usefulness, and enjoyment), and political measures (perceived and factual political knowledge). Results show that the three CAVAA modalities score equally high on political measures and the perception of enjoyment. At the same time, the textual and combined CAVAA outperform the voice CAVAA on several aspects: the voice CAVAA received lower ease of use and usefulness scores, respondents requested less additional information, and they experienced more miscommunication when interacting with the voice chatbot. Analyses of the usage data also indicate that in the combined condition users hardly use the voice-option and instead almost exclusively rely on text-functionalities like clicking on suggestion buttons. This seems to suggest that using voice is too much of an effort for CAVAA users; we therefore recommend the usage of text-bots in this specific usage context.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Data collection was initiated prior to final approval, following liaising with the ethics board.
References
Ahn, T., Ryu, S., Ahn, T., Ryu, S., Han, I.: The impact of Web quality and playfulness on user acceptance of online retailing. Inf. Manage. 44(3), 263–275 (2007). https://doi.org/10.1016/j.im.2006.12.008
Angga, P.A., Fachri, W.E., Elevanita, A., Agushinta, R.D.: Design of chatbot with 3D avatar, voice interface, and facial expression. In: 2015 International Conference on Science in Information Technology (ICSITech), pp. 326–330. IEEE, October 2015
Ashktorab, Z., Jain, M., Liao, Q.V., Weisz, J.D.: Resilient chatbots: Repair strategy preferences for conversational breakdowns. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–12, May 2019
Bohus, D., Rudnicky, A.: Sorry and i didn’t catch that! An investigation of non- understanding errors and recovery strategies. In: Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue, pp. 128–143, September 2005
Cho, E., Molina, M.D., Wang, J.: The effects of modality, device, and task differences on perceived human likeness of voice-activated virtual assistants. Cyberpsychol. Behav. Soc. Netw. 22(8), 515–520 (2019)
De Graaf, J.: The irresistible rise of Stemwijzer. In: Cedroni, L., Garzia, D. (eds.) Voting Advice Applications in Europe: The State of the Art, pp. 35–46. Scriptaweb, Napoli (2010)
Direct Research: De Nationale Voice Monitor 2021 (2021). https://www.directresearch.nl/blogs/de-nationale-voice-monitor-2021/. Accessed 8 Feb 2022
Følstad, A., et al.: Future directions for chatbot research: an interdisciplinary research agenda. Computing 103(12), 2915–2942 (2021). https://doi.org/10.1007/s00607-021-01016-7
Fryer, L.K., Ainley, M., Thompson, A., Gibson, A., Sherlock, Z.: Stimulating and sustaining interest in a language course: an experimental comparison of Chatbot and Human task partners. Comput. Hum. Behav. 75, 461–468 (2017)
Garzia, D., Marschall, S.: Voting advice applications under review: the state of research. Int. J. Electron. Govern. 5(3–4), 203–222 (2012)
Gemenis, K., Rosema, M.: Voting advice applications and electoral turnout. Elect. Stud. 36, 281–289 (2014)
Goodhue, D.L., Thompson, R.L.: Task-technology fit and individual performance. MIS Q. 19(2), 213 (1995). https://doi.org/10.2307/249689
Kamoen, N., Holleman, B.: I don’t get it. Response difficulties in answering political attitude statements in Voting Advice Applications. Surv. Res. Methods. 11(2), 125–140 (2017). https://doi.org/10.18148/srm/2017.v11i2.6728
Kamoen, N., Liebrecht, C.: I need a CAVAA: how conversational agent voting advice applications (CAVAAs) affect users’ political knowledge and tool experience. Front. Artif. Intell. 5, 835505 (2022). https://doi.org/10.3389/frai.2022.835505
Kamoen, N., McCartan, T., Liebrecht, C.: Conversational agent voting advice applications: a comparison between a structured, semi-structured, and non-structured chatbot design for communicating with voters about political issues. In: Følstad, A., et al. (eds.) Chatbot Research and Design: 5th International Workshop, CONVERSATIONS 2021, Virtual Event, November 23–24, 2021, Revised Selected Papers, pp. 160–175. Springer International Publishing, Cham (2022). https://doi.org/10.1007/978-3-030-94890-0_10
Kanda, T., Hirano, T., Eaton, D., Ishiguro, H.: Interactive robots as social partners and peer tutors for children: a field trial. Human-Comput. Interact. 19(1–2), 61–84 (2004)
Kim, Y., Lee, H.: The rise of chatbots in political campaigns: the effects of conversational agents on voting intention Int. J. Human–Comput. Interact. 1–12 (2022).https://doi.org/10.1080/10447318.2022.2108669
Kocielnik, R., Avrahami, D., Marlow, J., Lu, D., Hsieh, G.: Designing for workplace reflection: a chat and voice-based conversational agent. In: Proceedings of the 2018 Designing Interactive Systems Conference, pp. 881–894, June 2018
Krouwel, A., Vitiello, T., Wall, M.: The practicalities of issuing vote advice: a new methodology for profiling and matching. Int. J. Electron. Govern. 5(3–4), 223–243 (2012)
Le Bigot, L., Jamet, E., Rouet, J.-F., Amiel, V.: Mode and modal transfer effects on performance and discourse organization with an information retrieval dialogue system in natural language. Comput. Hum. Behav. 22, 467–500 (2006)
Lee, M.K., Cheung, C.M., Chen, Z.: Acceptance of Internet-based learning medium: the role of extrinsic and intrinsic motivation. Inf. Manage. 42(8), 1095–1104 (2005)
Liebrecht, C., Kamoen, N.: ‘Hey Siri, wat is de hondenbelasting?’: Voicebots en tekstbots in een politieke context. Tekstblad 27(1), 22–24 (2022)
McLean, G., Osei-Frimpong, K.: Hey Alexa… examine the variables influencing the use of artificial intelligent in-home voice assistants. Comput. Hum. Behav. 99, 28–37 (2019)
Nass, C.I., Brave, S.: Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship. MIT Press, Cambridge (2005)
Pal, D., Arpnikanondt, C., Funilkul, S., Chutimaskul, W.: The adoption analysis of voice-based smart Iot products. IEEE Internet Things J. 7(11), 10852–10867 (2020)
Riefle, L., Brand, A., Mietz, J., Rombach, L., Szekat, C., Benz, C.: What fits Tim might not fit Tom: Exploring the impact of user characteristics on users’ experience with conversational interaction modalities. In: Wirtschaftsinformatik 2022 Proceedings, vol. 13 (2022)
Rzepka, C., Berger, B., Hess, T.: Voice assistant vs. chatbot: examining the fit between conversational agents’ interaction modalities and information search tasks. Inf. Syst. Front. 24(3), 839–856 (2022)
Schroeder, J., Schroeder, M.: Trusting in machines: how mode of interaction affects willingness to share personal information with machines. In: Proceedings of the 51st Hawaii International Conference on System Sciences, Hawaii, USA (2018)
Shulman, H.C., Sweitzer, M.D.: Advancing framing theory: designing an equivalency frame to improve political information processing. Hum. Commun. Res. 44(2), 155–175 (2018). https://doi.org/10.1093/hcr/hqx006
Sundar, S.S.: The MAIN model: a heuristic approach to understanding technology effects on credibility. In: Metzger, M.J., Flanagin, A.J. (Eds.). Digital Media, Youth, and Credibility. The John D. and Catherine T. MacArthur Foundation Series on Digital Media and Learning, pp. 73–100. The MIT Press, Cambridge (2008). https://doi.org/10.1162/dmal.9780262562324.073
Van Camp, K., Lefevere, J., Walgrave, S.: The content and formulation of statements in voting advice applications. In: Garzia, D., Marschall, S., (eds.) Matching Voters with Parties and Candidates. Voting Advice Applications in Comparative Perspective, pp. 11–32. ECPR Press, Colchester (2014)
Xu, J.D., Benbasat, I., Cenfetelli, R.T.: The nature and consequences of trade-off transparency in the context of recommendation agents. MIS Q. 38, 379–406 (2014)
Yang, H., Lee, H.: Understanding user behavior of virtual personal assistant devices. IseB 17(1), 65–87 (2018). https://doi.org/10.1007/s10257-018-0375-1
Acknowledgements
The authors would like to thank Tilburg University’s Fund (project number ESF2021–2) for the financial support to develop the CAVAAs. A summary of the results of this study has also been published in the Dutch popular-scientific magazine Tekstblad [22].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Liebrecht, C., Kamoen, N., Aerts, C. (2023). Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA). In: Følstad, A., et al. Chatbot Research and Design. CONVERSATIONS 2022. Lecture Notes in Computer Science, vol 13815. Springer, Cham. https://doi.org/10.1007/978-3-031-25581-6_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-25581-6_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-25580-9
Online ISBN: 978-3-031-25581-6
eBook Packages: Computer ScienceComputer Science (R0)