Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3640794.3665562acmconferencesArticle/Chapter ViewAbstractPublication PagescuiConference Proceedingsconference-collections
research-article

Improving Conversational User Interfaces for Citizen Complaint Management through enhanced Contextual Feedback

Published: 08 July 2024 Publication History

Abstract

As cities transform, disrupting citizens’ lives, their participation in urban development is often undervalued despite its importance. Citizen complaint systems exist but are often limited in fostering meaningful dialogue with municipalities. Meanwhile, smart cities aim to improve living standards, efficiency, and sustainability by integrating digital twins with physical infrastructures, potentially enhancing transparency and enriching communication between cities and their inhabitants with real-time data. Complementing these developments, technologies realizing Conversational User Interfaces (CUIs) are becoming more capable in providing a conversational and feedback-oriented approach such as complaint management processes.
The improvement of CUIs for citizen complaint management through enhanced contextual feedback is explored in this work. The term contextual feedback has been developed and defined as all information (for example, background, conditions, explanations, timelines, and the existence of similar complaints) related to a complaint and or the underlying problem that could potentially be relevant for the user. The solution proposed in this paper gathers data from users about their issues via a CUI, which subsequently queries various data sources to obtain relevant contextual information. Following this, a Large Language Model processes the collected data to produce the corresponding feedback. In the study, a static CUI without contextual data as the baseline has been compared to a CUI that includes contextual data, analyzing their impact on pragmatic and hedonic quality, reuse intention, and potential influence on the citizens’ trust in their municipality. The study has been conducted in cooperation with the German municipality of Wadgassen. The good performance of the baseline system shows the general potential of LLMs in the citizen complaint domain even without data sources. The results show that contextual feedback performed better overall, with significant improvements in the pragmatic and hedonic quality, attractiveness, reuse intention, feeling that the complaint is taken seriously, and the citizens’ trust in their municipality.

References

[1]
Shubham Atreja, Pooja Aggarwal, Prateeti Mohapatra, Amol Dumrewal, Anwesh Basu, and Gargi B Dasgupta. 2018. Citicafe: An Interactive Interface for Citizen Engagement. International Conference on Intelligent User Interfaces, Proceedings IUI (2018), 617–628. https://doi.org/10.1145/3172944.3172955
[2]
M. Batty, K. W. Axhausen, F. Giannotti, A. Pozdnoukhov, A. Bazzani, M. Wachowicz, G. Ouzounis, and Y. Portugali. 2012. Smart cities of the future. European Physical Journal: Special Topics 214 (12 2012), 481–518. Issue 1. https://doi.org/10.1140/epjst/e2012-01703-3
[3]
Christian Brock, Julia Meik, Janine Kaiser, Sadi Al-Dari, and Bernd Handke. 2012. Der Bürger als Kunde Anliegenmanagement im öffentlichen Sektor. Springer Fachmedien Wiesbaden. 109–124 pages. https://doi.org/10.1007/978-3-531-19347-2_6
[4]
Andrés Camero and Enrique Alba. 2019. Smart City and information technology: A review. Cities 93 (10 2019), 84–94. https://doi.org/10.1016/j.cities.2019.04.014
[5]
Ana Paula Chaves and Marco Aurelio Gerosa. 2021. How Should My Chatbot Interact? A Survey on Social Characteristics in Human–Chatbot Interaction Design. International Journal of Human-Computer Interaction 37 (2021), 729–758. Issue 8. https://doi.org/10.1080/10447318.2020.1841438
[6]
Anind Dey. 2001. Understanding and Using Context. Personal and Ubiquitous Computing 5 (02 2001), 4–7. https://doi.org/10.1007/s007790170019
[7]
Anne Fota, Katja Wagner, Tobias Roeding, and Hanna Schramm-Klein. 2022. “Help! I Have a Problem” – Differences between a Humanlike and Robot-like Chatbot Avatar in Complaint Management. Proceedings of the 55th Hawaii International Conference on System Sciences 7 (2022), 4273–4282. https://doi.org/10.24251/hicss.2022.522
[8]
Momchil Hardalov, Ivan Koychev, and Preslav Nakov. 2018. Towards Automated Customer Support. (2018), 48–59. https://doi.org/10.1007/978-3-319-99344-7_5
[9]
Mike Harding, Bran Knowles, Nigel Davies, and Mark Rouncefield. 2015. HCI, Civic Engagement and Trust. Conference on Human Factors in Computing Systems - Proceedings 2015-April (4 2015), 2833–2842. https://doi.org/10.1145/2702123.2702255
[10]
Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. Vieweg+Teubner Verlag, 187–196. https://doi.org/10.1007/978-3-322-80058-9_19
[11]
Samuel Holmes, Anne Moorhead, Raymond Bond, Huiru Zheng, Vivien Coates, and Michael Mctear. 2019. Usability Testing of a Healthcare Chatbot: Can We Use Conventional Methods to Assess Conversational User Interfaces?(ECCE ’19). Association for Computing Machinery, New York, NY, USA, 207–214. https://doi.org/10.1145/3335082.3335094
[12]
Soonhee Kim and Jooho Lee. 2012. E-Participation, Transparency, and Trust in Local Government. Public Administration Review 72, 6 (2012), 819–828. https://doi.org/10.1111/j.1540-6210.2012.02593.x
[13]
Maximilien Kintz, Claudia Dukino, Matthias Blohm, and Marc Hanussek. 2020. Make Your Customers Happy Again: AI and NLP for a Customer Complaint Management Platform. (2020). https://publica-rest.fraunhofer.de/server/api/core/bitstreams/222a46f8-cbcb-4514-8da5-c08feeb984c1/content
[14]
Geok Theng Lau and Sook Han Lee. 1999. Consumers’ Trust in a Brand and the Link to Brand Loyalty., 341-370 pages. https://doi.org/10.1023/A:1009886520142
[15]
Maria Leitner. 2018. Digitale Bürgerbeteiligung Forschung und Praxis-Chancen und Herausforderungen der elektronischen Partizipation. Springer Vieweg Wiesbaden. https://doi.org/10.1007/978-3-658-21621-4
[16]
Alessandro Massaro, Vincenzo Maritati, and Angelo Galiano. 2018. Automated Self-Learning Chatbot Initially Built as a FAQS Database Information Retrieval System: Multi-level and Intelligent Universal Virtual Front-Office Implementing Neural Network. Informatica (Slovenia) 42 (2018), 515–525. Issue 4. https://doi.org/10.31449/inf.v42i4.2173
[17]
Anna S. Mattila and Daniel J. Mount. 2003. The impact of selected customer characteristics and response time on E-complaint satisfaction and return intent. International Journal of Hospitality Management 22, 2 (2003), 135–145. https://doi.org/10.1016/S0278-4319(03)00014-8
[18]
Michael McTear. 2020. Conversational AI. Springer Cham. https://doi.org/10.2200/S01060ED1V01Y202010HLT048
[19]
Piero Molino, Huaixiu Zheng, and Yi-Chia Wang. 2018. COTA: Improving the Speed and Accuracy of Customer Support through Ranking and Deep Networks. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 586–595. https://doi.org/10.1145/3219819.3219851
[20]
Jae Yun Moon and Lee S. Sproull. 2008. The Role of Feedback in Managing the Internet-Based Volunteer Work Force. Information Systems Research 19, 4 (2008), 494–515. https://doi.org/10.1287/isre.1080.0208
[21]
OpenAI. 2023. GPT-4V(ision) System Card. https://cdn.openai.com/papers/GPTV_System_Card.pdf
[22]
Cathy Pearl. 2016. Designing Voice User Interfaces: Principles of Conversational Experiences. " O’Reilly Media, Inc.".
[23]
Holger Roschk, Masoumeh Hosseinpour, and Golnaz Rezai. 2021. Supporting Complaint Management with Artificial Intelligence. (2021), 213–232. https://doi.org/10.1007/978-3-658-34326-2_8
[24]
Andreas Sackl, Sarah Thiel, and Peter Fröhlich. 2019. Smarticipate Citizen Dialog Requirements. https://www.smarticipate.eu/wp-content/uploads/smarticipate_D2.2-Citizen-dialog-design-requirements.pdf
[25]
Andreas Sackl, Sarah Kristin Thiel, Peter Fröhlich, and Manfred Tscheligi. 2018. “Thanks for Your Input. We Will Get Back to You Shortly.” How to Design Automated Feedback in Location-Based Citizen Participation Systems. Lecture Notes in Geoinformation and Cartography 0, 257–268. Issue 208669. https://doi.org/10.1007/978-3-319-71470-7_13
[26]
Dirk Schelle and Fernando Lyardet. 2006. Voice User Interface Design Patterns. https://pdfs.semanticscholar.org/6e08/7ddc8a262659fa211a2c9dc26a41e758b989.pdf
[27]
Ryan M. Schuetzler, G. Mark Grimes, Justin Scott Giboney, and Holly K. Rosser. 2021. Deciding Whether and How to Deploy Chatbots. MIS Quarterly Executive (Jan. 2021), 1–15. https://doi.org/10.17705/2msqe.00039
[28]
Priyanka Singh, Fiona Lynch, and Markus Helfert. 2021. Role of Citizens in the Development of Smart Cities: Benefit of Citizen’s Feedback for Improving Quality of Service. (2021), 35–44. Issue Smartgreens. https://doi.org/10.5220/0010442000350044
[29]
Anbang Xu, Zhe Liu, Yufan Guo, Vibha Sinha, and Rama Akkiraju. 2017. A New Chatbot for Customer Service on Social Media. Conference on Human Factors in Computing Systems - Proceedings 2017-May, 3506–3510. https://doi.org/10.1145/3025453.3025496
[30]
Hongyu Zhang, Liang Gong, and Steve Versteeg. 2013. Predicting Bug-Fixing Time: An Empirical Study of Commercial Software Projects. In 2013 35th International Conference on Software Engineering (ICSE). IEEE, 1042–1051. https://doi.org/10.1109/icse.2013.6606654
[31]
Andreas Zimmermann, Andreas Lorenz, and Reinhard Oppermann. 2007. An Operational Definition of Context. In Modeling and Using Context, Boicho Kokinov, Daniel C. Richardson, Thomas R. Roth-Berghofer, and Laure Vieu (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 558–571. https://doi.org/10.1007/978-3-540-74255-5_42

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CUI '24: Proceedings of the 6th ACM Conference on Conversational User Interfaces
July 2024
616 pages
ISBN:9798400705113
DOI:10.1145/3640794
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 July 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Citizen Engagement
  2. Context Information
  3. Conversational UI
  4. Smart City

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • BMBF - Bundesministerium für Bildung und Forschung

Conference

CUI '24
Sponsor:
CUI '24: ACM Conversational User Interfaces 2024
July 8 - 10, 2024
Luxembourg, Luxembourg

Acceptance Rates

Overall Acceptance Rate 34 of 100 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 70
    Total Downloads
  • Downloads (Last 12 months)70
  • Downloads (Last 6 weeks)19
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media