poster

Leveraging the Crowd to Support the Conversation Design Process

Authors:

Yoonseo Choi,

Hyungyu Shin,

Toni-Jan Keith Monserrat,

Nyoungwoo Lee,

Jeongeon Park,

Juho KimAuthors Info & Claims

CUI '20: Proceedings of the 2nd Conference on Conversational User Interfaces

Article No.: 50, Pages 1 - 4

https://doi.org/10.1145/3405755.3406155

Published: 22 July 2020 Publication History

Get Access

Abstract

Building a chatbot with human-like conversation capabilities is essential for users to feel more natural in task completion. Many designers try to collect human conversation data and apply them into a chatbot conversation, aiming that it could work like a human conversation. To support conversation design, we propose the idea of inviting the crowd into the design process, where crowd workers contribute to improving the designed conversation. To explore this idea, we developed ProtoChat, a prototype system that supports a conversation design process by (1) allowing the crowd to actively suggest new utterances based on designers' pre-written design and (2) visually representing crowdsourced conversation data so that designers can analyze and improve their conversation design. Results of an exploratory study indicated that the crowd is helpful in providing insights and ideas as designers explore the design space.

References

[1]

Ram G. Athreya, Axel-Cyrille Ngonga Ngomo, and Ricardo Usbeck. 2018. Enhancing Community Interactions with Data-Driven Chatbots-The DBpedia Chatbot. In Companion Proceedings of the The Web Conference 2018 (Lyon, France) (WWW '18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 143--146. https://doi.org/10.1145/3184558.3186964

Digital Library

Google Scholar

[2]

Yoonseo Choi, Hyungyu Shin, Toni-Jan Keith Palma Monserrat, Nyoungwoo Lee, Jeongeon Park, and Juho Kim. 2020. Supporting an Iterative Conversation Design Process (To appear). In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). Association for Computing Machinery, New York, NY, USA, Article LBW1458, 6 pages.

Google Scholar

[3]

Tianran Hu, Anbang Xu, Zhe Liu, Quanzeng You, Yufan Guo, Vibha Sinha, Jiebo Luo, and Rama Akkiraju. 2018. Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 415, 12 pages. https://doi.org/10.1145/3173574.3173989

Digital Library

Google Scholar

[4]

Meng-Chieh Ko and Zih-Hong Lin. 2018. CardBot: A Chatbot for Business Card Management. In Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion (Tokyo, Japan) (IUI '18 Companion). ACM, New York, NY, USA, Article 5, 2 pages. https://doi.org/10.1145/3180308.3180313

Digital Library

Google Scholar

[5]

Rafal Kocielnik, Lillian Xiao, Daniel Avrahami, and Gary Hsieh. 2018. Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 2, Article 70 (July 2018), 26 pages. https://doi.org/10.1145/3214273

Digital Library

Google Scholar

[6]

Walter S. Lasecki, Rachel Wesley, Jeffrey Nichols, Anand Kulkarni, James F. Allen, and Jeffrey P. Bigham. 2013. Chorus: A Crowd-Powered Conversational Assistant. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST '13). Association for Computing Machinery, New York, NY, USA, 151--162. https://doi.org/10.1145/2501988.2502057

Digital Library

Google Scholar

[7]

Archana Prasad, Sean Blagsvedt, Tej Pochiraju, and Indrani Medhi Thies. 2019. Dara: A Chatbot to Help Indian Artists and Designers Discover International Opportunities. In Proceedings of the 2019 on Creativity and Cognition (San Diego, CA, USA) (C&C '19). ACM, New York, NY, USA, 626--632. https://doi.org/10.1145/3325480.3326577

Digital Library

Google Scholar

[8]

Anbang Xu, Zhe Liu, Yufan Guo, Vibha Sinha, and Rama Akkiraju. 2017. A New Chatbot for Customer Service on Social Media. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). ACM, New York, NY, USA, 3506--3510. https://doi.org/10.1145/3025453.3025496

Digital Library

Google Scholar

[9]

Li Zhou, Jianfeng Gao, Di Li, and Heung-Yeung Shum. 2018. The Design and Implementation of XiaoIce, an Empathetic Social Chatbot. CoRR abs/1812.08989 (2018). arXiv:1812.08989 http://arxiv.org/abs/1812.08989

Google Scholar

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Guyre MHolland LShah NDivekar R(2024)Prompt Engineering an LLM into Roleplaying a Management Coach: a Short Guide by and for Non-NLP ExpertsProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665570(1-10)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665570

Index Terms

Leveraging the Crowd to Support the Conversation Design Process
1. Human-centered computing
  1. Interaction design

Recommendations

Supporting an Iterative Conversation Design Process
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Conversation design is an essential step in building a chatbot. Much like visual user interface design, conversation design benefits from prototyping and user testing to allow for conversation exploration and improvement. However, it can be overwhelming ...
ProtoChat: Supporting the Conversation Design Process with Crowd Feedback
CSCW '20 Companion: Companion Publication of the 2020 Conference on Computer Supported Cooperative Work and Social Computing

Conversation designers use iterative design to create, test, and improve conversation flows. While it is possible to iterate conversation design with existing chatbot prototyping tools, challenges remain such as recruiting participants and collecting ...
ProtoChat: Supporting the Conversation Design Process with Crowd Feedback
CSCW

Similar to a design process for designing graphical user interfaces, conversation designers often apply an iterative design process by defining a conversation flow, testing with users, reviewing user data, and improving the design. While it is possible ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CUI '20: Proceedings of the 2nd Conference on Conversational User Interfaces

July 2020

271 pages

ISBN:9781450375443

DOI:10.1145/3405755

Conference Chairs:
María Inés Torres,
Stephan Schlögl,
Program Chairs:
Leigh Clark,
Martin Porcheron

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2020

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Samsung Research, Samsung Electronics Co.,Ltd

Conference

CUI '20

CUI '20: 2nd Conference on Conversational User Interfaces

July 22 - 24, 2020

Bilbao, Spain

Acceptance Rates

CUI '20 Paper Acceptance Rate 13 of 39 submissions, 33%;

Overall Acceptance Rate 34 of 100 submissions, 34%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
129
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)2

Reflects downloads up to 12 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Guyre MHolland LShah NDivekar R(2024)Prompt Engineering an LLM into Roleplaying a Management Coach: a Short Guide by and for Non-NLP ExpertsProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665570(1-10)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665570

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Supporting an Iterative Conversation Design Process

ProtoChat: Supporting the Conversation Design Process with Crowd Feedback

ProtoChat: Supporting the Conversation Design Process with Crowd Feedback

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations