Comic-boarding with Children: Understanding the use of Language in Human-Human and Human-Agent Dialogue
Authors: 
Jennifer Nwogu, Amanda Buddemeyer, Rosta Farzan, 
Angela E.B. Stewart, Erin WalkerAuthors Info & Claims
Pages 667 - 671
Abstract
The intersection of language and identity refers to the ways in which language use reflects and shapes one's sense of self and group membership. It is important to design voice-based technologies that represent and support diverse types of identities to increase accessibility. Due to constraints in the data and algorithms used to train and improve artificial intelligence (AI) systems like social robots or voice assistants, they are often unable to represent certain dialects of English and other languages. This could result in data bias, identity exclusion, and communication barriers that can impact the user's outcomes when using such dialects. Technology companies are discussing how to close this gap by improving training data; however, some researchers believe that the intersection of identity and technology calls for effective collaborative design methodologies that involve intended users. This work-in-progress paper presents preliminary findings on a participatory design method, comic-boarding, that can accomplish the above goal. Using comic-boarding, our intention is to create a space for critical reflection on language and identity in human-human and human-agent dialogue for children from marginalized communities.
References
[1]
Bannon, Liam, Jeffrey Bardzell, and Susanne Bødker. "Introduction: Reimagining participatory design—Emerging voices." ACM Transactions on Computer-Human Interaction (TOCHI) 25.1 (2018): 1-8.
[2]
Beelen, Thomas, "Designing Conversational Robots with Children during the Pandemic." arXiv preprint arXiv:2205.11300 (2022).
[3]
Beirl, Diana, Y. Rogers, and Nicola Yuill. "Using voice assistant skills in family life." Computer-Supported Collaborative Learning Conference, CSCL. Vol. 1. International Society of the Learning Sciences, Inc., 2019.
[4]
Benner, Dennis, "What do you mean? a review on recovery strategies to overcome conversational breakdowns of conversational agents." International Conference on Information Systems (ICIS). 2021.
[5]
Blodgett, Su Lin, and Brendan O'Connor. "Racial disparity in natural language processing: A case study of social media african-american english." arXiv preprint arXiv:1707.00061 (2017).
[6]
Harrington, Christina N., "“It's Kind of Like Code-Switching”: Black Older Adults’ Experiences with a Voice Assistant for Health Information Seeking." CHI Conference on Human Factors in Computing Systems. 2022.
[7]
D. Harwell, B. Mayes, M. Walls, S. Hashemi, The accent gap. The Washington Post, 19 July 2018. https://www.washingtonpost.com/graphics/2018/business/alexa-does-not-understand-your-accent/. Accessed 3 March 2023.
[8]
Hussain, Sofia. "Empowering marginalized children in developing countries through participatory design processes." CoDesign 6.2 (2010): 99-117.
[9]
Iversen, Ole Sejer, Rachel Charlotte Smith, and Christian Dindler. "Child as protagonist: Expanding the role of children in participatory design." Proceedings of the 2017 conference on interaction design and children. 2017.
[10]
Kitashov, Fedor, Elizaveta Svitanko, and Debojyoti Dutta. "Foreign English accent adjustment by learning phonetic patterns." arXiv preprint arXiv:1807.03625 (2018).
[11]
Knapp, Melanie Hines. "African American Vernacular English (AAVE) In The Classroom: The Attitudes And Ideologies Of Urban Educators Toward AAVE." (2015).
[12]
Koenecke, Allison, "Racial disparities in automated speech recognition." Proceedings of the National Academy of Sciences 117.14 (2020): 7684- 7689.
[13]
Koch, Lisa M., Alan M. Gross, and Russell Kolts. "Attitudes toward Black English and code switching." Journal of Black psychology 27.1 (2001): 29- 42.
[14]
Lambeens, Tom, and Kris Pint. "12 The Interaction of Image and Text in Modern Comics." Texts, Transmissions, Receptions. Brill, 2015. 240-257.
[15]
Li, Yinmiao, "“I Want to Be Unique From Other Robots”: Positioning Girls as Co-creators of Social Robots in Culturally-Responsive Computing Education." Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 2023.
[16]
Moraveji, Neema, "comic-boarding: using comics as proxies for participatory design with children." Proceedings of the SIGCHI conference on Human factors in computing systems. 2007.
[17]
Om, Chimi. Designing interactive technologies to enhance nature engagement for children in urban Bhutan. Diss. Queensland University of Technology, 2022.
[18]
Powell, Denise, "The telling board: an interactive storyboarding tool for children." Proceedings of the 17th ACM conference on interaction design and children. 2018.
[19]
Read, Janet C., Daniel Fitton, and Matthew Horton. "Theatre, playdoh and comic strips: designing organic user interfaces with young adolescent and teenage participants." Interacting with Computers 25.2 (2013): 183-198.
[20]
Read, Janet C., Daniel Fitton, and Matthew Horton. "Giving ideas an equal chance: inclusion and representation in participatory design with children." Proceedings of the 2014 conference on Interaction design and children. 2014.
[21]
Rose, Emma J., and Elin A. Björling. "Designing for engagement: using participatory design to develop a social robot to measure teen stress." Proceedings of the 35th ACM International Conference on the Design of Communication. 2017.
[22]
Saad-Sulonen, Joanna, "Unfolding participation over time: temporal lenses in participatory design." CoDesign 14.1 (2018): 4-16.
[23]
Terzopoulos, George, and Maya Satratzemi. "Voice assistants and smart speakers in everyday life and in education." Informatics in Education 19.3 (2020): 473-490.
[24]
Walsh, Greg, "Layered elaboration: a new technique for co-design with children." Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2010.
Index Terms
- Comic-boarding with Children: Understanding the use of Language in Human-Human and Human-Agent Dialogue
Recommendations
Training a Dialogue Act Tagger for human-human and human-computer travel dialogues
SIGDIAL '02: Proceedings of the 3rd SIGdial workshop on Discourse and dialogue - Volume 2While dialogue acts provide a useful schema for characterizing dialogue behaviors in human-computer and human-human dialogues, their utility is limited by the huge effort involved in hand-labelling dialogues with a dialogue act labelling scheme. In this ...
Route instructions in map-based human-human and human-computer dialogue: A comparative analysis
When conveying information about spatial situations and goals, speakers adapt flexibly to their addressee in order to reach the communicative goal efficiently and effortlessly. Our aim is to equip a dialogue system with the abilities required for such a ...
Human-robot collaborative tutoring using multiparty multimodal spoken dialogue
HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interactionIn this paper, we describe a project that explores a novel experimental setup towards building a spoken, multi-modally rich, and human-like multiparty tutoring robot. A human-robot interaction setup is designed, and a human-human dialogue corpus is ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2023
824 pages
ISBN:9798400701313
DOI:10.1145/3585088
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 June 2023
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Conference
IDC '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 172 of 578 submissions, 30%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 153Total Downloads
- Downloads (Last 12 months)97
- Downloads (Last 6 weeks)3
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format