Work in Progress

Public Access

Unwritten Magic: Participatory Design of AI Dialogue to Empower Marginalized Voices

Authors:

Amanda Buddemeyer,

Jennifer Nwogu,

Jaemarie Solyst,

Leshell Hatley,

Angela StewartAuthors Info & Claims

GoodIT '22: Proceedings of the 2022 ACM Conference on Information Technology for Social Good

Pages 366 - 372

https://doi.org/10.1145/3524458.3547119

Published: 07 September 2022 Publication History

All formats PDF

Abstract

Language is an act of identity, but AI has no identity other than that which its creators assign it. Technology creators who do not fully consider how identity information is encoded in AI dialogue risk creating representational harms that negatively impact users’ interactions with the technology, particularly young users from groups marginalized in STEM education. One solution is to engage young users in Participatory Design of dialogue, pushing power away from the researcher and toward the young users. This positions users as technology creators who understand AI language as a technosocial phenomenon and who have their own perspective about how identity is best portrayed in AI language. In this work in progress paper, we provide initial impressions from a Youth Advisory Group (YAG) with 12 middle-school-aged learners of color who are all female or non-binary.

References

[1]

Patrícia Alves-Oliveira, Ana Paiva, Patrícia Arriaga, and Guy Hofman. 2021. Children as robot designers. ACM/IEEE International Conference on Human-Robot Interaction2 (2021), 399–408. https://doi.org/10.1145/3434073.3444650

Digital Library

[2]

Lindsey Arnold, Kung Jin Lee, and Jason C Yip. 2016. Co-designing with children : An approach to social robot design. 2nd Workshop on Evaluating Child Robot Interaction- HRI2016March (2016).

[3]

April Baker-Bell. 2020. Linguistic justice: Black language, literacy, identity, and pedagogy. Routledge.

[4]

Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020. Language (Technology) is Power: A Critical Survey of “Bias” in NLP. In Annual Meeting of the Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-main.485 arXiv:2005.14050

[5]

Susanne Bødker, Christian Dindler, Ole S Iversen, and Rachel C Smith. 2021. Participatory Design. Synthesis Lectures on Human-Centered Informatics 14, 5(2021), i–143.

[6]

Frank Broz, Hatice Kose-Bagci, Chrystopher L Nehaniv, and Kerstin Dautenhahn. 2009. Learning behavior for a social interaction game with a childlike humanoid robot. In Social Learning in Interactive Scenarios Workshop, Humanoids.

[7]

Mary Bucholtz. 2001. The whiteness of nerds: Superstandard English and racial markedness. Journal of linguistic anthropology 11, 1 (2001), 84–100.

[8]

Amanda Buddemeyer, Leshell Hatley, Angela Stewart, Jaemarie Solyst, Amy Ogan, and Erin Walker. 2021. Agentic Engagement with a Programmable Dialog System. In Proceedings of the 17th ACM Conference on International Computing Education Research. 423–424.

Digital Library

[9]

Amanda Buddemeyer, Erin Walker, and Malihe Alikhani. 2021. Words of Wisdom: Representational Harms in Learning From AI Communication. Presented at the 16th Annual European Conference on Technology Enhanced Learning, Workshop on Designing Learning Technologies for Equality, Diversity and Inclusion (LearnTec4EDI). http://www.pragmaticist.com/Buddemeyer_LearnTec4EDI.pdf

[10]

Sasha Costanza-Chock. 2020. Design Justice: Community-Led Practices to Build the Worlds We Need. The MIT Press, Cambridge, Massachusetts.

[11]

Crawford, Kate. 2017. The Trouble with Bias. https://www.youtube.com/watch?v=fMym_BKWQzk. Accessed: 2021-06-01.

[12]

Dario Cvencek, Andrew N Meltzoff, and Anthony G Greenwald. 2011. Math–gender stereotypes in elementary school children. Child development 82, 3 (2011), 766–779.

[13]

Allison Druin. 1999. Cooperative inquiry: Developing new technologies for children with children. Conference on Human Factors in Computing Systems - Proceedings (1999), 592–599. https://doi.org/10.1145/302979.303166

Digital Library

[14]

Allison Druin, Benjamin B Bederson, Juan Pablo Hourcade, Lisa Sherman, Glenda Revelle, Michele Platner, and Stacy Weng. 2001. Designing a digital library for young children. In Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries. 398–405.

Digital Library

[15]

Christopher Emdin. 2016. For White folks who teach in the hood... and the rest of y’all too: Reality pedagogy and urban education. Beacon Press.

[16]

Carmen Fought. 2006. Language and ethnicity. Cambridge University Press.

[17]

Radhika Garg and Subhasree Sengupta. 2020. Conversational Technologies for In-home Learning: Using Co-Design to Understand Children’s and Parents’ Perspectives. Conference on Human Factors in Computing Systems - Proceedings (2020), 1–13. https://doi.org/10.1145/3313831.3376631

Digital Library

[18]

Christina N. Harrington and Tawanna R. Dillahunt. 2021. Eliciting tech futures among black young adults: A case study of remote speculative co-design. Conference on Human Factors in Computing Systems - Proceedings (2021). https://doi.org/10.1145/3411764.3445723

Digital Library

[19]

Dirk Hovy and Diyi Yang. 2021. The Importance of Modeling Social Factors of Language: Theory and Practice. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. https://public.flourish.studio/visua

[20]

Natalie S. King and Rose M. Pringle. 2019. Black girls speak STEM: Counterstories of informal and formal learning experiences. Journal of Research in Science Teaching 56, 5 (2019), 539–569. https://doi.org/10.1002/tea.21513

[21]

Robert Brock Le Page and Andrée Tabouret-Keller. 1985. Acts of identity : Creole-based approaches to language and ethnicity. Cambridge University Press, Cambridge, New York.

[22]

Naja A. Mack, Dekita G.Moon Rembert, Robert Cummings, and Juan E. Gilbert. 2019. Co-designing an intelligent conversational history tutor with children. Proceedings of the 18th ACM International Conference on Interaction Design and Children, IDC 2019(2019), 482–487. https://doi.org/10.1145/3311927.3325336

Digital Library

[23]

John Maloney, Mitchel Resnick, Natalie Rusk, Brian Silverman, and Evelyn Eastmond. 2010. The scratch programming language and environment. ACM Transactions on Computing Education (TOCE) 10, 4 (2010), 1–15.

Digital Library

[24]

Sally McConnell-Ginet and Penelope Eckert. 2003. Language and gender. Cambridge University Press.

[25]

Neema Moraveji, Jason Li, Jiarong Ding, Patrick O’Kelley, and Suze Woolf. 2007. Comicboarding: using comics as proxies for participatory design with children. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1371–1374.

Digital Library

[26]

Amy Ogan, Samantha Finkelstein, Elijah Mayfield, Claudia D’adamo, Noboru Matsuda, and Justine Cassell. 2012. ”Oh, dear Stacy!” Social Interaction, Elaboration, and Learning with Teachable Agents.

[27]

Yolanda A Rankin and Kallayah K Henderson. 2021. Resisting Racism in Tech Design: Centering the Experiences of Black Youth. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1(2021), 1–32. https://doi.org/10.1145/3449291

Digital Library

[28]

Sarah L Rodriguez and Kathleen Lehman. 2017. Developing the next generation of diverse computer scientists: the need for enhanced, intersectional computing identity theory. Computer Science Education 27, 3-4 (2017), 229–247.

[29]

Jennifer Roth‐Gordon. 2020. Language and Creativity: Slang. The International Encyclopedia of Linguistic Anthropology (2020), 1–8. https://doi.org/10.1002/9781118786093.iela0192

[30]

Kimberly A Scott and Patricia Garcia. 2016. Techno-Social Change Agents: Fostering Activist Dispositions Among Girls of Color. Meridians: Feminism, Race 15, 1 (2016), 65–85. https://doi.org/10.2979/meridians.15.1.05

[31]

Kimberly A Scott, Kimberly M Sheridan, and Kevin Clark. 2015. Culturally Responsive Computing: a Theory Revisited. Learning, Media and Technology 40, 4 (2015), 412–436. https://doi.org/10.1080/17439884.2014.924966

[32]

Mia S. Shaw and Yasmin B. Kafai. 2020. Charting the identity turn in K-12 computer science education: Developing more inclusive learning pathways for identities. In 14th International Conference of the Learning Sciences (ICLS) 2020, Vol. 1. 114–121.

[33]

Jeff Siegel. 2006. Language ideologies and the education of speakers of marginalized language varieties: Adopting a critical awareness approach. Linguistics and Education 17, 2 (2006), 157–174.

[34]

Katta Spiel, Emeline Brulé, Christopher Frauenberger, Gilles Bailly, Katta Spiel, Emeline Brulé, Christopher Frauenberger, Gilles Bailly, Geraldine Fitzpatrick Micro, Emeline Brulé, Christopher Frauenberger, Gilles Bailly, and Geraldine Fitzpatrick. 2018. Micro-Ethics for Participatory Design with Marginalised Children To cite this version : HAL Id : hal-01839208 Micro-Ethics for Participatory Design with Marginalised Children. (2018).

[35]

Khai N Truong, Gillian R Hayes, and Gregory D Abowd. 2006. Storyboarding: an empirical determination of best practices and effective guidelines. In Proceedings of the 6th conference on Designing Interactive systems. 12–21.

Digital Library

[36]

Greg Walsh, Elizabeth Ross, Jason Yip, and Allison Druin. 2013. Octoract: an eight-dimensional framework for intergenerational participatory design techniques. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 13 (2013), 1–10.

Digital Library

[37]

Martin J Wasserberg. 2014. Stereotype threat effects on African American children in an urban elementary school. The journal of experimental education 82, 4 (2014), 502–517.

[38]

Walt Wolfram. 2004. Social Varieties of American English. Language in the USA: Themes for the Twenty-First Century (2004), 58–75. https://doi.org/10.1017/CBO9780511809880.006

[39]

Jason C. Yip, Kiley Sobel, Xin Gao, Allison Marie Hishikawa, Alexis Lim, Laura Meng, Romaine Flor Ofana, Justin Park, and Alexis Hiniker. 2019. Laughing is scary, but farting is cute a conceptual model of children’s perspectives of creepy technologies. Conference on Human Factors in Computing Systems - Proceedings (2019), 1–15. https://doi.org/10.1145/3290605.3300303

Digital Library

Cited By

Nazari ZVahidi AMusilek P(2024)Blockchain and Artificial Intelligence Non-Formal Education System (BANFES)Education Sciences10.3390/educsci1408088114:8(881)Online publication date: 12-Aug-2024
https://doi.org/10.3390/educsci14080881
Joshi STolloczko CWenaas SHolm OLangved M(2024)Investigating How Generative AI Affects Decision-Making in Participatory Design: Shifting the space to make design choicesProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685384(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685384
Stigberg SCarcani KJoshi SBratteteig T(2024)Participatory Design meets Artificial Intelligence: Co-imagining mutual learning of AI technologies and designing with AI toolsAdjunct Proceedings of the 2024 Nordic Conference on Human-Computer Interaction10.1145/3677045.3685471(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3677045.3685471
Show More Cited By

Index Terms

Unwritten Magic: Participatory Design of AI Dialogue to Empower Marginalized Voices

Recommendations

Intersectionality and cyberbullying

Display Omitted Our paper applies an intersectional approach to the study of cyberbullying.We explore the conditional impact of race, gender, and sexuality on victimization.We conducted an original survey of students in a Midwestern high school (N=752)...
The Influence of Gender-Ethnic Intersectionality on Gender Stereotypes about IT Skills and Knowledge

One line of investigation in attempting to better understand the gender imbalance in the information technology (IT) field is to examine gender stereotypes about the skills and knowledge in the IT profession. A survey of 4046 university students in the ...
Understanding underrepresentation in IT through intersectionality
iConference '12: Proceedings of the 2012 iConference

Results of an investigation of the effect of intersectionality on perceptions of university students about IT careers are presented. This analysis deepens the discussion began at the 2011 iConference by presenting an examination of responses of African ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

GoodIT '22: Proceedings of the 2022 ACM Conference on Information Technology for Social Good

September 2022

436 pages

ISBN:9781450392846

DOI:10.1145/3524458

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCAS: ACM Special Interest Group on Computers and Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2022

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Funding Sources

Google Award for Inclusion Research Program
National Science Foundation

Conference

GoodIT 2022

Sponsor:

SIGCAS

GoodIT 2022: ACM International Conference on Information Technology for Social Good

September 7 - 9, 2022

Limassol, Cyprus

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
635
Total Downloads

Downloads (Last 12 months)334
Downloads (Last 6 weeks)48

Reflects downloads up to 14 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nazari ZVahidi AMusilek P(2024)Blockchain and Artificial Intelligence Non-Formal Education System (BANFES)Education Sciences10.3390/educsci1408088114:8(881)Online publication date: 12-Aug-2024
https://doi.org/10.3390/educsci14080881
Joshi STolloczko CWenaas SHolm OLangved M(2024)Investigating How Generative AI Affects Decision-Making in Participatory Design: Shifting the space to make design choicesProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685384(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685384
Stigberg SCarcani KJoshi SBratteteig T(2024)Participatory Design meets Artificial Intelligence: Co-imagining mutual learning of AI technologies and designing with AI toolsAdjunct Proceedings of the 2024 Nordic Conference on Human-Computer Interaction10.1145/3677045.3685471(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3677045.3685471
Wong NJeong SReddy MStamatis CLattie EJacobs M(2024)Voice Assistants for Mental Health Services: Designing Dialogues with Homebound Older AdultsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661536(844-858)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661536
Famaye TIrgens GAdisa I(2024)Shifting roles and slow research: children’s roles in participatory co-design of critical machine learning activities and technologiesBehaviour & Information Technology10.1080/0144929X.2024.2313147(1-22)Online publication date: 7-Feb-2024
https://doi.org/10.1080/0144929X.2024.2313147
Hayes PFitzpatrick NFerrández J(2024)From applied ethics and ethical principles to virtue and narrative in AI practicesAI and Ethics10.1007/s43681-024-00472-zOnline publication date: 8-Apr-2024
https://doi.org/10.1007/s43681-024-00472-z

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten