research-article

User Perspectives on Ethical Challenges in Human-AI Co-Creativity: A Design Fiction Study

Authors:

Mary Lou MaherAuthors Info & Claims

C&C '23: Proceedings of the 15th Conference on Creativity and Cognition

Pages 62 - 74

https://doi.org/10.1145/3591196.3593364

Published: 19 June 2023 Publication History

Abstract

In a human-AI co-creation, AI not only categorizes, evaluates and interprets data but also generates new content and interacts with humans. As co-creative AI is a form of intelligent technology that directly involves humans, it is critical to anticipate and address ethical issues during all design stages. The open-ended nature of human-AI interactions in co-creation poses many challenges for designing ethical co-creative AI systems. Researchers have been exploring ethical issues associated with autonomous AI in recent years, but ethics in human-AI co-creativity is a relatively new research area. In order to design human-centered ethical AI, it is important to understand the perspectives, expectations, and ethical concerns of potential users. In this paper, we present a study with 18 participants to explore several ethical dilemmas and challenges in human-AI co-creation from the perspective of potential users using a design fiction (DF) methodology. DF is a speculative research method that depicts a new concept or technology through stories as an intangible prototype. We present the findings from the study as potential users’ perspectives, stances, and expectations around ethical challenges in human-AI co-creativity as a basis for designing human-centered ethical AI partners for human-AI co-creation.

References

[1]

[n.d.]. ChatGPT: Optimizing Language Models for Dialogue — openai.com. https://openai.com/blog/chatgpt/.

[2]

[n.d.]. DALL·E 2 — openai.com. https://openai.com/dall-e-2/.

[3]

[n.d.]. GitHub Copilot · Your AI pair programmer — github.com. https://github.com/features/copilot.

[4]

Theo Araujo, Natali Helberger, Sanne Kruikemeier, and Claes H De Vreese. 2020. In AI we trust? Perceptions about automated decision-making by artificial intelligence. AI & SOCIETY 35, 3 (2020), 611–623.

Digital Library

[5]

Gary Bente, Sabine Rüggenberg, and Nicole C Krämer. 2004. Social presence and interpersonal trust in avatar-based, collaborative net-communications. In Proceedings of the Seventh Annual International Workshop on Presence. 54–61.

[6]

Julian Bleecker. 2022. Design fiction: A short essay on design, science, fact, and fiction. Machine Learning and the City: Applications in Architecture and Urban Design (2022), 561–578.

[7]

Mark Blythe. 2014. Research through design fiction: narrative in real and imaginary abstracts. In Proceedings of the SIGCHI conference on human factors in computing systems. 703–712.

Digital Library

[8]

Michał Boni. 2021. The ethical dimension of human–artificial intelligence collaboration. European View 20, 2 (2021), 182–190.

[9]

Virginia Braun and Victoria Clarke. 2012. Thematic analysis. (2012).

[10]

Barry Brown, Julian Bleecker, Marco D’adamo, Pedro Ferreira, Joakim Formo, Mareike Glöss, Maria Holm, Kristina Höök, Eva-Carin Banka Johnson, Emil Kaburuan, 2016. The IKEA Catalogue: Design fiction in academic and industrial collaborations. In Proceedings of the 19th International Conference on Supporting Group Work. 335–344.

Digital Library

[11]

Daniel Buschek, Lukas Mecke, Florian Lehmann, and Hai Dang. 2021. Nine Potential Pitfalls when Designing Human-AI Co-Creative Systems. arXiv preprint arXiv:2104.00358 (2021).

[12]

Amit K Chopra and Munindar P Singh. 2018. Sociotechnical systems and ethics in the large. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society. 48–53.

Digital Library

[13]

James A Crowder, John Carbone, and Shelli Friess. 2020. Human–AI Collaboration. In Artificial Psychology. Springer, 35–50.

[14]

Nicholas Davis. 2013. Human-computer co-creativity: Blending human and computational creativity. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 9.

[15]

Nicholas Davis, Chih-Pin Hsiao, Yanna Popova, and Brian Magerko. 2015. An enactive model of creativity for computational collaboration and co-creation. In Creativity in the Digital Age. Springer, 109–133.

[16]

Nicholas Davis, Chih-PIn Hsiao, Kunwar Yashraj Singh, Lisa Li, and Brian Magerko. 2016. Empirically studying participatory sense-making in abstract drawing with a co-creative cognitive agent. In Proceedings of the 21st International Conference on Intelligent User Interfaces. 196–207.

Digital Library

[17]

Arne Dietrich. 2004. The cognitive neuroscience of creativity. Psychonomic bulletin & review 11, 6 (2004), 1011–1026.

[18]

Paul Dourish and Genevieve Bell. 2014. “Resistance is futile”: reading science fiction alongside ubiquitous computing. Personal and Ubiquitous Computing 18, 4 (2014), 769–778.

Digital Library

[19]

Anthony Dunne and Fiona Raby. 2013. Speculative everything: design, fiction, and social dreaming. MIT press.

Digital Library

[20]

Christopher Flathmann, Beau G Schelble, Rui Zhang, and Nathan J McNeese. 2021. Modeling and Guiding the Creation of Ethical Human-AI Teams. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society. 469–479.

Digital Library

[21]

Cary Funk, Alec Tyson, Brian Kennedy, and Courtney Johnson. 2020. Science and scientists held in high esteem across global publics. Pew research center 29 (2020).

[22]

Katy Ilonka Gero and Lydia B Chilton. 2019. Metaphoria: An algorithmic companion for metaphor creation. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–12.

Digital Library

[23]

Simon Grand and Martin Wiedmer. 2010. Design fiction: a method toolbox for design research in a complex world. (2010).

[24]

Niklas Gudowsky and Aaron Rosa. 2019. Bridging epistemologies—identifying uniqueness of lay and expert knowledge for agenda setting. Futures 109 (2019), 24–38.

[25]

Guy Hoffman and Gil Weinberg. 2010. Shimon: an interactive improvisational robotic marimba player. In CHI’10 Extended Abstracts on Human Factors in Computing Systems. 3097–3102.

[26]

Guy Hoffman and Gil Weinberg. 2011. Interactive improvisation with a robotic marimba player. Autonomous Robots 31, 2-3 (2011), 133–153.

Digital Library

[27]

Stephanie Houde and Charles Hill. 1997. What do prototypes prototype? In Handbook of human-computer interaction. Elsevier, 367–381.

[28]

Kyle E Jennings, Dean Keith Simonton, and Stephen E Palmer. 2011. Understanding exploratory creativity in a visual domain. In Proceedings of the 8th ACM conference on Creativity and cognition. 223–232.

Digital Library

[29]

Rex Eugene Jung, Brittany S Mead, Jessica Carrasco, and Ranee A Flores. 2013. The structure of creative cognition in the human brain. Frontiers in human neuroscience 7 (2013), 330.

[30]

Anna Kantosalo 2019. Human-Computer Co-Creativity: Designing, Evaluating and Modelling Computational Collaborators for Poetry Writing. (2019).

[31]

Anna Kantosalo, Prashanth Thattai Ravikumar, Kazjon Grace, and Tapio Takala. 2020. Modalities, Styles and Strategies: An Interaction Framework for Human-Computer Co-Creativity. In ICCC. 57–64.

[32]

Anna Kantosalo, Jukka M Toivanen, Ping Xiao, and Hannu Toivonen. 2014. From Isolation to Involvement: Adapting Machine Creativity Software to Support Human-Computer Co-Creation. In ICCC. 1–7.

[33]

Anna Kantosalo and Hannu Toivonen. 2016. Modes for creative human-computer collaboration: Alternating and task-divided co-creativity. In Proceedings of the seventh international conference on computational creativity. 77–84.

[34]

Pegah Karimi, Kazjon Grace, Mary Lou Maher, and Nicholas Davis. 2018. Evaluating creativity in computational co-creative systems. arXiv preprint arXiv:1807.09886 (2018).

[35]

Pegah Karimi, Jeba Rezwana, Safat Siddiqui, Mary Lou Maher, and Nasrin Dehbozorgi. 2020. Creative sketching partner: an analysis of human-AI co-creativity. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 221–230.

Digital Library

[36]

Tom Kelley. 2001. Prototyping is the shorthand of innovation. Design Management Journal (Former Series) 12, 3 (2001), 35–42.

[37]

Kangsoo Kim, Luke Boelling, Steffen Haesler, Jeremy Bailenson, Gerd Bruder, and Greg F Welch. 2018. Does a digital assistant need a body? The influence of visual embodiment and social behavior on the perception of intelligent virtual agents in AR. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 105–114.

[38]

Q Vera Liao, Matthew Davis, Werner Geyer, Michael Muller, and N Sadat Shami. 2016. What can you do? Studying social-agent orientation and agent proactive interactions with an agent for employees. In Proceedings of the 2016 acm conference on designing interactive systems. 264–275.

Digital Library

[39]

Joseph Lindley and Robert Potts. 2014. A machine learning: an example of HCI prototyping with design fiction. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational. 1081–1084.

Digital Library

[40]

Maria Teresa Llano and Jon McCormack. 2020. Existential Risks of Co-Creative Systems. In Workshop on the Future of Co-creative Systems 2020. Association for Computational Creativity (ACC).

[41]

Jennifer M Logg, Julia A Minson, and Don A Moore. 2019. Algorithm appreciation: People prefer algorithmic to human judgment. Organizational Behavior and Human Decision Processes 151 (2019), 90–103.

[42]

Duri Long, Mikhail Jacob, Nicholas Davis, and Brian Magerko. 2017. Designing for socially interactive systems. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. 39–50.

Digital Library

[43]

Ezio Manzini. 2015. Design, when everybody designs: An introduction to design for social innovation. MIT press.

[44]

Thomas Markussen and Eva Knutz. 2013. The Poetics of Design Fiction. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces (Newcastle upon Tyne, United Kingdom) (DPPI ’13). Association for Computing Machinery, New York, NY, USA, 231–240. https://doi.org/10.1145/2513506.2513531

Digital Library

[45]

Thomas Memmel, Fredrik Gundelsweiler, and Harald Reiterer. 2007. Agile human-centered software engineering. In BCS-HCI’07: 21st British HCI Group Annual Conference on People and Computers. 167–175.

[46]

Brent Mittelstadt. 2019. Principles alone cannot guarantee ethical AI. Nature Machine Intelligence 1, 11 (2019), 501–507.

[47]

Masahiro Mori, Karl F MacDorman, and Norri Kageki. 2012. The uncanny valley [from the field]. IEEE Robotics & automation magazine 19, 2 (2012), 98–100.

[48]

Michael Muller and Q Vera Liao. 2017. Exploring AI Ethics and Values through Participatory Design Fictions. Human Computer Interaction Consortium (2017).

[49]

Michael Muller, Steven Ross, Stephanie Houde, Mayank Agarwal, Fernando Martinez, John Richards, Kartik Talamadupula, Justin D Weisz, AI Human-Centered, Sahil Suneja, 2022. Drinking Chai with Your (AI) Programming Partner: A Design Fiction about Generative AI for Software Engineering. (2022).

[50]

Larissa Vivian Nägele, Merja Ryöppy, and Danielle Wilde. 2018. PDFi: participatory design fiction with vulnerable users. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. 819–831.

Digital Library

[51]

SANTIAGO NEGRETE YANKELEVICH and NORA ANGELICA MORALES ZARAGOZA. 2014. The apprentice framework: planning and assessing creativity. Fifth International Conference on Computational Creativity.

[52]

Hao Nie, Xianpei Han, Ben He, Le Sun, Bo Chen, Wei Zhang, Suhui Wu, and Hao Kong. 2019. Deep sequence-to-sequence entity matching for heterogeneous entity resolution. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 629–638.

Digital Library

[53]

Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I lead, you help but only with enough details: Understanding user experience of co-creation with artificial intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[54]

Sarvapali D Ramchurn, Sebastian Stein, and Nicholas R Jennings. 2021. Trustworthy human-AI partnerships. Iscience 24, 8 (2021), 102891.

[55]

Jeba Rezwana and Mary Lou Maher. 2022. Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems. ACM Transactions on Computer-Human Interaction (2022).

[56]

Jeba Rezwana and Mary Lou Maher. 2022. Identifying Ethical Issues in AI Partners in Human-AI Co-Creation. arXiv preprint arXiv:2204.07644 (2022).

[57]

Jeba Rezwana and Mary Lou Maher. 2022. Understanding User Perceptions, Collaborative Experience and User Engagement in Different Human-AI Interaction Designs for Co-Creative Systems. In Creativity and Cognition. 38–48.

[58]

Elayne Ruane, Abeba Birhane, and Anthony Ventresque. 2019. Conversational AI: Social and Ethical Considerations. In AICS. 104–115.

[59]

Stuart Russell, Sabine Hauert, Russ Altman, and Manuela Veloso. 2015. Ethics of artificial intelligence. Nature 521, 7553 (2015), 415–416.

[60]

E B-N Sanders. 2000. Generative tools for co-designing. In Collaborative design: Proceedings of codesigning 2000. Springer, 3–12.

[61]

Keng Siau and Weiyu Wang. 2020. Artificial intelligence (AI) ethics: ethics of AI and ethical AI. Journal of Database Management (JDM) 31, 2 (2020), 74–87.

[62]

Bruce Sterling. 2005. Shaping things.

[63]

Theresa Jean Tanenbaum, Marcel Pufal, and Karen Tanenbaum. 2016. The limits of our imagination: design fiction as a strategy for engaging with dystopian futures. In Proceedings of the Second Workshop on Computing within Limits. 1–9.

Digital Library

[64]

Neil Thurman, Judith Moeller, Natali Helberger, and Damian Trilling. 2019. My friends, editors, algorithms, and I: Examining audience attitudes to news selection. Digital journalism 7, 4 (2019), 447–469.

[65]

Suzanne Tolmeijer, Markus Christen, Serhiy Kandul, Markus Kneer, and Abraham Bernstein. 2022. Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making. In CHI Conference on Human Factors in Computing Systems. 1–17.

[66]

Wendell Wallach and Colin Allen. 2008. Moral machines: Teaching robots right from wrong. Oxford University Press.

[67]

Dakuo Wang, Pattie Maes, Xiangshi Ren, Ben Shneiderman, Yuanchun Shi, and Qianying Wang. 2021. Designing AI to Work with or for People?. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–5.

Digital Library

[68]

Jess Whittlestone, Rune Nyrup, Anna Alexandrova, and Stephen Cave. 2019. The role and limits of principles in AI ethics: towards a focus on tensions. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society. 195–200.

Digital Library

[69]

Wei Xu. 2019. Toward human-centered AI: a perspective from human-computer interaction. interactions 26, 4 (2019), 42–46.

Cited By

Zhu LWang JLi J(2024)Exploring the Roles of Artifacts in Speculative Futures: Perspectives in HCISystems10.3390/systems1206019412:6(194)Online publication date: 3-Jun-2024
https://doi.org/10.3390/systems12060194
Tost JFlechtner RMaué RHeidmann F(2024)Caring for a companion as a form of self-care. Exploring the design space for irritating companion technologies for mental healthProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685343(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685343
Ma XYan ZMeng HCao ZJin YWang Z(2024)Get Your Hands Dirty? A Comparative Study of Tool Usage and Perceptual Engagement in Physical and Digital SculptingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656188(358-373)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656188
Show More Cited By

Index Terms

User Perspectives on Ethical Challenges in Human-AI Co-Creativity: A Design Fiction Study
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Mapping the landscape of ethical considerations in explainable AI research
Abstract
With its potential to contribute to the ethical governance of AI, eXplainable AI (XAI) research frequently asserts its relevance to ethical considerations. Yet, the substantiation of these claims with rigorous ethical analysis and reflection ...
Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

While artificial intelligence (AI) is increasingly applied for decision-making processes, ethical decisions pose challenges for AI applications. Given that humans cannot always agree on the right thing to do, how would ethical decision-making by AI ...
Modeling and Guiding the Creation of Ethical Human-AI Teams
AIES '21: Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society

With artificial intelligence continuing to advance, so too do the ethical concerns that can potentially negatively impact humans and the greater society. When these systems begin to interact with humans, these concerns become much more complex and much ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

C&C '23: Proceedings of the 15th Conference on Creativity and Cognition

June 2023

564 pages

ISBN:9798400701801

DOI:10.1145/3591196

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

C&C '23

Sponsor:

SIGCHI

C&C '23: Creativity and Cognition

June 19 - 21, 2023

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
826
Total Downloads

Downloads (Last 12 months)548
Downloads (Last 6 weeks)73

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhu LWang JLi J(2024)Exploring the Roles of Artifacts in Speculative Futures: Perspectives in HCISystems10.3390/systems1206019412:6(194)Online publication date: 3-Jun-2024
https://doi.org/10.3390/systems12060194
Tost JFlechtner RMaué RHeidmann F(2024)Caring for a companion as a form of self-care. Exploring the design space for irritating companion technologies for mental healthProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685343(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685343
Ma XYan ZMeng HCao ZJin YWang Z(2024)Get Your Hands Dirty? A Comparative Study of Tool Usage and Perceptual Engagement in Physical and Digital SculptingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656188(358-373)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656188
Sun YJang EMa FWang T(2024)Generative AI in the Wild: Prospects, Challenges, and StrategiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642160(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642160
Turchi TMalizia ABorsci S(2024)Reflecting on Algorithmic Bias With Design Fiction: The MiniCoDe WorkshopsIEEE Intelligent Systems10.1109/MIS.2024.335297739:2(40-50)Online publication date: 11-Jan-2024
https://dl.acm.org/doi/10.1109/MIS.2024.3352977
Garcia M(2024)The Paradox of Artificial Creativity: Challenges and Opportunities of Generative AI ArtistryCreativity Research Journal10.1080/10400419.2024.2354622(1-14)Online publication date: 30-May-2024
https://doi.org/10.1080/10400419.2024.2354622
Marasinghe RYigitcanlar TMayere SWashington TLimb M(2024)Towards Responsible Urban Geospatial AI: Insights From the White and Grey LiteraturesJournal of Geovisualization and Spatial Analysis10.1007/s41651-024-00184-28:2Online publication date: 26-Jun-2024
https://doi.org/10.1007/s41651-024-00184-2

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents