Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3527927.3532801acmconferencesArticle/Chapter ViewAbstractPublication Pagesc-n-cConference Proceedingsconference-collections
research-article
Open access

Cracking the code: Co-coding with AI in creative programming education

Published: 20 June 2022 Publication History

Abstract

This paper presents a study of a group of university students using generative machine learning to translate from natural language to computer code. The study explores how the use of the AI tool can be understood in terms of co-creation, focusing on the one hand on how the tool may serve as a resource for understanding and learning, and on the other hand how the tool affects the creative processes. Findings show how the participants search for a ’correct’ syntax in their instructions to the machine learning tool, and how the inconsistent and erroneous behavior can work as a way to generate clues and inspiration for generating creative expressions. The notion of friction is used to describe how systems like this can serve to both lower thresholds for programming, and also interfere with the creative processes, encouraging reflection and exploration of alternative solutions.

References

[1]
Lea Albaugh, Scott E. Hudson, Lining Yao, and Laura Devendorf. 2020. Investigating Underdetermination Through Interactive Computational Handweaving. In Proceedings of the 2020 ACM Designing Interactive Systems Conference(DIS ’20). Association for Computing Machinery, New York, NY, USA, 1033–1046. https://doi.org/10.1145/3357236.3395538
[2]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300233
[3]
Kristina Andersen, Ron Wakkary, Laura Devendorf, and Alex McLean. 2019. Digital crafts-machine-ship: creative collaborations with machines. interactions 27, 1 (Dec. 2019), 30–35. https://doi.org/10.1145/3373644
[4]
Fraser Anderson, Tovi Grossman, and George Fitzmaurice. 2017. Trigger-Action-Circuits: Leveraging Generative Design to Enable Novices to Design and Build Circuitry. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology(UIST ’17). Association for Computing Machinery, New York, NY, USA, 331–342. https://doi.org/10.1145/3126594.3126637
[5]
Karen Barad. 2007. Meeting the Universe Halfway: Quantum Physics and the Entanglement of Matter and Meaning. Duke University Press. Google-Books-ID: H41WUfTU2CMC.
[6]
Ilias Bergstrom and R. Beau Lotto. 2015. Code Bending: A New Creative Coding Practice. Leonardo 48, 1 (Feb. 2015), 25–31. https://doi.org/10.1162/LEON_a_00934
[7]
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. arXiv:2005.14165 [cs] (July 2020). http://arxiv.org/abs/2005.14165 arXiv:2005.14165.
[8]
Leah Buechley, Mike Eisenberg, Jaime Catchen, and Ali Crockett. 2008. The LilyPad Arduino: using computational textiles to investigate engagement, aesthetics, and diversity in computer science education. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’08). Association for Computing Machinery, New York, NY, USA, 423–432. https://doi.org/10.1145/1357054.1357123
[9]
Scott C. Chase. 2005. Generative design tools for novice designers: Issues for selection. Automation in Construction 14, 6 (Dec. 2005), 689–698. https://doi.org/10.1016/j.autcon.2004.12.004
[10]
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba. 2021. Evaluating Large Language Models Trained on Code. arXiv:2107.03374 [cs] (July 2021). http://arxiv.org/abs/2107.03374 arXiv:2107.03374.
[11]
Anna L. Cox, Sandy J.J. Gould, Marta E. Cecchinato, Ioanna Iacovides, and Ian Renfree. 2016. Design Frictions for Mindful Interactions: The Case for Microboundaries. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 1389–1397. https://doi.org/10.1145/2851581.2892410
[12]
Antonia Creswell, Tom White, Vincent Dumoulin, Kai Arulkumaran, Biswa Sengupta, and Anil A. Bharath. 2018. Generative Adversarial Networks: An Overview. IEEE Signal Processing Magazine 35, 1 (Jan. 2018), 53–65. https://doi.org/10.1109/MSP.2017.2765202 Conference Name: IEEE Signal Processing Magazine.
[13]
Laura Devendorf, Abigail De Kosnik, Kate Mattingly, and Kimiko Ryokai. 2016. Probing the Potential of Post-Anthropocentric 3D Printing. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems(DIS ’16). Association for Computing Machinery, New York, NY, USA, 170–181. https://doi.org/10.1145/2901790.2901879
[14]
Laura Devendorf and Kimiko Ryokai. 2015. Being the Machine: Reconfiguring Agency and Control in Hybrid Fabrication. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 2477–2486. https://doi.org/10.1145/2702123.2702547
[15]
Tayebeh Fani and Farid Ghaemi. 2011. Implications of Vygotsky’s Zone of Proximal Development (ZPD) in Teacher Education: ZPTD and Self-scaffolding. Procedia - Social and Behavioral Sciences 29 (Jan. 2011), 1549–1554. https://doi.org/10.1016/j.sbspro.2011.11.396
[16]
William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a resource for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’03). Association for Computing Machinery, New York, NY, USA, 233–240. https://doi.org/10.1145/642611.642653
[17]
Elisa Giaccardi and Johan Redström. 2020. Technology and More-Than-Human Design. Design Issues 36, 4 (Sept. 2020), 33–44. https://doi.org/10.1162/desi_a_00612
[18]
Miwa Ikemiya and Daniela K. Rosner. 2014. Broken probes: toward the design of worn media. Pers Ubiquit Comput 18, 3 (March 2014), 671–683. https://doi.org/10.1007/s00779-013-0690-y
[19]
Martin Jonsson, Jakob Tholander, and Ylva Fernaeus. 2009. Setting the stage – Embodied and spatial dimensions in emerging programming practices. Interacting with Computers 21, 1-2 (Jan. 2009), 117–124. https://doi.org/10.1016/j.intcom.2008.10.004
[20]
Lenneke Kuijer and Elisa Giaccardi. 2018. Co-performance: Conceptualizing the Role of Artificial Agency in the Design of Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173699
[21]
Matthias Laschke, Sarah Diefenbach, and Marc Hassenzahl. 2015. “Annoying, but in a Nice Way”:. 9, 2 (2015), 12.
[22]
Ewa Luger and Abigail Sellen. 2016. ”Like Having a Really Bad PA”: The Gulf between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, New York, NY, USA, 5286–5297. https://doi.org/10.1145/2858036.2858288
[23]
Betti Marenko. 2015. When making becomes divination: Uncertainty and contingency in computational glitch-events. Design Studies 41 (Nov. 2015), 110–125. https://doi.org/10.1016/j.destud.2015.08.004
[24]
Betti Marenko and Philip van Allen. 2016. Animistic design: how to reimagine digital interaction between the human and the nonhuman. Digital Creativity 27, 1 (Jan. 2016), 52–70. https://doi.org/10.1080/14626268.2016.1145127 Publisher: Routledge _eprint: https://doi.org/10.1080/14626268.2016.1145127.
[25]
Jon McCormack, Alan Dorin, and Troy Innocent. 2004. Generative Design: A Paradigm for Design Research.DRS Biennial Conference Series (Nov. 2004). https://dl.designresearchsociety.org/drs-conference-papers/drs2004/researchpapers/171
[26]
L. A. Miller. 1981. Natural language programming: Styles, strategies, and contrasts. IBM Systems Journal 20, 2 (1981), 184–215. https://doi.org/10.1147/sj.202.0184 Conference Name: IBM Systems Journal.
[27]
James Mountstephens and Jason Teo. 2020. Progress and Challenges in Generative Product Design: A Review of Systems. Computers 9, 4 (Dec. 2020), 80. https://doi.org/10.3390/computers9040080 Number: 4 Publisher: Multidisciplinary Digital Publishing Institute.
[28]
J. Brian Pickering, Vegard Engen, and Paul Walland. 2017. The Interplay Between Human and Machine Agency. In Human-Computer Interaction. User Interface Design, Development and Multimodality(Lecture Notes in Computer Science), Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 47–59. https://doi.org/10.1007/978-3-319-58071-5_4
[29]
Martin Porcheron, Joel E. Fischer, Moira McGregor, Barry Brown, Ewa Luger, Heloisa Candello, and Kenton O’Hara. 2017. Talking with Conversational Agents in Collaborative Action. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, Portland Oregon USA, 431–436. https://doi.org/10.1145/3022198.3022666
[30]
David Price, Ellen Rilofff, Joseph Zachary, and Brandon Harvey. 2000. NaturalJava: a natural language interface for programming in Java. In Proceedings of the 5th international conference on Intelligent user interfaces(IUI ’00). Association for Computing Machinery, New York, NY, USA, 207–211. https://doi.org/10.1145/325737.325845
[31]
Mitchel Resnick and Eric Rosenbaum. 2013. Designing for tinkerability. In Design, make, play: Growing the next generation of STEM innovators, M Honey and D Kanter (Eds.). Routledge, New York, NY, USA, 163–181.
[32]
Donald A. Schön. 1987. Educating the reflective practitioner: Toward a new design for teaching and learning in the professions. Jossey-Bass, San Francisco, CA, US. Pages: xvii, 355.
[33]
Lucy Suchman. 2017. Agencies in Technology Design: Feminist Reconfigurations*. In Machine Ethics and Robot Ethics. Routledge. Num Pages: 15.
[34]
Jakob Tholander and Maria Normark. 2020. Crafting Personal Information - Resistance, Imperfection, and Self-Creation in Bullet Journaling. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376410
[35]
Jakob Tholander, Maria Normark, and Chiara Rossitto. 2012. Understanding agency in interaction design materials. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). Association for Computing Machinery, New York, NY, USA, 2499–2508. https://doi.org/10.1145/2207676.2208417
[36]
Vasiliki Tsaknaki and Ylva Fernaeus. 2016. Expanding on Wabi-Sabi as a Design Resource in HCI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, New York, NY, USA, 5970–5983. https://doi.org/10.1145/2858036.2858459
[37]
Ron Wakkary. 2020. A Posthuman Theory for Knowing Design. 14, 3 (2020), 12.
[38]
Ron Wakkary. 2021. Things We Could Design: For More Than Human-Centered Worlds. MIT Press. Google-Books-ID: UiY6EAAAQBAJ.
[39]
Ke Wang, Rishabh Singh, and Zhendong Su. 2018. Search, align, and repair: data-driven feedback generation for introductory programming exercises. In Proceedings of the 39th ACM SIGPLAN Conference on Programming Language Design and Implementation(PLDI 2018). Association for Computing Machinery, New York, NY, USA, 481–495. https://doi.org/10.1145/3192366.3192384

Cited By

View all
  • (2025)Themes in the Declared Use of Generative Artificial Intelligence in AssessmentProceedings of the 9th Conference on Computing Education Practice10.1145/3702212.3702217(17-20)Online publication date: 7-Jan-2025
  • (2025)Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools2024 Working Group Reports on Innovation and Technology in Computer Science Education10.1145/3689187.3709614(300-338)Online publication date: 22-Jan-2025
  • (2025)Automated Generation of Multiple-Choice Questions for Computer Science Education Using Conditional Generative Adversarial NetworksIEEE Access10.1109/ACCESS.2025.353047413(16697-16715)Online publication date: 2025
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
C&C '22: Proceedings of the 14th Conference on Creativity and Cognition
June 2022
710 pages
ISBN:9781450393270
DOI:10.1145/3527927
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2022

Check for updates

Badges

  • Honorable Mention

Author Tags

  1. GPT-3
  2. co-creation
  3. generative machine learning
  4. post-human design
  5. programming

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

C&C '22
Sponsor:
C&C '22: Creativity and Cognition
June 20 - 23, 2022
Venice, Italy

Acceptance Rates

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2,003
  • Downloads (Last 6 weeks)212
Reflects downloads up to 05 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Themes in the Declared Use of Generative Artificial Intelligence in AssessmentProceedings of the 9th Conference on Computing Education Practice10.1145/3702212.3702217(17-20)Online publication date: 7-Jan-2025
  • (2025)Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools2024 Working Group Reports on Innovation and Technology in Computer Science Education10.1145/3689187.3709614(300-338)Online publication date: 22-Jan-2025
  • (2025)Automated Generation of Multiple-Choice Questions for Computer Science Education Using Conditional Generative Adversarial NetworksIEEE Access10.1109/ACCESS.2025.353047413(16697-16715)Online publication date: 2025
  • (2024)Generative AI in Education: Technical Foundations, Applications, and ChallengesArtificial Intelligence for Quality Education [Working Title]10.5772/intechopen.1005402Online publication date: 20-May-2024
  • (2024)Ethical Considerations and ChallengesThe Rise of AI in Academic Inquiry10.4018/979-8-3693-6905-0.ch007(201-234)Online publication date: 30-Aug-2024
  • (2024)The Role of AI in Transforming Assessment Practices in EducationAI Applications and Strategies in Teacher Education10.4018/979-8-3693-5443-8.ch003(43-70)Online publication date: 25-Oct-2024
  • (2024)Exploring Human-Centered Approaches in Generative AI and Introductory Programming Research: A Scoping ReviewProceedings of the 2024 Conference on United Kingdom & Ireland Computing Education Research10.1145/3689535.3689553(1-7)Online publication date: 5-Sep-2024
  • (2024)"I'm a Solo Developer but AI is My New Ill-Informed Co-Worker": Envisioning and Designing Generative AI to Support Indie Game DevelopmentProceedings of the ACM on Human-Computer Interaction10.1145/36770828:CHI PLAY(1-26)Online publication date: 15-Oct-2024
  • (2024)Temporal Aspects of Human-AI Collaborations for WorkProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663397(1-7)Online publication date: 25-Jun-2024
  • (2024)Drinking Chai with Your (AI) Programming Partner: Value Tensions in the Tokenization of Future Human-AI Collaborative WorkProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663390(1-15)Online publication date: 25-Jun-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media