research-article

Prompt Aloud!: Incorporating image-generative AI into STEAM class with learning analytics using prompt data

Authors:

Hyeoncheol Kim,

Cheolil LimAuthors Info & Claims

Education and Information Technologies, Volume 29, Issue 8

Pages 9575 - 9605

https://doi.org/10.1007/s10639-023-12150-4

Published: 18 September 2023 Publication History

Abstract

The rapid advancements in artificial intelligence (AI) have transformed various domains, including education. Generative AI models have garnered significant attention for their potential in educational settings, but image-generative AI models need to be more utilized. This study explores the potential of integrating generative AI, specifically Stable Diffusion, into art-focused STEAM classes. To this end, we combined STEAM education with image-generative AI. We designed and implemented a learning activity in which students used image-generative AI to generate creative images and wrote imaginative diaries inspired by AI-generated pictures. Using a mixed-methods approach, we collected and analyzed data from surveys, interviews, and prompt datasets to gain insights into students' perceptions, motivations, and behaviors concerning the integration of generative AI in art education. Our study found that incorporating generative AI into art-focused STEAM classes may reduce the gap between male and female students' interest in art practices. We also found that the number of subjects in students' prompt datasets is linked to their divergent and convergent thinking. Finally, we discovered a meaningful correlation between the number of unique words in students' diaries and the image scores that researchers assessed. Our findings shed light on the relationship between students' divergent and convergent behaviors, offering valuable insights into their creative thinking processes. This study underscores the potential of integrating image-generative AI models in STEAM education.

References

[1]

Aguilera D and Ortiz-Revilla J STEM vs. STEAM education and student creativity: A systematic literature review Education Sciences 2021 11 7 331

[2]

Ali, S., DiPaola, D., & Breazeal, C. (2021). What are GANs?: Introducing generative adversarial networks to middle school students. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 35, No. 17, pp. 15472–15479).

[3]

Baidoo-Anu, D., & Owusu Ansah, L. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Available at SSRN 4337484.

[4]

Bailey CR and Bailey CA A guide to qualitative field research 2017 Sage Publications

[5]

Brown, A., & Cariveau, T. (2022). A systematic review of simultaneous prompting and prompt delay procedures. Journal of Behavioral Education, 1–22.

[6]

Bull, C., & Kharrufa, A. (2023). Generative AI assistants in software development education. arXiv preprint arXiv:2303.13936

[7]

Castronovo F, Van Meter PN, and Messner JI Leveraging metacognitive prompts in construction educational games for higher educational gains International Journal of Construction Management 2022 22 1 19-30

[8]

Clelland, A. G. (2009). STEAM - Science, Technology, Engineering, Arts, Mathematics. http://www.handshake20.com/2009/04/steam.html

[9]

Cooper, G. (2023). Examining science education in chatgpt: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 1–9.

[10]

Crescenzi-Lanna L Multimodal learning analytics research with young children: A systematic review British Journal of Educational Technology 2020 51 5 1485-1504

[11]

Creswell J and Poth C Qualitative Inquiry and Research Design: Choosing among Five Approaches 2017 Sage

[12]

Davis S Considering gender equity policy and recent debates in relation to arts education Australian Art Education 1995 18 2 52-60

[13]

Dehouche, N., & Dehouche, K. (2023). What’s in a text-to-image prompt? The potential of stable diffusion in visual arts education. Heliyon.

[14]

DeJarnette NK Implementing STEAM in the early childhood classroom European Journal of STEM Education 2018 3 3 18

[15]

Drachsler, H., & Goldhammer, F. (2020). Learning analytics and eAssessment—Towards computational psychometrics by combining psychometrics with learning analytics. Radical solutions and learning analytics: Personalized learning and teaching through big data, 67–80.

[16]

Dumais, S., Jeffries, R., Russell, D. M., Tang, D., & Teevan, J. (2014). Understanding user behavior through log data and analysis. Ways of Knowing in HCI, 349–372.

[17]

Guilford JP The nature of human intelligence 1967 McGraw-Hill

[18]

Ho J, Jain A, and Abbeel P Denoising diffusion probabilistic models Advances in Neural Information Processing Systems 2020 33 6840-6851

[19]

Hoffman B and Spatariu A The influence of self-efficacy and metacognitive prompting on math problem-solving efficiency Contemporary Educational Psychology 2008 33 4 875-893

[20]

Hornberg J and Reiter-Palmon R Creativity and the big five personality traits: Is the relationship dependent on the creativity measure? 2017 Cambridge University Press

[21]

How ML and Hung WLD Educing AI-thinking in science, technology, engineering, arts, and mathematics (STEAM) education Education Sciences 2019 9 3 184

[22]

Jang J, Jeon J, and Jung SK Development of STEM-based AI education program for sustainable improvement of elementary learners Sustainability 2022 14 22 15178

[23]

Jovanovic M and Campbell M Generative artificial intelligence: Trends and prospects Computer 2022 55 107-112

Digital Library

[24]

Kasneci E, Seßler K, Küchemann S, Bannert M, Dementieva D, Fischer F, Gasser U, Groh G, Günnemann S, Hüllermeier E, Krusche S, Kutyniok G, Michaeli T, Nerdel C, Pfeffer J, Poquet O, Sailer M, Schmidt A, Seidel T, Stadler M, Weller J, Kuhn J, and Kasneci G ChatGPT for good? On opportunities and challenges of large language models for education Learning and Individual Differences 2023 103 102274

[25]

Kauffman DF, Ge X, Xie K, and Chen CH Prompting in web-based environments: Supporting self-monitoring and problem solving skills in college students Journal of Educational Computing Research 2008 38 2 115-137

[26]

Kim KH Can we trust creativity tests? A review of the Torrance Tests of Creative Thinking (TTCT) Creativity Research Journal 2006 18 1 3-14

[27]

Kim KH Proven reliability and validity of the Torrance Tests of Creative Thinking (TTCT) Psychology of Aesthetics, Creativity, and the Arts 2011 5 4 314-315

[28]

Land MH Full STEAM ahead: The benefits of integrating the arts into STEM Procedia Computer Science 2013 20 547-552

[29]

Lang, C., Siemens, G., Wise, A. F., Gašević, D., & Merceron, A. (2022). The Handbook of Learning Analytics - Second edition. SOLAR, Society for Learning Analytics and Research. NY: SOLAR.

[30]

Law V and Chen CH Promoting science learning in game-based learning with question prompts and feedback Computers & Education 2016 103 134-143

Digital Library

[31]

Li, B. & Han, L. (2013). Distance weighted cosine similarity measure for text classification. In Intelligent Data Engineering and Automated Learning–IDEAL 2013: 14th International Conference, IDEAL 2013, Hefei, China, October 20–23, 2013. Proceedings 14 (pp. 611–618). Springer Berlin Heidelberg.

Digital Library

[32]

Lim WM, Gunasekara A, Pallant JL, Pallant JI, and Pechenkina E Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators The International Journal of Management Education 2023 21 2 100790

[33]

Liu, V., & Chilton, L. B. (2022). Design guidelines for prompt engineering text-to-image generative models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (pp. 1–23).

Digital Library

[34]

Liu P, Yuan W, Fu J, Jiang Z, Hayashi H, and Neubig G Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing ACM Computing Surveys 2023 55 9 1-35

Digital Library

[35]

Maeda J Stem+ art= steam The STEAM Journal 2013 1 1 34

[36]

Maes, B. (2010). Stop talking about “STEM” education! “TEAMS” is way cooler. Retrieved from http://bertmaes.wordpress.com/2010/10/21/teams/

[37]

Markelz A, Scheeler MC, Riccomini P, and Taylor JC A systematic review of tactile prompting in teacher education Teacher Education and Special Education 2020 43 4 296-313

[38]

Meece JL, Glienke BB, and Burg S Gender and motivation Journal of School Psychology 2006 44 5 351-373

[39]

Miao F, Holmes W, Huang R, and Zhang H AI and education: A guidance for policymakers 2021 UNESCO Publishing

[40]

Michalsky T and Kramarski B Prompting reflections for integrating self-regulation into teacher technology education Teachers College Record 2015 117 5 1-38

[41]

Microsoft Azure Azure Documentation (2023). Introduction to prompt engineering. Retrieved from https://learn.microsoft.com/en-us/azure/cognitive-services/openai/concepts/prompt-engineering

[42]

Mohana, M., Nandhini, K., & Subashini, P. (2022). Review on Artificial Intelligence and Robots in STEAM Education for Early Childhood Development: The State-of-the-Art Tools and Applications. In Handbook of Research on Innovative Approaches to Early Childhood Development and School Readiness (pp. 468–498). IGI Global.

[43]

Oliner, A., & Stearley, J. (2007). What supercomputers say: A study of five system logs. 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’07).

Digital Library

[44]

Pavlik JV Collaborating with CHATGPT: Considering the implications of Generative Artificial Intelligence for Journalism and Media Education Journalism & Mass Communication Educator 2023 78 1 84-93

[45]

Pennington RC, Stenhoff DM, Gibson J, and Ballou K Using simultaneous prompting to teach computer-based story writing to a student with autism Education & Treatment of Children 2012 35 3 389-406

[46]

Platz, J. (2007). How do you turn STEM into STEAM? Add the arts (pp. 1–5). Columbus: Ohio Alliance for Arts Education. http://www.ikzadvisors.com/wp-content/uploads/2009/09/STEM-+-ARTS-STEAM.pdf

[47]

Qadir, J. (2022). Engineering Education in the Era of Chatgpt: Promise and Pitfalls of Generative AI for Education.

[48]

Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., Krueger, G., & Sutskever, I. (2021). Learning transferable visual models from natural language supervision. In International conference on machine learning (pp. 8748–8763). PMLR.

[49]

Reimers, N., & Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084

[50]

Runco MA Children's divergent thinking and creative ideation Developmental Review 1992 12 3 233-264

[51]

Sanders M STEM, STEM education, STEMAnia The Technology Teacher 2009 68 4 20-27

[52]

Savoie A Boys' lack of interest in fine arts in a coeducational setting: A review of sex-related cognitive traits studies International Journal of Art & Design Education 2009 28 1 25-36

[53]

Shatunova O, Anisimova T, Sabirova F, and Kalimullina O STEAM as an innovative educational technology Journal of Social Studies Education Research 2019 10 2 131-144

[54]

Shawbitz KN and Brock ME A systematic review of training educators to implement response prompting Teacher Education and Special Education 2023 46 2 127-145

[55]

Stokel-Walker C AI bot ChatGPT writes smart essays-should academics worry? Nature 2022

[56]

Torrance EP Torrance tests of creative thinking: Norms-technical manual: Verbal tests, forms a and b: Figural tests, forms a and b 1966 Personal Press

[57]

Torrance EP Torrance tests of creative thinking: Norms-technical manual: Figural (streamlined) forms A & B 1998 Scholastic Testing Service

[58]

Treffers-Daller, J. (2013). Measuring lexical diversity among L2 learners of French. Vocabulary knowledge: Human ratings and automated measures, 47.

[59]

Treffinger DJ Creative problem solving: Overview and educational implications Educational Psychology Review 1995 7 301-312

[60]

Treffinger DJ, Isaksen SG, and Stead-Dorval KB Creative problem solving: An introduction 2006 Prufrock Press Inc

[61]

Trisnayanti, Y., Khoiri, A., Miterianifa, & Ayu, H. D. (2019). Development of Torrance test creativity thinking (TTCT) instrument in science learning. In AIP Conference Proceedings (Vol. 2194, No. 1, p. 020129).

[62]

Vartiainen, H., & Tedre, M. (2023). Using artificial intelligence in craft education: crafting with text-to-image generative models. Digital Creativity, 1–21.

[63]

Wang, Y., Shen, S., & Lim, B. Y. (2023). RePrompt: Automatic prompt editing to refine AI-generative art towards precise expressions. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.

Digital Library

[64]

Wikberg S Art education–mostly for girls? A gender perspective on the Art subject in Swedish compulsory school Education Inquiry 2013 4 3 22630

[65]

Wu SPW and Rau MA Effectiveness and efficiency of adding drawing prompts to an interactive educational technology when learning with visual representations Learning and Instruction 2018 55 93-104

[66]

Yang, K.-H., Chu, H.-C., & Chiang, L.-Y. (2018). Effects of a progressive prompting-based educational game on second graders’ mathematics learning performance and behavioral patterns. Journal of Educational Technology & Society, 21(2), 322–334. http://www.jstor.org/stable/26388410

[67]

Yu G Lexical diversity in writing and speaking task performances Applied Linguistics 2010 31 2 236-259

[68]

Zhai X CHATGPT user experience: Implications for education SSRN Electronic Journal 2022

[69]

Zhai X Chatgpt for next generation science learning XRDS: Crossroads, The ACM Magazine for Students 2023 29 3 42-46

Digital Library

Cited By

Benjamin JLindley JEdwards ERubegni EKorjakow TGrist DSharkey R(2024)Responding to Generative AI Technologies with Research-through-Design: The Ryelands AI Lab as an Exploratory StudyProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660677(1823-1841)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660677
Li Y(2024)“Will artificial intelligence platforms replace designers in the future?” analyzing the impact of artificial intelligence platforms on the engineering design industry through color perceptionEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.109369138:PAOnline publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1016/j.engappai.2024.109369

Recommendations

The Prompt Artists
C&C '23: Proceedings of the 15th Conference on Creativity and Cognition

This paper examines the art practices, artwork, and motivations of prolific users of the latest generation of text-to-image models. Through interviews, observations, and a user survey, we present a sampling of the artistic styles and describe the ...
Is Your Prompt Detailed Enough? Exploring the Effects of Prompt Coaching on Users' Perceptions, Engagement, and Trust in Text-to-Image Generative AI Tools
TAS '24: Proceedings of the Second International Symposium on Trustworthy Autonomous Systems

Prompts are the primary medium for interacting with generative AI tools. However, users often lack sufficient prompt literacy and motivation to fully benefit from these tools. To address this, we explore whether introducing prompt coaching into a chatbot-...
Towards a Diffractive Analysis of Prompt-Based Generative AI
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Recent developments in prompt-based generative AI has given rise to discourse surrounding the perceived ethical concerns, economic implications, and consequences for the future of cultural production. As generative imagery becomes pervasive in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Education and Information Technologies

Education and Information Technologies Volume 29, Issue 8

Jun 2024

1309 pages

Issue’s Table of Contents

© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 18 September 2023

Accepted: 15 August 2023

Received: 19 May 2023

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Benjamin JLindley JEdwards ERubegni EKorjakow TGrist DSharkey R(2024)Responding to Generative AI Technologies with Research-through-Design: The Ryelands AI Lab as an Exploratory StudyProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660677(1823-1841)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660677
Li Y(2024)“Will artificial intelligence platforms replace designers in the future?” analyzing the impact of artificial intelligence platforms on the engineering design industry through color perceptionEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.109369138:PAOnline publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1016/j.engappai.2024.109369

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents