Supermind Ideator: How Scaffolding Human-AI Collaboration Can Increase Creativity
Authors: 
Jennifer L Heyman, 
Steven R Rick, Gianni Giacomelli, Haoran Wen, Robert Laubacher, Nancy Taubenslag, Max Knicker, Younes Jeddi, Pranav Ragupathy, Jared Curhan, 
Thomas MaloneAuthors Info & Claims
Pages 18 - 28
Abstract
Previous efforts to support creative problem-solving have included (a) techniques such as brainstorming and design thinking to stimulate creative ideas, and (b) software tools to record and share these ideas. Now, generative AI technologies can suggest new ideas that might never have occurred to the users, and users can then select from these ideas or use them to stimulate even more ideas. To explore these possibilities, we developed a system called Supermind Ideator that uses a large language model (LLM) and adds prompts, fine tuning, and a specialized user interface in order to help users reformulate their problem statements and generate possible solutions. This provides scaffolding to guide users through a set of creative problem-solving techniques, including some techniques specifically intended to help generate innovative ideas about designing groups of people and/or computers (“superminds”). In an experimental study, we found that people using Supermind Ideator generated significantly more innovative ideas than those generated by people using ChatGPT or people working alone. Thus our results suggest that the benefits of using LLMs for creative problem-solving can be substantially enhanced by scaffolding designed specifically for this purpose.
References
[1]
2005. Framework for Innovation: Design Council’s evolved Double Diamond. https://www.designcouncil.org.uk/our-work/skills-learning/tools-frameworks/framework-for-innovation-design-councils-evolved-double-diamond/
[2]
2018. Design Thinking Bootleg. https://dschool.stanford.edu/resources/design-thinking-bootleg
[3]
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency(FAccT ’21). Association for Computing Machinery, New York, NY, USA, 610–623. https://doi.org/10.1145/3442188.3445922
[4]
Tom Brown. 2009. Change by design. HARPER COLLINS.
[5]
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems, Vol. 33. Curran Associates, Inc., 1877–1901. https://proceedings.neurips.cc/paper/2020/hash/1457c0d6bfcb4967418bfb8ac142f64a-Abstract.html
[6]
Erik Brynjolfsson, Danielle Li, and Lindsey R Raymond. 2023. Generative AI at work. Technical Report. National Bureau of Economic Research.
[7]
Bendik Bygstad. 2010. Generative mechanisms for innovation in information infrastructures. Information and Organization 20, 3 (July 2010), 156–168. https://doi.org/10.1016/j.infoandorg.2010.07.001
[8]
Andres Campero, Michelle Vaccaro, Jaeyoon Song, Haoran Wen, Abdullah Almaatouq, and Thomas W. Malone. 2022. A Test for Evaluating Performance in Human-Computer Systems. https://doi.org/10.48550/arXiv.2206.12390 arXiv:2206.12390 [cs].
[9]
Carlos Cardoso and Petra Badke-Schaub. 2011. Fixation or Inspiration: Creative Problem Solving in Design. The Journal of Creative Behavior 45, 2 (June 2011), 77–82. https://doi.org/10.1002/j.2162-6057.2011.tb01086.x
[10]
Fang Chen and Jacques Terken. 2023. Design Process. In Automotive Interaction Design: From Theory to Practice, Fang Chen and Jacques Terken (Eds.). Springer Nature, Singapore, 165–179. https://doi.org/10.1007/978-981-19-3448-3_10
[11]
Nigel Cross. 1982. Designerly ways of knowing. Design Studies 3, 4 (Oct. 1982), 221–227. https://doi.org/10.1016/0142-694X(82)90040-0
[12]
Rikke Friis Dam and Teo Yu Siang. 2020. Design thinking: a quick overview. (June 2020). https://apo.org.au/node/306478 Publisher: Interaction Design Foundation.
[13]
Edward De Bono. 1970. Lateral thinking. New York (1970).
[14]
Kees Dorst and Nigel Cross. 2001. Creativity in the design process: co-evolution of problem–solution. Design Studies 22, 5 (Sept. 2001), 425–437. https://doi.org/10.1016/S0142-694X(01)00009-6
[15]
Claudia Eckert and Martin Stacey. 2000. Sources of inspiration: a language of design. Design Studies 21, 5 (Sept. 2000), 523–538. https://doi.org/10.1016/S0142-694X(00)00022-3
[16]
Andreas Fink, Karl Koschutnig, Mathias Benedek, Gernot Reishofer, Anja Ischebeck, Elisabeth M. Weiss, and Franz Ebner. 2012. Stimulating creativity via the exposure to other people’s ideas. Human Brain Mapping 33, 11 (2012), 2603–2610. https://doi.org/10.1002/hbm.21387
[17]
MIT Center for Collective Intelligence. [n. d.]. Supermind Design Primer | MIT Center for Collective Intelligence. https://cci.mit.edu/supermind-design-primer/
[18]
Jonas Frich, Michael Mose Biskjaer, and Peter Dalsgaard. 2018. Twenty Years of Creativity Research in Human-Computer Interaction: Current State and Future Directions. In Proceedings of the 2018 Designing Interactive Systems Conference(DIS ’18). Association for Computing Machinery, New York, NY, USA, 1235–1257. https://doi.org/10.1145/3196709.3196732
[19]
Liane Gabora. 2002. Cognitive mechanisms underlying the creative process. In Proceedings of the 4th conference on Creativity & cognition(C&C ’02). Association for Computing Machinery, New York, NY, USA, 126–133. https://doi.org/10.1145/581710.581730
[20]
K. J. Gilhooly, E. Fioratou, S. H. Anthony, and V. Wynn. 2007. Divergent thinking: Strategies and executive involvement in generating novel uses for familiar objects. British Journal of Psychology 98, 4 (2007), 611–625. https://doi.org/10.1111/j.2044-8295.2007.tb00467.x
[21]
Steven M. Goodman, Erin Buehler, Patrick Clary, Andy Coenen, Aaron Donsbach, Tiffanie N. Horne, Michal Lahav, Robert MacDonald, Rain Breaw Michaels, Ajit Narayanan, Mahima Pushkarna, Joel Riley, Alex Santana, Lei Shi, Rachel Sweeney, Phil Weaver, Ann Yuan, and Meredith Ringel Morris. 2022. LaMPost: Design and Evaluation of an AI-assisted Email Writing Prototype for Adults with Dyslexia. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’22). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3517428.3544819
[22]
Dawn G. Gregg. 2010. Designing for collective intelligence. Commun. ACM 53, 4 (April 2010), 134–138. https://doi.org/10.1145/1721654.1721691
[23]
Matthias Griebel, Christoph Flath, and Sascha Friesike. 2020. AUGMENTED CREATIVITY: LEVERAGING ARTIFICIAL INTELLIGENCE FOR IDEA GENERATION IN THE CREATIVE SPHERE. (2020).
[24]
T. J. Howard, E. A. Dekoninck, and S. J. Culley. 2010. The use of creative stimuli at early stages of industrial product innovation. Research in Engineering Design 21, 4 (Oct. 2010), 263–274. https://doi.org/10.1007/s00163-010-0091-4
[25]
Edwin L Hutchins, James D Hollan, and Donald A Norman. 1985. Direct manipulation interfaces. Human–computer interaction 1, 4 (1985), 311–338.
[26]
David G. Jansson and Steven M. Smith. 1991. Design fixation. Design Studies 12, 1 (Jan. 1991), 3–11. https://doi.org/10.1016/0142-694X(91)90003-F
[27]
W. Chan Kim and Mauborgne Renee. 2017. Blue Ocean Shift: Beyond competing: Proven steps to inspire confidence and seize new growth. Hachette Books.
[28]
Mark Klein and Gregorio Convertino. 2014. An embarrassment of riches. Commun. ACM 57, 11 (2014), 40–42.
[29]
Don Koberg and Jim Bagnall. 1974. The Universal Traveler, A Soft-Systems Guide to: Creativity, Problem Solving, and the Process of Reaching Goals.[Revised Edition.]. (1974).
[30]
Akhilesh Koppineni, David Sun Kong, and Thomas W Malone. 2022. Supermind Design for Responding to Covid-19: A case study of university students generating innovative ideas for a societal problem. (2022).
[31]
Jo’Anne Langham and Neil Paulsen. 2020. Simulating the cognitive leap using brainwriting. Design Management Journal 15, 1 (2020), 85–101.
[32]
Robert Laubacher, Annalyn Bachmann, Kathleen Kennedy, and Thomas W Malone. 2023. Supermind Design for inventing smarter organizations: Applying a new organizational design approach in a professional services setting. (2023).
[33]
Robert Laubacher, Gianni Giacomelli, Kathleen Kennedy, David Sun Kong, Annalyn Bachmann, Katharina Kramer, Paul Schlag, and Thomas W. Malone. 2020. Using a Supermind to Design a Supermind: A Case Study of University Researchers and Corporate Executives Co-Designing an Innovative Healthcare Concept. https://doi.org/10.2139/ssrn.3601059
[34]
Jung-Yong Lee and Chang-Hyun Jin. 2019. How Collective Intelligence Fosters Incremental Innovation. Journal of Open Innovation: Technology, Market, and Complexity 5, 3 (Sept. 2019), 53. https://doi.org/10.3390/joitmc5030053
[35]
Terence Lee, Lauren O’Mahony, and Pia Lebeck. 2023. Prompts for Creativity. In Creativity and Innovation: Everyday Dynamics and Practice, Terence Lee, Lauren O’Mahony, and Pia Lebeck (Eds.). Springer Nature, Singapore, 85–115. https://doi.org/10.1007/978-981-19-8880-6_4
[36]
J. S. Linsey, I. Tseng, K. Fu, J. Cagan, K. L. Wood, and C. Schunn. 2010. A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty. Journal of Mechanical Design 132, 4 (April 2010), 041003. https://doi.org/10.1115/1.4001110
[37]
Todd I. Lubart. 2001. Models of the Creative Process: Past, Present and Future. Creativity Research Journal 13, 3-4 (Oct. 2001), 295–308. https://doi.org/10.1207/S15326934CRJ1334_07
[38]
A. Majchrzak and A. Malhotra. 2013. Towards an information systems perspective and research agenda on crowdsourcing for innovation. The Journal of Strategic Information Systems 22, 4 (Dec. 2013), 257–268. https://doi.org/10.1016/j.jsis.2013.07.004
[39]
Thomas W Malone. 2018. Superminds: The surprising power of people and computers thinking together. Little, Brown Spark.
[40]
Thomas W Malone, Kevin Crowston, and George Arthur Herman. 2003. Organizing business knowledge: The MIT process handbook. MIT press.
[41]
Sarnoff Mednick. 1963. The associative basis of the creative process.Psychological Review 69, 3 (April 1963), 220. https://doi.org/10.1037/h0048850 Publisher: US: American Psychological Association.
[42]
Cheryl Nakata and Jiyoung Hwang. 2020. Design thinking for innovation: Composition, consequence, and contingency. Journal of Business Research 118 (Sept. 2020), 117–128. https://doi.org/10.1016/j.jbusres.2020.06.038
[43]
Shakked Noy and Whitney Zhang. 2023. Experimental evidence on the productivity effects of generative artificial intelligence. Science 381, 6654 (2023), 187–192.
[44]
Alex Osborn. 2012. Applied imagination-principles and procedures of creative writing. Read Books Ltd.
[45]
Paul B Paulus, Nicholas W Kohn, and Lauren E Arditti. 2011. Effects of quantity and quality instructions on brainstorming. The Journal of Creative Behavior 45, 1 (2011), 38–46.
[46]
Xavier Pavie and Daphne Carthy. 2015. Leveraging Uncertainty: A Practical Approach to the Integration of Responsible Innovation through Design Thinking. Procedia - Social and Behavioral Sciences 213 (Dec. 2015), 1040–1049. https://doi.org/10.1016/j.sbspro.2015.11.523
[47]
Michael E. Porter. 1998. Competitive strategy: Techniques for analyzing industries and competitors: With a new introduction. Free Press.
[48]
Steven R Rick, Gianni Giacomelli, Haoran Wen, Robert J Laubacher, Nancy Taubenslag, Jennifer L Heyman, Max Sina Knicker, Younes Jeddi, Hendrik Maier, Stephen Dwyer, 2023. Supermind Ideator: Exploring generative AI to support creative problem-solving. arXiv preprint arXiv:2311.01937 (2023).
[49]
Brett Robertson and David Radcliffe. 2008. The Role of Software Tools in Influencing Creative Problem Solving in Engineering Design and Education. American Society of Mechanical Engineers Digital Collection, 999–1007. https://doi.org/10.1115/DETC2006-99343
[50]
Elizabeth B.-N. Sanders and Pieter Jan Stappers. 2008. Co-creation and the new landscapes of design. CoDesign 4, 1 (March 2008), 5–18. https://doi.org/10.1080/15710880701875068
[51]
Nikhil Singh, Guillermo Bernal, Daria Savchenko, and Elena L. Glassman. 2022. Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence. ACM Transactions on Computer-Human Interaction (Feb. 2022). https://doi.org/10.1145/3511599 Just Accepted.
[52]
Steven M. Smith and Julie Linsey. 2011. A Three-Pronged Approach for Overcoming Design Fixation. The Journal of Creative Behavior 45, 2 (2011), 83–91. https://doi.org/10.1002/j.2162-6057.2011.tb01087.x
[53]
Hariharan Subramonyam, Christopher Lawrence Pondoc, Colleen Seifert, Maneesh Agrawala, and Roy Pea. 2023. Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces. arXiv preprint arXiv:2309.14459 (2023).
[54]
Douglas Summers-Stay, Clare R. Voss, and Stephanie M. Lukin. 2023. Brainstorm, then Select: a Generative Language Model Improves Its Creativity Score. https://openreview.net/forum?id=8HwKaJ1wvl
[55]
Todd M. Thrash, Emil G. Moldovan, Victoria C. Oleynick, and Laura A. Maruskin. 2014. The Psychology of Inspiration. Social and Personality Psychology Compass 8, 9 (2014), 495–510. https://doi.org/10.1111/spc3.12127
[56]
Karthik Valmeekam, Alberto Olmo, Sarath Sreedharan, and Subbarao Kambhampati. 2022. Large Language Models Still Can’t Plan (A Benchmark for LLMs on Planning and Reasoning about Change). arXiv preprint arXiv:2206.10498 (2022).
[57]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates, Inc.https://proceedings.neurips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html
[58]
Joel O. Wooten and Karl T. Ulrich. 2017. Idea Generation and the Role of Feedback: Evidence from Field Experiments with Innovation Tournaments. Production and Operations Management 26, 1 (2017), 80–99. https://doi.org/10.1111/poms.12613
[59]
Robert J. Youmans and Thomaz Arciszewski. 2014. Design fixation: Classifications and modern methods of prevention. AI EDAM 28, 2 (May 2014), 129–137. https://doi.org/10.1017/S0890060414000043 Publisher: Cambridge University Press.
[60]
Jinhyo Joseph Yun, Euiseob Jeong, Sangwoo Kim, Heungju Ahn, Kyunghun Kim, Sung Deuk Hahm, and Kyungbae Park. 2021. Collective Intelligence: The Creative Way from Knowledge to Open Innovation. Science, Technology and Society 26, 2 (July 2021), 201–222. https://doi.org/10.1177/09717218211005604 Publisher: SAGE Publications India.
[61]
Qihao Zhu and Jianxi Luo. 2023. Generative Transformers for Design Concept Generation. Journal of Computing and Information Science in Engineering 23, 4 (Jan. 2023). https://doi.org/10.1115/1.4056220
Index Terms
- Supermind Ideator: How Scaffolding Human-AI Collaboration Can Increase Creativity
Recommendations
Some Video Games Can Increase the Player's Creativity
It is said that playing video games might make people more creative. There is some evidence of an association, but no so far general theory about any psychological causes, or other key factors. In this study, we test the possibility that different sorts ...
Improving Group Creativity: Brainstorming Versus Non-Brainstorming Techniques in a GSS Environment
HICSS '01: Proceedings of the 34th Annual Hawaii International Conference on System Sciences ( HICSS-34)-Volume 1 - Volume 1Creativity is increasingly important in today's fast changing world. The use of Group Support Systems has been shown to improve the quantity and quality of ideas produced by groups during idea generation. Similarly, creative techniques may be used to ...
Creativity patterns: 5 Habits
VikingPLoP '16: Proceedings of the 10th Travelling Conference on Pattern Languages of ProgramsCreative thinking is a key skill in almost every domain. Creativity is required to innovate, develop new ideas, get deeper insights, address challenges and resolve conflicts. This paper presents patterns of creative habits. These habits can be become ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
CI '24
Sponsor:
Upcoming Conference
CI '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 944Total Downloads
- Downloads (Last 12 months)944
- Downloads (Last 6 weeks)339
Reflects downloads up to 26 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in