research-article

Evaluating Creativity Support Tools in HCI Research

Authors:

Christian Remy,

Lindsay MacDonald Vermeulen,

Michael Mose Biskjaer,

Peter DalsgaardAuthors Info & Claims

DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

Pages 457 - 476

https://doi.org/10.1145/3357236.3395474

Published: 03 July 2020 Publication History

Abstract

The design and development of Creativity Support Tools (CSTs) is of growing interest in research at the intersection of creativity and Human-Computer Interaction, and has been identified as a 'grand challenge for HCI'. While creativity research and HCI each have had long-standing discussions about---and rich toolboxes of---evaluation methodologies, the nascent field of CST evaluation has so far received little attention. We contribute a survey of 113 research papers that present and evaluate CSTs, and we offer recommendations for future CST evaluation. We center our discussion around six major points that researchers might consider: 1) Clearly define the goal of the CST; 2) link to theory to further understanding of usage of CSTs; 3) recruit domain experts, if applicable and feasible; 4) consider longitudinal, in-situ studies; 5) distinguish and decide whether to evaluate usability or creativity; and 6) as a community, help develop a toolbox for CST evaluation.

References

[1]

Piotr D. Adamczyk, Kevin Hamilton, Michael B. Twidale, and Brian P. Bailey. 2007. HCI and new media arts: methodology and evaluation. In Extended Abstracts Proceedings of the 2007 Conference on Human Factors in Computing Systems, CHI 2007, San Jose, California, USA, April 28 - May 3, 2007. 2813--2816.

Digital Library

[2]

PatrÃcia Alves-Oliveira, PatrÃcia Arriaga, Ana Paiva, and Guy Hoffman. 2017. YOLO, a Robot for Creativity: A Co-Design Study with Children. In Proceedings of the 2017 Conference on Interaction Design and Children IDC '17. ACM Press, Stanford, California, USA, 423--429.

Digital Library

[3]

Teresa M Amabile. 1983. The social psychology of creativity: A componential conceptualization. Journal of personality and social psychology 45, 2 (1983), 357.

[4]

Teresa M Amabile. 1996. Creativity in context: Update to "The social psychology of creativity" (2 ed.). Westview Press, Boulder, CO.

[5]

Salvatore Andolina, Hendrik Schneider, Joel Chan, Khalil Klouche, Giulio Jacucci, and Steven Dow. 2017. Crowdboard: Augmenting In-Person Idea Generation with Real-Time Crowds. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition C&C'17. ACM Press, Singapore, Singapore, 106--118.

Digital Library

[6]

Maryam Azh, Shengdong Zhao, and Sriram Subramanian. 2016. Investigating Expressive Tactile Interaction Design in Artistic Graphical Representations. ACM Trans.comput.-Hum. Interact. 23, 5 (Oct. 2016), 32:1--32:47.

Digital Library

[7]

John Baer and Sharon S McKool. 2009. Assessing Creativity Using the Consensual Assessment Technique. Hershey, 65âĂŞ77.

[8]

Patti Bao, Elizabeth Gerber, Darren Gergle, and David Hoffman. 2010. Momentum: Getting and Staying on Topic During a Brainstorm. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1233--1236.

Digital Library

[9]

Gabriel Barata, Sandra Gama, Manuel J. Fonseca, and Daniel GonÃğalves. 2013. Improving Student Creativity with Gamification and Virtual Worlds. In Proceedings of the First International Conference on Gameful Design, Research, and Applications. ACM, New York, NY, USA, 95--98.

Digital Library

[10]

Louise Barkhuus and Jennifer A. Rode. 2007. From Mice to Men - 24 Years of Evaluation in CHI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA.

Digital Library

[11]

Eric P.S. Baumer, Jordan Sinclair, and Bill Tomlinson. 2010. America is Like Metamucil: Fostering Critical and Creative Thinking About Metaphor in Political Blogs. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1437--1446.

Digital Library

[12]

Tilde Bekker, Janienke Sturm, and Berry Eggen. 2010. Designing Playful Interactions for Social Interaction and Physical Play. Personal Ubiquitous Comput. 14, 5 (July 2010), 385--396.

[13]

Luca Benedetti, Holger WinnemÃűller, Massimiliano Corsini, and Roberto Scopigno. 2014. Painting with Bob: Assisted Creativity for Novices. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 419--428.

Digital Library

[14]

Ben Bengler and Nick Bryan-Kinns. 2013. Designing Collaborative Musical Experiences for Broad Audiences. In Proceedings of the 9th ACM Conference on Creativity & Cognition. ACM, New York, NY, USA, 234--242.

Digital Library

[15]

Enrico Bertini, Catherine Plaisant, and Giuseppe Santucci. 2007. BELIV'06: Beyond Time and Errors; Novel Evaluation Methods for Information Visualization. interactions 14, 3 (May 2007), 59--60.

Digital Library

[16]

Elizabeth Bonsignore, Alexander J. Quinn, Allison Druin, and Benjamin B. Bederson. 2013. Sharing Stories âĂIJin the WildâĂI: A Mobile Storytelling Case Study Using StoryKit. ACM Trans.comput.-Hum. Interact. 20, 3 (July 2013), 18:1--18:38.

Digital Library

[17]

N. Bryan-Kinns. 2004. Daisyphone: The Design and Impact of a Novel Environment for Remote Group Music Improvisation. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. ACM, New York, NY, USA, 135--144.

Digital Library

[18]

Nick Bryan-Kinns, Patrick G. T. Healey, and Joe Leach. 2007. Exploring Mutual Engagement in Creative Collaborations. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition. ACM, New York, NY, USA, 223--232.

Digital Library

[19]

Hronn Brynjarsdottir, Maria HÃěkansson, James Pierce, Eric Baumer, Carl DiSalvo, and Phoebe Sengers. 2012. Sustainably unpersuaded: how persuasion narrows our vision of sustainability. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 947--956.

[20]

Peter Calingaert. 1967. System Performance Evaluation: Survey and Appraisal.commun. ACM 10, 1 (Jan. 1967), 12--18.

Digital Library

[21]

Xiang Cao, SiÃćn E. Lindley, John Helmes, and Abigail Sellen. 2010. Telling the Whole Story: Anticipation, Inspiration and Reputation in a Field Deployment of TellTable. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work. ACM, New York, NY, USA, 251--260.

Digital Library

[22]

Erin A. Carroll and Celine Latulipe. 2009. The Creativity Support Index. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, New York, NY, USA, 4009--4014.

Digital Library

[23]

Erin A. Carroll, Celine Latulipe, Richard Fung, and Michael Terry. 2009. Creativity Factor Evaluation: Towards a Standardized Survey Metric for Creativity Support. In Proceedings of the Seventh ACM Conference on Creativity and Cognition. ACM, New York, NY, USA, 127--136.

Digital Library

[24]

Alejandro Catala, Javier Jaen, Betsy van Dijk, and Sergi JordÃā. 2012. Exploring Tabletops As an Effective Tool to Foster Creativity Traits. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM, New York, NY, USA, 143--150.

Digital Library

[25]

Joel Chan, Steven Dang, and Steven P Dow. 2016. Improving Crowd Innovation with Expert Facilitation. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16. ACM Press, San Francisco, California, USA, 1221--1233.

Digital Library

[26]

Siddhartha Chaudhuri and Vladlen Koltun. 2010. Data-driven Suggestions for Creativity Support in 3D Modeling. In ACM SIGGRAPH Asia 2010 Papers. ACM, New York, NY, USA, 183:1--183:10.

Digital Library

[27]

Erin Cherry and Celine Latulipe. 2014. Quantifying the Creativity Support of Digital Tools Through the Creativity Support Index. ACM Trans.comput.-Hum. Interact. 21, 4 (June 2014), 21:1--21:25.

Digital Library

[28]

Sharon Lynn Chu Yew Yee, Francis K.H. Quek, and Lin Xiao. 2011. Studying Medium Effects on Children's Creative Processes. In Proceedings of the 8th ACM Conference on Creativity and Cognition. ACM, New York, NY, USA, 3--12.

Digital Library

[29]

Marianela Ciolfi Felice, Sarah Fdili Alaoui, and Wendy E. Mackay. 2018. Knotation: Exploring and Documenting Choreographic Processes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 448:1--448:12.

Digital Library

[30]

Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A. Smith. 2018. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval - IUI '18. ACM Press, Tokyo, Japan, 329--340.

Digital Library

[31]

Andy Cockburn, Carl Gutwin, and Alan Dix. 2018. HARK No More: On the Preregistration of CHI Experiments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 141, 12 pages.

Digital Library

[32]

Tim Coughlan and Peter Johnson. 2009. Understanding Productive, Structural and Longitudinal Interactions in the Design of Tools for Creative Activities. In Proceedings of the Seventh ACM Conference on Creativity and Cognition. ACM, New York, NY, USA, 155--164.

Digital Library

[33]

Peter Dalsgaard. 2014. Pragmatism and Design Thinking. 8, 1 (2014), 13.

[34]

Peter Dalsgaard, Christian Remy, Jonas Frich Pedersen, Lindsay MacDonald Vermeulen, and Michael Mose Biskjaer. 2018. Digital Tools in Collaborative Creative Work. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction (NordiCHI '18). ACM, New York, NY, USA, 964--967.

Digital Library

[35]

Sayamindu Dasgupta, William Hale, AndrÃl's Monroy-HernÃandez, and Benjamin Mako Hill. 2016. Remixing as a Pathway to Computational Thinking. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16. ACM Press, San Francisco, California, USA, 1436--1447.

Digital Library

[36]

Sayamindu Dasgupta and Benjamin Mako Hill. 2017. Scratch Community Blocks: Supporting Children as Data Scientists. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems CHI '17. ACM Press, Denver, Colorado, USA, 3620--3631.

Digital Library

[37]

Matthew E. P. Davies, Philippe Hamel, Kazuyoshi Yoshii, and Masataka Goto. 2014. AutoMashUpper: Automatic Creation of Multi-song Music Mashups. IEEE/ACM Trans. Audio, Speech and Lang. Proc. 22, 12 (Dec. 2014), 1726--1737.

Digital Library

[38]

Nicholas Davis, Chih-PIn Hsiao, Kunwar Yashraj Singh, Lisa Li, Sanat Moningi, and Brian Magerko. 2015. Drawing Apprentice: An Enactive Co-Creative Agent for Artistic Collaboration. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 185--186.

Digital Library

[39]

Nicholas Davis, Chih-PIn Hsiao, Kunwar Yashraj Singh, Lisa Li, and Brian Magerko. 2016. Empirically Studying Participatory Sense-Making in Abstract Drawing with a Co-Creative Cognitive Agent. In Proceedings of the 21st International Conference on Intelligent User Interfaces IUI '16. ACM Press, Sonoma, California, USA, 196--207.

Digital Library

[40]

Nicholas Davis, Alexander Zook, Brian O'Neill, Brandon Headrick, Mark Riedl, Ashton Grosz, and Michael Nitsche. 2013. Creativity Support for Novice Digital Filmmaking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 651--660.

Digital Library

[41]

Jelle van Dijk, Jirka van der Roest, Remko van der Lugt, and Kees C.J. Overbeeke. 2011. NOOT: A Tool for Sharing Moments of Reflection During Creative Meetings. In Proceedings of the 8th ACM Conference on Creativity and Cognition. ACM, New York, NY, USA, 157--164.

Digital Library

[42]

Carl DiSalvo, Marti Louw, Julina Coupland, and Mary Ann Steiner. 2009. Local Issues, Local Uses: Tools for Robotics and Sensing in Community Contexts. In Proceedings of the Seventh ACM Conference on Creativity and Cognition. ACM, New York, NY, USA, 245--254.

Digital Library

[43]

Alan Dix. 2008. Theoretical analysis and theory creation. In Research Methods for Human-Computer Interaction. Cambridge University Press.

[44]

Douglas Engelbart. 1962. Augmenting Human Intellect: A Conceptual Framework. Summary Report AFOSR-3233. Washington, DC, USA. https://web. stanford.edu/dept/SUL/library/extra4/sloan/mousesite/EngelbartPapers/B5_F18_ConceptFrameworkInd.html

[45]

Shelly Engelman, Brian Magerko, Tom McKlin, Morgan Miller, Doug Edwards, and Jason Freeman. 2017. Creativity in Authentic STEAM Education with Ear Sketch. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education SIGCSE '17. ACM Press, Seattle, Washington, USA, 183--188.

Digital Library

[46]

Umer Farooq, John M. Carroll, and Craig H. Ganoe. 2007. Supporting Creativity with Awareness in Distributed Collaboration. In Proceedings of the 2007 International ACM Conference on Supporting Group Work. ACM, New York, NY, USA, 31--40.

Digital Library

[47]

Gerhard Fischer. 2004. Social Creativity: Turning Barriers into Opportunities for Collaborative Design. In Proceedings of the Eighth Conference on Participatory Design: Artful Integration: Interweaving Media, Materials and Practices - Volume 1. ACM, New York, NY, USA, 152--161.

Digital Library

[48]

Jonas Frich, Michael Mose Biskjaer, and Peter Dalsgaard. 2018a. Why HCI and Creativity Research Must Collaborate to Develop New Creativity Support Tools. In Proceedings of the Technology, Mind, and Society. ACM Press, Washington, DC, USA, 1--6.

Digital Library

[49]

Jonas Frich, Michael Mose Biskjaer, and Peter Dalsgaard. 2018b. Twenty Years of Creativity Research in Human-Computer Interaction: Current State and Future Directions. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 1235--1257.

Digital Library

[50]

Jonas Frich, Lindsay MacDonald Vermeulen, Christian Remy, Michael Mose Biskjaer, and Peter Dalsgaard. 2019. Mapping the Landscape of Creativity Support Tools in HCI. 18.

[51]

Quentin Galvane, Marc Christie, Chrsitophe Lino, and RÃl'mi Ronfard. 2015. Camera-on-rails: Automated Computation of Constrained Camera Paths. In Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games. ACM, New York, NY, USA, 151--157.

Digital Library

[52]

JÃl'rÃl'mie Garcia, Theophanis Tsandilas, Carlos Agon, and Wendy E. Mackay. 2014. Structured Observation with Polyphony: A Multifaceted Tool for Studying Music Composition. In Proceedings of the 2014 Conference on Designing Interactive Systems. ACM, New York, NY, USA, 199--208.

Digital Library

[53]

Howard Gardner. 1988. Creativity: An interdisciplinary perspective. Creativity Research Journal 1, 1 (Dec. 1988), 8--26.

[54]

Jill GerhardtâĂŘPowals. 1996. Cognitive engineering principles for enhancing humanâĂŘŘcomputer performance. International Journal of Human-Computer Interaction 8, 2 (Apr 1996), 189âĂŞ211.

Digital Library

[55]

Florian Geyer, Jochen Budzinski, and Harald Reiterer. 2012. IdeaVis: A Hybrid Workspace and Interactive Visualization for Paper-based Collaborative Sketching Sessions. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. ACM, New York, NY, USA, 331--340.

Digital Library

[56]

Florian Geyer, Ulrike Pfeil, Anita HÃűchtl, Jochen Budzinski, and Harald Reiterer. 2011. Designing Reality-based Interfaces for Creative Group Work. In Proceedings of the 8th ACM Conference on Creativity and Cognition. ACM, New York, NY, USA, 165--174.

Digital Library

[57]

Karni Gilon, Joel Chan, Felicia Y. Ng, Hila Liifshitz-Assaf, Aniket Kittur, and Dafna Shahaf. 2018. Analogy Mining for Specific Design Needs. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, Montreal QC, Canada, 1--11.

Digital Library

[58]

Victor Girotto, Erin Walker, and Winslow Burleson. 2017. The Effect of Peripheral Micro-tasks on Crowd Ideation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, Denver, Colorado, USA, 1843--1854.

Digital Library

[59]

Eric Gordon, Becky E. Michelson, and Jason Haas. 2016. @Stake: A Game to Facilitate the Process of Deliberative Democracy. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion - CSCW '16 Companion. ACM Press, San Francisco, California, USA, 269--272.

Digital Library

[60]

Wayne D. Gray. 1995. Discount or Disservice?: Discount Usability AnalysisâĂŞ Sevaluation at a Bargain Price or Simply Damaged Merchandise? (Panel Session). In Conference Companion on Human Factors in Computing Systems (CHI '95). ACM, New York, NY, USA, 176--177.

Digital Library

[61]

Saul Greenberg and Bill Buxton. 2008. Usability Evaluation Considered Harmful (Some of the Time). In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 111--120.

Digital Library

[62]

Garth Griffin and Robert Jacob. 2013. Priming Creativity Through Improvisation on an Adaptive Musical Instrument. In Proceedings of the 9th ACM Conference on Creativity & Cognition. ACM, New York, NY, USA, 146--155.

Digital Library

[63]

J. P. Guilford. 1950. Creativity. American Psychologist 5, 9 (1950), 444--454.

[64]

Joy Paul Guilford. 1967. The nature of human intelligence. McGraw-Hill, New York.

[65]

Florian GÃijldenpfennig, Wolfgang Reitberger, and Geraldine Fitzpatrick. 2012. Capturing Rich Media Through Media Objects on Smartphones. In Proceedings of the 24th Australian Computer-Human Interaction Conference. ACM, New York, NY, USA, 180--183.

Digital Library

[66]

Adam Haar Horowitz, Ishaan Grover, Pedro Reynolds-CuÃl'llar, Cynthia Breazeal, and Pattie Maes. 2018. Dormio: Interfacing with Dreams. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, alt10:1--alt10:10.

Digital Library

[67]

Joshua Hailpern, Erik Hinterbichler, Caryn Leppert, Damon Cook, and Brian P. Bailey. 2007. TEAM STORM: Demonstrating an Interaction Model for Working with Multiple Ideas During Creative Group Work. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition. ACM, New York, NY, USA, 193--202.

Digital Library

[68]

John Halloran, Eva Hornecker, Geraldine Fitzpatrick, Mark Weal, David Millard, Danius Michaelides, Don Cruickshank, and David De Roure. 2006. The Literacy Fieldtrip: Using UbiComp to Support Children's Creative Writing. In Proceedings of the 2006 Conference on Interaction Design and Children. ACM, New York, NY, USA, 17--24.

Digital Library

[69]

Megan K. Halpern, Jakob Tholander, Max Evjen, Stuart Davis, Andrew Ehrlich, Kyle Schustak, Eric P.S. Baumer, and Geri Gay. 2011. MoBoogie: Creative Expression Through Whole Body Musical Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 557--560.

Digital Library

[70]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Human mental workload. North-Holland, Oxford, England, 139--183.

[71]

Peter HedstrÃűm and Petri Ylikoski. 2010. Causal Mechanisms in the Social Sciences. Annual Review of Sociology 36, 1 (June 2010), 49--67.

[72]

Beth A Hennessey and Teresa M Amabile. 1999. Consensual assessment. Encyclopedia of creativity 1 (1999), 347--359.

[73]

Tom Hewett, Mary Czerwinski, Michael Terry, Jay Nunamaker, Linda Candy, Bill Kules, and Elisabeth Sylvan. 2005. Creativity support tool evaluation methods and metrics. Creativity Support Tools (2005), 10--24.

[74]

Otmar Hilliges, Lucia Terrenghi, Sebastian Boring, David Kim, Hendrik Richter, and Andreas Butz. 2007. Designing for Collaborative Creative Problem Solving. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition. ACM, New York, NY, USA, 137--146.

Digital Library

[75]

D. Hocevar. 1981. Measurement of creativity: review and critique. Journal of Personality Assessment 45, 5 (Oct. 1981), 450--464.

[76]

Rania Hodhod and Brian Magerko. 2016. Closing the Cognitive Gap between Humans and Interactive Narrative Agents Using Shared Mental Models. In Proceedings of the 21st International Conference on Intelligent User Interfaces - IUI '16. ACM Press, Sonoma, California, USA, 135--146.

Digital Library

[77]

Eva Hornecker. 2010. Creative Idea Exploration Within the Structure of a Guiding Framework: The Card Brainstorming Game. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, NY, USA, 101--108.

Digital Library

[78]

Cheng-Zhi Anna Huang, David Duvenaud, and Krzysztof Z. Gajos. 2016. ChordRipple: Recommending Chords to Help Novice Composers Go Beyond the Ordinary. In Proceedings of the 21st International Conference on Intelligent User Interfaces - IUI '16. ACM Press, Sonoma, California, USA, 241--250.

Digital Library

[79]

Samuel Huron, Pauline Gourlet, Uta Hinrichs, Trevor Hogan, and Yvonne Jansen. 2017. Let's Get Physical: Promoting Data Physicalization in Workshop Formats. In Proceedings of the 2017 Conference on Designing Interactive Systems - DIS '17. ACM Press, Edinburgh, United Kingdom, 1409--1422.

Digital Library

[80]

Junko Ichino, Aura Pon, Ehud Sharlin, David Eagle, and Sheelagh Carpendale. 2014. Vuzik: The Effect of Large Gesture Interaction on Children's Creative Musical Expression. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design. ACM, New York, NY, USA, 240--249.

Digital Library

[81]

Sam Jacoby and Leah Buechley. 2013. Drawing the Electric: Storytelling with Conductive Ink. In Proceedings of the 12th International Conference on Interaction Design and Children. ACM, New York, NY, USA, 265--268.

Digital Library

[82]

Peter H. Kahn, Takayuki Kanda, Hiroshi Ishiguro, Brian T. Gill, Solace Shen, Jolina H. Ruckert, and Heather E. Gary. 2016. Human creativity can be facilitated through interacting with a social robot. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, Christchurch, New Zealand, 173--180.

[83]

Michael Karlesky and Katherine Isbister. 2014. Designing for the Physical Margins of Digital Workspaces: Fidget Widgets in Support of Productivity and Creativity. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, New York, NY, USA, 13--20.

Digital Library

[84]

Jun Kato, Tomoyasu Nakano, and Masataka Goto. 2015. TextAlive: Integrated Design Environment for Kinetic Typography. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 3403--3412.

Digital Library

[85]

Natsumi Kato, Hiroyuki Osone, Daitetsu Sato, Naoya Muramatsu, and Yoichi Ochiai. 2018. DeepWear: a Case Study of Collaborative Design between Human and Artificial Intelligence. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '18. ACM Press, Stockholm, Sweden, 529--536.

Digital Library

[86]

James C. Kaufman. 2014. Measuring Creativity - the Last Windmill? | The Creativity Post. (2014). http://www.creativitypost.com/psychology/measuring_ creativity_the_last_windmill

[87]

James C. Kaufman, Jonathan A. Plucker, and John Baer. 2008. Essentials of creativity assessment. John Wiley & Sons Inc.

[88]

Joseph 'Jofish' Kaye. 2007. Evaluating Experience-focused HCI. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI EA '07). ACM, New York, NY, USA, 1661--1664.

Digital Library

[89]

Rubaiat Habib Kazi, Kien Chuan Chua, Shengdong Zhao, Richard Davis, and Kok-Lim Low. 2011. SandCanvas: A Multi-touch Art Medium Inspired by Sand Animation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1283--1292.

Digital Library

[90]

Andruid Kerne, Andrew Billingsley, Nic Lupfer, Rhema Linder, Yin Qu, Alyssa Valdez, Ajit Jain, Kade Keith, Matthew Carrasco, and Jorge Vanegas. 2017. Strategies of Free-Form Web Curation: Processes of Creative Engagement with Prior Work. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition - C&C'17. ACM Press, Singapore, Singapore, 380--392.

Digital Library

[91]

Andruid Kerne, Eunyee Koh, Steven Smith, Hyun Choi, Ross Graeber, and Andrew Webb. 2007. Promoting Emergence in Information Discovery by Representing Collections with Composition. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition. ACM, New York, NY, USA, 117--126.

Digital Library

[92]

Andruid Kerne, Eunyee Koh, Steven M. Smith, Andrew Webb, and Blake Dworaczyk. 2008.combinFormation: Mixed-initiative Composition of Image and Text Surrogates Promotes Information Discovery. ACM Trans. Inf. Syst. 27, 1 (Dec. 2008), 5:1--5:45.

Digital Library

[93]

Andruid Kerne, Andrew M. Webb, Celine Latulipe, Erin Carroll, Steven M. Drucker, Linda Candy, and Kristina HÃűÃűk. 2013. Evaluation Methods for Creativity Support Environments. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 3295--3298.

Digital Library

[94]

Andruid Kerne, Andrew M. Webb, Steven M. Smith, Rhema Linder, Nic Lupfer, Yin Qu, Jon Moeller, and Sashikanth Damaraju. 2014. Using Metrics of Curation to Evaluate Information-Based Ideation. ACM Trans.comput.-Hum. Interact. 21, 3 (June 2014), 14:1--14:48.

Digital Library

[95]

Joy Kim, Maneesh Agrawala, and Michael S. Bernstein. 2017. Mosaic: Designing Online Creative Communities for Sharing Works-in-Progress. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17. ACM Press, Portland, Oregon, USA, 246--258.

Digital Library

[96]

Joy Kim, Justin Cheng, and Michael S. Bernstein. 2014. Ensemble: Exploring Complementary Strengths of Leaders and Crowds in Creative Collaboration. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, New York, NY, USA, 745--755.

Digital Library

[97]

Joy Kim, Mira Dontcheva, Wilmot Li, Michael S. Bernstein, and Daniela Steinsapir. 2015. Motif: Supporting Novice Creativity Through Expert Patterns. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1211--1220.

Digital Library

[98]

Joy Kim and Andres Monroy-Hernandez. 2016. Storia: Summarizing Social Media Content Based on Narrative Theory Using Crowdsourcing. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1018--1027.

Digital Library

[99]

Joy Kim, Sarah Sterman, Allegra Argent Beal Cohen, and Michael S. Bernstein. 2017. Mechanical Novel: Crowdsourcing Complex Work through Reflection and Revision. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17. ACM Press, Portland, Oregon, USA, 233--245.

Digital Library

[100]

Celine Latulipe, Erin A. Carroll, and Danielle Lottridge. 2011. Evaluating Longitudinal Projects Combining Technology with Temporal Arts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1835--1844.

Digital Library

[101]

David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 36:1--36:17.

Digital Library

[102]

Sara Ljungblad. 2009. Passive Photography from a Creative Perspective: "If I Would Just Shoot the Same Thing for Seven Days, It's Like... What's the Point?". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 829--838.

Digital Library

[103]

Fei Lu, Feng Tian, Yingying Jiang, Xiang Cao, Wencan Luo, Guang Li, Xiaolong Zhang, Guozhong Dai, and Hongan Wang. 2011. ShadowStory: Creative and Collaborative Digital Storytelling Inspired by Cultural Heritage. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1919--1928.

Digital Library

[104]

Kurt Luther, Casey Fiesler, and Amy Bruckman. 2013. Redistributing Leadership in Online Creative Collaboration. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work. ACM, New York, NY, USA, 1007--1022.

Digital Library

[105]

Neil Maiden, Konstantinos Zachos, Amanda Brown, George Brock, Lars Nyre, Aleksander NygÃěrd Tonheim, Dimitris Apsotolou, and Jeremy Evans. 2018. Making the News: Digital Creativity Support for Journalists. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems CHI '18. ACM Press, Montreal QC, Canada, 1--11.

Digital Library

[106]

Nicolas Mangano, Alex Baker, Mitch Dempsey, Emily Navarro, and AndrÃl' van der Hoek. 2010. Software Design Sketching with Calico. In Proceedings of the IEEE/ACM International Conference on Automated Software Engineering. ACM, New York, NY, USA, 23--32.

Digital Library

[107]

Charles Martin, Henry Gardner, Ben Swift, and Michael Martin. 2016. Intelligent Agents and Networked Buttons Improve Free-Improvised Ensemble Music-Making on Touch-Screens. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, Santa Clara, California, USA, 2295--2306.

Digital Library

[108]

J. Nathan Matias, Sayamindu Dasgupta, and Benjamin Mako Hill. 2016. Skill Progression in Scratch Revisited. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, Santa Clara, California, USA, 1486--1490.

Digital Library

[109]

Nolwenn Maudet, Ghita Jalal, Philip Tchernavskij, Michel Beaudouin-Lafon, and Wendy E. Mackay. 2017. Beyond Grids: Interactive Graphical Substrates to Structure Digital Layout. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, Denver, Colorado, USA, 5053--5064.

Digital Library

[110]

Ali Mazalek, Sanjay Chandrasekharan, Michael Nitsche, Tim Welsh, Paul Clifton, Andrew Quitmeyer, Firaz Peer, Friedrich Kirschner, and Dilip Athreya. 2011. I'M in the Game: Embodied Puppet Interface Improves Avatar Control. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, NY, USA, 129--136.

Digital Library

[111]

Florian Mueller, Martin R. Gibbs, Frank Vetere, and Darren Edge. 2014. Supporting the Creative Game Design Process with Exertion Cards. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2211--2220.

Digital Library

[112]

Brad A. Myers, Ashley Lai, Tam Minh Le, YoungSeok Yoon, Andrew Faulring, and Joel Brandt. 2015. Selective Undo Support for Painting Applications. ACM Press, 4227--4236.

Digital Library

[113]

Naoto Nakazato, Shigeo Yoshida, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2014. Smart Face: Enhancing Creativity During Video Conferences Using Real-time Facial Deformation. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, New York, NY, USA, 75--83.

Digital Library

[114]

Grace Ngai, Stephen C.F. Chan, Hong Va Leong, and Vincent T.Y. Ng. 2013. Designing I*CATch: A Multipurpose, Education-friendly Construction Kit for Physical and Wearable Computing. Trans.comput. Educ. 13, 2 (July 2013), 7:1--7:30.

Digital Library

[115]

Tricia J. Ngoon, C. Ailie Fraser, Ariel S. Weingarten, Mira Dontcheva, and Scott Klemmer. 2018. Interactive Guidance Techniques for Improving Creative Feedback. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, Montreal QC, Canada, 1--11.

Digital Library

[116]

Jakob Nielsen. 1989. Usability Engineering at a Discount. In Proceedings of the Third International Conference on Human-computer Interaction on Designing and Using Human-computer Interfaces and Knowledge Based Systems (2Nd Ed.). Elsevier Science Inc., New York, NY, USA, 394--401. http://dl.acm.org/citation.cfm?id=92449.92499

Digital Library

[117]

Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann Publishers, San Francisco, Calif.

Digital Library

[118]

Lora Oehlberg, Kyu Simm, Jasmine Jones, Alice Agogino, and BjÃűrn Hartmann. 2012. Showing is Sharing: Building Shared Understanding in Human-centered Design Teams with Dazzle. In Proceedings of the Designing Interactive Systems Conference. ACM, New York, NY, USA, 669--678.

Digital Library

[119]

Hyunjoo Oh, Jiffer Harriman, Abhishek Narula, Mark D. Gross, Michael Eisenberg, and Sherry Hsi. 2016. Crafting Mechatronic Percussion with Everyday Materials. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '16. ACM Press, Eindhoven, Netherlands, 340--348.

Digital Library

[120]

Antti Oulasvirta, Anna Feit, Perttu LÃd'hteenlahti, and Andreas Karrenbauer. 2017.computational Support for Functionality Selection in Interaction Design. ACM Transactions on Computer-Human Interaction 24, 5 (Oct. 2017), 1--30.

Digital Library

[121]

Ingrid Pettersson, Anna-Katharina Frison, Florian Lachner, Andreas Riener, and Jesper Nolhage. 2017. Triangulation in UX Studies: Learning from Experience. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (DIS '17 Companion). ACM, New York, NY, USA, 341--344.

Digital Library

[122]

Ingrid Pettersson, Florian Lachner, Anna-Katharina Frison, Andreas Riener, and Andreas Butz. 2018. A Bermuda Triangle?: A Review of Method Application and Triangulation in User Experience Evaluation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 461:1--461:16.

Digital Library

[123]

Cecil Piya, Vinayak, Senthil Chandrasegaran, Niklas Elmqvist, and Karthik Ramani. 2017. Co-3Deator: A Team-First Collaborative 3D Design Ideation Tool. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, Denver, Colorado, USA, 6581--6592.

Digital Library

[124]

Karl R. Popper. 1962. Conjectures and Refutations: The Growth of Scientific Knowledge (first edition edition ed.). Basic Books.

[125]

Thorsten Prante, Carsten Magerkurth, and Norbert Streitz. 2002. Developing CSCW Tools for Idea Finding -: Empirical Results and Implications for Design. In Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work. ACM, New York, NY, USA, 106--115.

Digital Library

[126]

Daniel Rees Lewis, Emily Harburg, Elizabeth Gerber, and Matthew Easterday. 2015. Building Support Tools to Connect Novice Designers with Professional Coaches. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 43--52.

Digital Library

[127]

Christian Remy, Oliver Bates, Alan Dix, Vanessa Thomas, Mike Hazas, Adrian Friday, and Elaine M. Huang. 2018a. Evaluation beyond Usability: Validating Sustainable HCI Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18).

[128]

Christian Remy, Oliver Bates, Jennifer Mankoff, and Adrian Friday. 2018b. Evaluating HCI Research beyond Usability. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. Montreal, Canada.

Digital Library

[129]

Christian Remy, Oliver Bates, Vanessa Thomas, and Elaine May Huang. 2017. The Limits of Evaluating Sustainability. In Proceedings of the Third Workshop on Computing within Limits. ACM Press, Santa Barbara, California, USA.

Digital Library

[130]

Mel Rhodes. 1961. An Analysis of Creativity. The Phi Delta Kappan 42, 7 (1961), 305--310. https://www.jstor.org/stable/20342603

[131]

Daniela Rosner and Jonathan Bean. 2009. Learning from IKEA Hacking: I'M Not One to Decoupage a Tabletop and Call It a Day. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 419--422.

Digital Library

[132]

Daniela K. Rosner and Kimiko Ryokai. 2010. Spyn: Augmenting the Creative and Communicative Potential of Craft. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2407--2416.

Digital Library

[133]

Mark A. Runco and Selcuk Acar. 2012. Divergent Thinking as an Indicator of Creative Potential. Creativity Research Journal 24, 1 (2012), 66--75.

[134]

Mark A. Runco and Garrett J. Jaeger. 2012. The Standard Definition of Creativity. Creativity Research Journal 24, 1 (Jan. 2012), 92--96.

[135]

Jana Schumann, Patrick C. Shih, David F. Redmiles, and Graham Horton. 2012. Supporting Initial Trust in Distributed Idea Generation and Idea Evaluation. In Proceedings of the 17th ACM International Conference on Supporting Group Work. ACM, New York, NY, USA, 199--208.

Digital Library

[136]

Duane F. Shell, Leen-Kiat Soh, Abraham E. Flanigan, Markeya S. Peteranetz, and Elizabeth Ingraham. 2017. Improving Students' Learning and Achievement in CS Classrooms through Computational Creativity Exercises that Integrate Computational and Creative Thinking. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education - SIGCSE '17. ACM Press, Seattle, Washington, USA, 543--548.

Digital Library

[137]

Ben Shneiderman. 2000. Creating Creativity: User Interfaces for Supporting Innovation. ACM Trans.comput.-Hum. Interact. 7, 1 (March 2000), 114--138.

Digital Library

[138]

Ben Shneiderman. 2007. Creativity Support Tools: Accelerating Discovery and Innovation.commun. ACM 50, 12 (Dec. 2007), 20--32.

Digital Library

[139]

Maria Shugrina, Jingwan Lu, and Stephen Diverdi. 2017. Playful palette: an interactive parametric color mixer for artists. ACM Transactions on Graphics 36, 4 (July 2017), 1--10.

Digital Library

[140]

Pao Siangliulue, Joel Chan, Krzysztof Z. Gajos, and Steven P. Dow. 2015. Providing Timely Examples Improves the Quantity and Quality of Generated Ideas. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 83--92.

Digital Library

[141]

Vikash Singh, Celine Latulipe, Erin Carroll, and Danielle Lottridge. 2011. The Choreographer's Notebook: A Video Annotation System for Dancers and Choreographers. In Proceedings of the 8th ACM Conference on Creativity and Cognition. ACM, New York, NY, USA, 197--206.

Digital Library

[142]

DorothÃl' Smit, Thomas Grah, Martin Murer, Vincent van Rheden, and Manfred Tscheligi. 2018. MacroScope: First-Person Perspective in Physical Scale Models. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '18. ACM Press, Stockholm, Sweden, 253--259.

Digital Library

[143]

Cesar Torres, Wilmot Li, and Eric Paulos. 2016. ProxyPrint: Supporting Crafting Practice through Physical Computational Proxies. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16. ACM Press, Brisbane, QLD, Australia, 158--169.

Digital Library

[144]

Cesar Torres and Eric Paulos. 2015. MetaMorphe: Designing Expressive 3D Models for Digital Fabrication. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 73--82.

Digital Library

[145]

Theophanis Tsandilas, Catherine Letondal, and Wendy E. Mackay. 2009. Musink: Composing Music Through Augmented Drawing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 819--828.

Digital Library

[146]

Rajan Vaish, Shirish Goyal, Amin Saberi, and Sharad Goel. 2018. Creating Crowdsourced Research Talks at Scale. In Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18. ACM Press, Lyon, France, 1--11.

Digital Library

[147]

Dagny Valgeirsdottir and Balder Onarheim. 2017. Studying creativity training programs: A methodological analysis. Creativity and Innovation Management 26, 4 (2017), 430â ? A¸ S439.

[148]

Hao-Chuan Wang, Dan Cosley, and Susan R. Fussell. 2010. Idea Expander: Supporting Group Brainstorming with Conversationally Triggered Visual Thinking Stimuli. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work. ACM, New York, NY, USA, 103--106.

Digital Library

[149]

Hao-Chuan Wang, Susan R. Fussell, and Dan Cosley. 2011. From Diversity to Creativity: Stimulating Group Brainstorming with Cultural Differences and Conversationally-retrieved Pictures. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work. ACM, New York, NY, USA, 265--274.

Digital Library

[150]

Tianyi Wang, Ke Huo, Pratik Chawla, Guiming Chen, Siddharth Banerjee, and Karthik Ramani. 2018. Plain2Fun: Augmenting Ordinary Objects with Interactive Functions by Auto-Fabricating Surface Painted Circuits. In Proceedings of the 2018 on Designing Interactive Systems Conference 2018 - DIS '18. ACM Press, Hong Kong, China, 1095--1106.

Digital Library

[151]

Andrew Warr and Eamonn O'Neill. 2007. Tool Support for Creativity Using Externalizations. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition (C&C'07). ACM, New York, NY, USA, 127--136.

Digital Library

[152]

Kento Watanabe, Yuichiroh Matsubayashi, Kentaro Inui, Tomoyasu Nakano, Satoru Fukayama, and Masataka Goto. 2017. LyriSys: An Interactive Support System for Writing Lyrics Based on Topic Transition. In Proceedings of the 22nd International Conference on Intelligent User Interfaces - IUI '17. ACM Press, Limassol, Cyprus, 559--563.

Digital Library

[153]

Cathleen Wharton, Janice Bradford, Robin Jeffries, and Marita Franzke. 1992. Applying Cognitive Walkthroughs to More Complex User Interfaces: Experiences, Issues, and Recommendations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92). ACM, New York, NY, USA, 381--388.

Digital Library

[154]

Karl D.D. Willis, Juncong Lin, Jun Mitani, and Takeo Igarashi. 2010. Spatial Sketch: Bridging Between Movement & Fabrication. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, NY, USA, 5--12.

Digital Library

[155]

Jun Xie, Aaron Hertzmann, Wilmot Li, and Holger WinnemÃűller. 2014. PortraitSketch: Face Sketching Assistance for Novices. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 407--417.

Digital Library

[156]

Anbang Xu, Shih-Wen Huang, and Brian Bailey. 2014. Voyant: Generating Structured Feedback on Visual Designs Using a Crowd of Non-experts. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, New York, NY, USA, 1433--1444.

Digital Library

[157]

Junichi Yamaoka and Yasuaki Kakehi. 2013. dePENd: Augmented Handwriting System Using Ferromagnetism of a Ballpoint Pen. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 203--210.

Digital Library

[158]

Daisy Yoo, Alina Huldtgren, Jill Palzkill Woelfer, David G. Hendry, and Batya Friedman. 2013. A Value Sensitive Action-reflection Model: Evolving a Co-design Space with Stakeholder and Designer Prompts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 419--428.

Digital Library

[159]

Sang Ho Yoon, Ansh Verma, Kylie Peppler, and Karthik Ramani. 2015. HandiMate: Exploring a Modular Robotics Kit for Animating Crafted Toys. In Proceedings of the 14th International Conference on Interaction Design and Children. ACM, New York, NY, USA, 11--20.

Digital Library

[160]

Natsuko Yoshida, Shogo Fukushima, Daiya Aida, and Takeshi Naemura. 2016. Practical Study of Positive-feedback Button for Brainstorming with Interjection Sound Effects. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16. ACM Press, Santa Clara, California, USA, 1322--1328.

Digital Library

[161]

Lixiu Yu and Jeffrey V. Nickerson. 2011. Cooks or Cobblers?: Crowd Creativity Through Combination. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1393--1402.

Digital Library

[162]

Yupeng Zhang, Teng Han, Zhimin Ren, Nobuyuki Umetani, Xin Tong, Yang Liu, Takaaki Shiratori, and Xiang Cao. 2013. BodyAvatar: Creating Freeform 3D Avatars Using First-person Body Gestures. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 387--396.

Digital Library

[163]

Zhenpeng Zhao, Sriram Karthik Badam, Senthil Chandrasegaran, Deok Gun Park, Niklas L.E. Elmqvist, Lorraine Kisselburgh, and Karthik Ramani. 2014. skWiki: A Multimedia Sketching System for Collaborative Creativity. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1235--1244.

Digital Library

[164]

Clement Zheng, Ellen Yi-Luen Do, and Jim Budd. 2017. Joinery: Parametric Joint Generation for Laser Cut Assemblies. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition - C&C'17. ACM Press, Singapore, Singapore, 63--74.

Digital Library

Cited By

Wang YGong DXiao RWu XZhang H(2024)A Systematic Review on Extended Reality-Mediated Multi-User Social EngagementSystems10.3390/systems1210039612:10(396)Online publication date: 26-Sep-2024
https://doi.org/10.3390/systems12100396
Frich JDalsgaard PTaranu MMose Biskjaer M(2024)How Are Measures of Usability and Creativity Support Correlated?Proceedings of the European Conference on Cognitive Ergonomics 202410.1145/3673805.3673815(1-7)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3673805.3673815
Yu EChevalier FSingh KBousseau A(2024)3D-Layers: Bringing Layer-Based Color Editing to VR PaintingACM Transactions on Graphics10.1145/365818343:4(1-15)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658183
Show More Cited By

Index Terms

Evaluating Creativity Support Tools in HCI Research
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Quantifying the Creativity Support of Digital Tools through the Creativity Support Index

Creativity support tools help people engage creatively with the world, but measuring how well a tool supports creativity is challenging since creativity is ill-defined. To this end, we developed the Creativity Support Index (CSI), which is a psychometric ...
Understanding and evaluating creativity
C&C '09: Proceedings of the seventh ACM conference on Creativity and cognition

This tutorial presents different perspectives on creativity based on knowledge from research and practice. The aim is to provide an understanding of creativity and how to evaluate it in terms of the ways audiences respond, how we assess the creative ...
Enhancing the Creativity Process by Adding Context Awareness in Creativity Support Tools
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services

The existence of creativity support tools establishes creativity as part of the Computer Science research. Therefore, the development of computational methods for the enhancement of creativity is undoubtedly a challenge. In this paper we argue that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

July 2020

2264 pages

ISBN:9781450369749

DOI:10.1145/3357236

General Chairs:
Ron Wakkary
Simon Fraser University, CA and Eindhoven University of Technology, NL
,
Kristina Andersen
Eindhoven University of Technology, NL
,
Program Chairs:
Will Odom
Simon Fraser University, CA
,
Audrey Desjardins
University of Washington, USA
,
Marianne Graves Petersen
Aarhus University, DK

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 July 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

The Velux Foundations

Conference

DIS '20

Sponsor:

SIGCHI

DIS '20: Designing Interactive Systems Conference 2020

July 6 - 10, 2020

Eindhoven, Netherlands

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
1,739
Total Downloads

Downloads (Last 12 months)563
Downloads (Last 6 weeks)83

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang YGong DXiao RWu XZhang H(2024)A Systematic Review on Extended Reality-Mediated Multi-User Social EngagementSystems10.3390/systems1210039612:10(396)Online publication date: 26-Sep-2024
https://doi.org/10.3390/systems12100396
Frich JDalsgaard PTaranu MMose Biskjaer M(2024)How Are Measures of Usability and Creativity Support Correlated?Proceedings of the European Conference on Cognitive Ergonomics 202410.1145/3673805.3673815(1-7)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3673805.3673815
Yu EChevalier FSingh KBousseau A(2024)3D-Layers: Bringing Layer-Based Color Editing to VR PaintingACM Transactions on Graphics10.1145/365818343:4(1-15)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658183
Toka MFrost DBourgault SFarber AFriedman-Gerlicz CLee RPaek EWiley PJacobs J(2024)Practice-driven Software Development: A Collaborative Method for Digital Fabrication Systems Research in a Residency ProgramProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661522(1192-1217)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661522
Anderson BShah JKreminski M(2024)Homogenization Effects of Large Language Models on Human Creative IdeationProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656204(413-425)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656204
Hoffmann PWehbe RMühlhäuser MBarrera Machuca M(2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656191
Ning ZZhang ZBan JJiang KGan RTian YLi T(2024)MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on VideosProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656189(156-169)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656189
Anderson BShah JKreminski M(2024)Evaluating Creativity Support Tools via Homogenization AnalysisExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651088(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651088
Maiden NZachos KLockerbie JBrown ASteele SWolf A(2024)Designing digital tools for creative thinking: a case study from elite sports coachingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3637146(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3637146
Wadinambiarachchi SKelly RPareek SZhou QVelloso E(2024)The Effects of Generative AI on Design Fixation and Divergent ThinkingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642919(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642919
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents