research-article

Parallel prototyping leads to better design results, more divergence, and increased self-efficacy

Authors:

Scott R. KlemmerAuthors Info & Claims

ACM Transactions on Computer-Human Interaction (TOCHI), Volume 17, Issue 4

Article No.: 18, Pages 1 - 24

https://doi.org/10.1145/1879831.1879836

Published: 29 December 2010 Publication History

Get Access

Abstract

Iteration can help people improve ideas. It can also give rise to fixation, continuously refining one option without considering others. Does creating and receiving feedback on multiple prototypes in parallel, as opposed to serially, affect learning, self-efficacy, and design exploration? An experiment manipulated whether independent novice designers created graphic Web advertisements in parallel or in series. Serial participants received descriptive critique directly after each prototype. Parallel participants created multiple prototypes before receiving feedback. As measured by click-through data and expert ratings, ads created in the Parallel condition significantly outperformed those from the Serial condition. Moreover, independent raters found Parallel prototypes to be more diverse. Parallel participants also reported a larger increase in task-specific self-confidence. This article outlines a theoretical foundation for why parallel prototyping produces better design results and discusses the implications for design education.

References

[1]

Alexander, C., Ishikawa, S., and Silverstein, M. 1977. A Pattern Language: Towns, Buildings, Construction. Oxford University Press.

Google Scholar

[2]

Arkes, H. R. and Blumer, C. 1985. The psychology of sunk cost. Organiz. Behav. Hum. Decision Proc. 35, 124--140.

Crossref

Google Scholar

[3]

Ball, L. J., Evans, JStB, Dennis, I. D., and Ormerod, T. C. 1997. Problem-solving strategies and expertise in engineering design. Think. Reason. 3, 247.

Crossref

Google Scholar

[4]

Ball, L. J. and Ormerod, T. C. 1995. Structured and opportunistic processing in design: A critical discussion. Int. J. Hum.-Comput. Stud. 43, 131--151.

Digital Library

Google Scholar

[5]

Bandura, A. 1997. Self-Efficacy: The Exercise of Control 1st Ed. Worth Publishers.

Google Scholar

[6]

de Bono, E. 1999. Six Thinking Hats 2nd Ed. Back Bay Books.

Google Scholar

[7]

Boroditsky, L. 2007. Comparison and the development of knowledge. Cognition 102, 118--128.

Crossref

Google Scholar

[8]

Buxton, B. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann.

Digital Library

Google Scholar

[9]

Carson, S. H., Peterson, J. B., and Higgens, D. M. 2005. Reliability, validity, and factor structure of the creative achievement questionnaire. Creativity Resear. J. 17, 37--50.

Crossref

Google Scholar

[10]

Colhoun, J., Gentner, D., and Loewenstein, J. 2008. Learning abstract principles through principle-case comparison. In Proceedings of Cognitive Science Society. 1659--1664.

Google Scholar

[11]

Cross, N. 2006. Designerly Ways of Knowing 1st Ed. Springer.

Google Scholar

[12]

Cross, N. 2004. Expertise in design: An overview. Design Studies 25, 427--441.

Crossref

Google Scholar

[13]

Csikszentmihalyi, M. 1991. Flow: The Psychology of Optimal Experience. Harper Perennial.

Google Scholar

[14]

Dodgson, P. G. and Wood, J. V. 1998. Self-esteem and the cognitive accessibility of strengths and weaknesses after failure. J. Personality Social Psy. 75, :178--197.

Crossref

Google Scholar

[15]

Dorst, K. and Cross, N. 2001. Creativity in the design process: Co-evolution of problem-solution. Design Studies 22, 425--437.

Crossref

Google Scholar

[16]

Dow, S. P., Heddleston, K., and Klemmer, S. R. 2009. The efficacy of prototyping under time constraints. In Proceeding of the 7th ACM Conference on Creativity and Cognition. 165--174.

Digital Library

Google Scholar

[17]

Duncker, K. 1945. On Problem-Solving. Greenwood Press Reprint.

Google Scholar

[18]

Dweck, C. 2007. Mindset: The New Psychology of Success. Ballantine Books.

Google Scholar

[19]

Dym, C. L, Agogino, A. M., Frey, D. D., and Leifer, L. J. 2005. Engineering design thinking, teaching, and learning. J. Engin. Educ. 94, 103--120.

Crossref

Google Scholar

[20]

Fredrickson, B. L. 2001. The role of positive emotions in positive psychology: The broaden-and-build theory of positive emotions. American Psych. 56, 218--226.

Crossref

Google Scholar

[21]

Gentner, D., Loewenstein, J., and Thompson, L. 2003. Learning and transfer: A general role for analogical encoding. J. Educ. Psych. 95, 408, 393.

Crossref

Google Scholar

[22]

Gentner, D. and Markman, A. B. 1997. Structure mapping in analogy and similarity. Amer. Psych. 52, 45--56.

Crossref

Google Scholar

[23]

Gick, M. L. and Keith J. H. 1983. Schema induction and analogical transfer. Cognitive Psych. 15, 1--38.

Crossref

Google Scholar

[24]

Goel, V. and Pirolli, P. 1992. The structure of design problem spaces. Cognitive Science 16, 395--429.

Crossref

Google Scholar

[25]

Gopnik, A., Meltzoff, A. N., and Kuhl, P. K. 2001. The Scientist in the Crib: What Early Learning Tells Us About the Mind. Harper Paperbacks.

Google Scholar

[26]

Granville, V., Krivánek, M., and Rasson, J. P. 1994. Simulated annealing: A proof of convergence. IEEE Trans. Patt. Anal. Mach. Intell. 16, 652--656.

Digital Library

Google Scholar

[27]

Hall, T. S. 2008. Improving self-efficacy in problem solving: Learning from errors and feedback. PhD thesis, University of North Carolina, Greensboro.

Google Scholar

[28]

Hartmann, B., Klemmer, S. R., Bernstein, M., Abdulla, L., Burr, B., Robinson-Mosher, and Gee, J. 2006. ‘Reflective physical prototyping through integrated design, test, and analysis. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology. ACM, 299--308.

Digital Library

Google Scholar

[29]

Herring, S. R., Chang, C.-C., Krantzler, J., and Balley, B. P. 2009. Getting inspired&excl;: Understanding how and why examples are used in creative design practice. In Proceedings of the 27th International Conference on Human Factors in Computing Systems. ACM, 87--96.

Digital Library

Google Scholar

[30]

Janis, I. L. 1982. Groupthink: Psychological Studies of Policy Decisions and Fiascoes 2nd Ed. Wadsworth Publishing.

Google Scholar

[31]

Jansson, D. and Smith, S. 1991. Design fixation. Design Studies 12, 3--11.

Crossref

Google Scholar

[32]

Kelley, T. 2002. The Art of Innovation. Broadway Business Books.

Google Scholar

[33]

Kershaw, T. C. and Ohlsson, S. 2004. Multiple causes of difficulty in insight: The case of the nine-dot problem. J. Exper. Psych.; Learn., Memory, Cognition 30, 3--13.

Crossref

Google Scholar

[34]

Kolodner, J. 1993. Case-Based Reasoning. Morgan Kaufmann.

Digital Library

Google Scholar

[35]

Kosara, R. 2007. Visualization criticism—the missing link between information visualization and art. In Proceedings of the Conference on Information Visualization. IEEE Computer Society, 631--636.

Digital Library

Google Scholar

[36]

Landis, J. R. and Koch, G. G. 1977. The measurement of observer agreement for categorical data. Biometrics 33, 159--174.

Crossref

Google Scholar

[37]

Laseau, P. 1988. Graphic Thinking for Architects and Designers 2nd Ed. John Wiley & Sons Inc.

Google Scholar

[38]

Lee, B., Srivastava, S., Kumar, R., Brafman, R., and Klemmer, S. R. 2000. Designing with interactive example galleries. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems.

Digital Library

Google Scholar

[39]

Mele, A. R. 2005. Motivation and Agency. Oxford University Press.

Google Scholar

[40]

Newell, A. 1972. Human Problem Solving. Prentice Hall.

Digital Library

Google Scholar

[41]

Nielsen, J. and Faber, J. M. 1996. Improving system usability through parallel design. Computer 29, 29--35.

Digital Library

Google Scholar

[42]

Osborn, A. F. 1963. Applied Imagination: Principles and Procedures of Creative Problem Solving. Charles Scribner’s Sons.

Google Scholar

[43]

Piaget, J. 2001. The Psychology of Intelligence. Routledge.

Google Scholar

[44]

Rittel, H. and Webber, M. 1973. Dilemmas in a general theory of planning. Policy Sci. 4, 169, 155.

Crossref

Google Scholar

[45]

Schmidt, R. A., Young, D. E., Swinnen, S., and Shapiro, D. C. 1989. Summary knowledge of results for skill acquisition: Support for the guidance hypothesis. J. Exper. Psych.: Learn., Memory, Cognition 15, 352--359.

Crossref

Google Scholar

[46]

Schon, D. A. 1990. Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions 1st Ed. Jossey-Bass.

Google Scholar

[47]

Schon, D. A. 1995. The Reflective Practitioner: How Professionals Think in Action. Ashgate Publishing.

Google Scholar

[48]

Schooler, L. J., and Anderson, J. R. 1990. The disruptive potential of immediate feedback. In Proceedings of the 12th Annual Conference of the Cognitive Science Society.

Google Scholar

[49]

Schrage, M. 1999. Serious Play: How the World's Best Companies Simulate to Innovate. Harvard Business School Press.

Google Scholar

[50]

Shrout, P. E. and Fleiss, J. L. 1979. Intraclass correlations: Uses in assessing rater reliability. Psych. Bull. 86, 420--428.

Crossref

Google Scholar

[51]

Simon, H. A. 1996. The Sciences of the Artificial 3rd Ed. The MIT Press.

Digital Library

Google Scholar

[52]

Smith, S., Kohn, N., and Shah, J. 2008. What you see is what you get: Effects of provocative stimuli on creative invention. In Proceedings of the NSF International Workshop on Studying Design Creativity.

Google Scholar

[53]

Sterne, J. 2002. Web Metrics: Proven Methods for Measuring Web Site Success 1st Ed. Wiley.

Digital Library

Google Scholar

[54]

Thompson, L., Gentner, D., and Loewenstein, J. 2000. Avoiding missed opportunities in managerial life: Analogical training more powerful than individual case training. Organiz. Behav. Hum. Decision Process. 82, 60--75.

Crossref

Google Scholar

[55]

Tohidi, M., Buxton, W., Baecker, R., and Sellen, A. 2006. Getting the right design and the design right. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1243--1252.

Digital Library

Google Scholar

[56]

Torrance, E. P. 1974. Torrance Tests of Creative Thinking. Personnel Press, Ginn and Co., Xerox Education Co.

Google Scholar

Cited By

View all

Asgari MHurtut T(2024)A Design Language for Prototyping and Storyboarding Data-Driven StoriesApplied Sciences10.3390/app1404138714:4(1387)Online publication date: 8-Feb-2024
https://doi.org/10.3390/app14041387
Bartlett KYoung ACamba J(2024)Semiautomatic Exploration of Conceptual Design Spaces through Parametric Shape Variability and Additive ManufacturingJournal of Integrated Design and Process Science10.3233/JID-240033(1-15)Online publication date: 26-Aug-2024
https://doi.org/10.3233/JID-240033
Yen YE JJin HLi MLin GPan IDow S(2024)ProcessGallery: Contrasting Early and Late Iterations for Design Principle LearningProceedings of the ACM on Human-Computer Interaction10.1145/36373898:CSCW1(1-35)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637389
Show More Cited By

Index Terms

Parallel prototyping leads to better design results, more divergence, and increased self-efficacy

Recommendations

The effects of DTAI on nursing skills and self-efficacy

This research is to evaluate the effects of Digital Technology Assisted Instruction (DTAI) applied in the Physical-Examining (PE) skill courses for nursing students. Both a "Learning Satisfaction with DTAI" survey and a "Self-efficacy" survey for these ...
Computers, self-efficacy, and primary children
Pre-service teachers' self-efficacy perceptions on Web Pedagogical Content Knowledge

21st century classrooms call for teachers to integrate technology into their instructional practices. This requires the ability and willingness to combine technological, pedagogical and content knowledge. The main purpose of this study is to investigate ...

Reviews

Reviewer: Alyx Macfadyen

This paper is essentially about designing visual material for persuasive advertising. The processes of iteration and prototyping are at the heart of software and systems engineering and design. As such, they seem somewhat out of context for producing advertising material designed to convince consumers to buy a product or service. Several hypotheses underpin this study, and are perhaps reasonable even when applied to this somewhat lightweight study. Click-through analytics, for example, are the stated and accepted metric for better design results, but it remains contentious to deploy them as the sole measure for "higher quality design." The authors cite research in cognitive studies, motivation, and user agency as validating factors for their study. Nevertheless, it is important to point out that the purpose of the works cited was to improve user experience rather than to influence the purchase of a product or service. The results of this study suggest that prototyping and iteration did return positive results. This is true, however, of all mentoring, testing, and extra time taken in the design process. The sequence of methods reported is certainly interesting, and those methods that support the confidence and self-efficacy of learners are important for success in industry. Design skills for Web portals, system interfaces, and online decision support systems, as well as in professional practices, are crucial for usability. I would like to have seen more focus here on design teaching that places an emphasis on contributing to the service and supporting its users and purpose. Targeted consumers quickly learn to recognize and avoid advertisements. Thus, designers must continue to develop new methods, ploys, and tricks to ensure that they obtain the click-throughs that are the measure of design success. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 17, Issue 4

December 2010

149 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/1879831

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 December 2010

Accepted: 01 August 2010

Revised: 01 August 2010

Received: 01 May 2010

Published in TOCHI Volume 17, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

228
Total Citations
View Citations
4,353
Total Downloads

Downloads (Last 12 months)456
Downloads (Last 6 weeks)71

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Asgari MHurtut T(2024)A Design Language for Prototyping and Storyboarding Data-Driven StoriesApplied Sciences10.3390/app1404138714:4(1387)Online publication date: 8-Feb-2024
https://doi.org/10.3390/app14041387
Bartlett KYoung ACamba J(2024)Semiautomatic Exploration of Conceptual Design Spaces through Parametric Shape Variability and Additive ManufacturingJournal of Integrated Design and Process Science10.3233/JID-240033(1-15)Online publication date: 26-Aug-2024
https://doi.org/10.3233/JID-240033
Yen YE JJin HLi MLin GPan IDow S(2024)ProcessGallery: Contrasting Early and Late Iterations for Design Principle LearningProceedings of the ACM on Human-Computer Interaction10.1145/36373898:CSCW1(1-35)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637389
Wan QHu SZhang YWang PWen BLu Z(2024)"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language ModelsProceedings of the ACM on Human-Computer Interaction10.1145/36373618:CSCW1(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637361
E JYen YPan ILin GLi MJin HChen MXia HDow S(2024)When to Give Feedback: Exploring Tradeoffs in the Timing of Design FeedbackProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656183(292-310)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656183
Nouraei FSiu ARossi RLipka N(2024)Thinking Outside the Box: Non-Designer Perspectives and Recommendations for Template-Based Graphic Design ToolsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650967(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650967
Ha JJeon HHan DSeo JOh C(2024)CloChat: Understanding How People Customize, Interact, and Experience Personas in Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642472(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642472
Suh SChen MMin BLi TXia H(2024)Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-CreationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642400(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642400
Reza MLaundry NMusabirov IDushniku PYu ZMittal KGrossman TLiut MKuzminykh AWilliams J(2024)ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641899(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641899
Trelles JWentzel ABerrios WShatkay HMarai G(2024)BI‐LAVA: Biocuration With Hierarchical Image Labelling Through Active Learning and Visual AnalyticsComputer Graphics Forum10.1111/cgf.15261Online publication date: Oct-2024
https://doi.org/10.1111/cgf.15261
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

The effects of DTAI on nursing skills and self-efficacy

Computers, self-efficacy, and primary children

Pre-service teachers' self-efficacy perceptions on Web Pedagogical Content Knowledge

Reviews

Access critical reviews of Computing literature here