research-article

GEM-NI: A System for Creating and Managing Alternatives In Generative Design

Authors:

Loutfouz Zaman,

Wolfgang Stuerzlinger,

Christian Neugebauer,

Maher Elkhaldi,

Naghmi Shireen,

Michael TerryAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Pages 1201 - 1210

https://doi.org/10.1145/2702123.2702398

Published: 18 April 2015 Publication History

Abstract

We present GEM-NI -- a graph-based generative-design tool that supports parallel exploration of alternative designs. Producing alternatives is a key feature of creative work, yet it is not strongly supported in most extant tools. GEM-NI enables various forms of exploration with alternatives such as parallel editing, recalling history, branching, merging, comparing, and Cartesian products of and for alternatives. Further, GEM-NI provides a modal graphical user interface and a design gallery, which both allow designers to control and manage their design exploration. We conducted an exploratory user study followed by in-depth one-on-one interviews with moderately and highly skills participants and obtained positive feedback for the system features, showing that GEM-NI supports creative design work well.

Supplementary Material

suppl.mov (pn1419-file3.m4v)

Supplemental video

Download
83.52 MB

MP4 File (p1201.mp4)

Download
191.85 MB

References

[1]

Akin, Ö. How do architects design? Artificial Intelligence and Pattern Recognition in Computer Aided Design, (1978), 65--103.

[2]

Akin, Ö. Variants in design cognition. Design knowing and learning: Cognition in design education, (2001), 105--124.

[3]

Bohnacker, H. Generative Design: Visualize, Program, and Create with Processing. Princeton Architectural Press, New York, 2012.

Digital Library

[4]

Bueno, C., Crossland, S., Lutteroth, C., and Weber, G. Rewriting History: More Power to Creative People. OzCHI 2011, 62--71.

Digital Library

[5]

Buxton, B. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan & Kaufmann, 2007.

Digital Library

[6]

Chen, H.-T., Wei, L.-Y., and Chang, C.-F. Nonlinear revision control for images. ACM SIGGRAPH 2011 papers, ACM (2011), 105:1--105:10.

Digital Library

[7]

Cherry, E. and Latulipe, C. Quantifying the Creativity Support of Digital Tools Through the Creativity Support Index. TOCHI 2014 21, 4 (2014), 21:1--21:25.

Digital Library

[8]

Chevalier, F., Dragicevic, P., Bezerianos, A., and Fekete, J.-D. Using text animated transitions to support navigation in document histories. CHI 2010, ACM (2010), 683--692.

Digital Library

[9]

Dow, S., Fortuna, J., Schwartz, D., Altringer, B., et al. Prototyping Dynamics: Sharing Multiple Designs Improves Exploration, Group Rapport, and Results. SIGCHI' 11, ACM (2011), 2807--2816.

Digital Library

[10]

Drucker, S.M., Petschnigg, G., and Agrawala, M. Comparing and managing multiple versions of slide presentations. UIST 2006, ACM (2006), 47--56.

Digital Library

[11]

Edwards, W.K., Igarashi, T., LaMarca, A., and Mynatt, E.D. A temporal model for multi-level undo and redo. UIST 2000, ACM (2000), 31--40.

Digital Library

[12]

Green, T.R. Cognitive dimensions of notations. People and Computers V, (1989), 443--460.

Digital Library

[13]

Grossman, T., Matejka, J., et al. Chronicle: capture, exploration, and playback of document workflow histories. UIST 2010, ACM (2010), 143--152.

Digital Library

[14]

Hartmann, B., Follmer, S., Ricciardi, A., Cardenas, T., and Klemmer, S.R. d.note: revising user interfaces through change tracking, annotations, and alternatives. CHI 2010, ACM (2010), 493--502.

Digital Library

[15]

Hartmann, B., Yu, L., Allison, A., Yang, Y., and Klemmer, S.R. Design as exploration: creating interface alternatives through parallel authoring and runtime tuning. UIST 2008, ACM (2008), 91--100.

Digital Library

[16]

Heer, J., Mackinlay, J., Stolte, C., and Agrawala, M. Graphical histories for visualization: supporting analysis, communication, and evaluation. TVCG 14, 6 (2008), 1189--1196.

Digital Library

[17]

Hsu, W. and Woon, I.M.Y. Current research in the conceptual design of mechanical products. ComputerAided Design 30, 5 (1998), 377--389.

[18]

Jankun-Kelly, T.J. and Ma, K.-L. A spreadsheet interface for visualization exploration. Visualization '00, IEEE Computer Society Press (2000), 69--76.

Digital Library

[19]

Klemmer, S.R., Thomsen, M., Phelps-Goodman, E., Lee, R., and Landay, J.A. Where do web sites come from?: Capturing and interacting with design history. CHI 2002, ACM (2002), 1--8.

Digital Library

[20]

Kurlander, D. and Feiner, S. A visual language for browsing, undoing, and redoing graphical interface commands. In Visual Languages and Visual Programming, 1990, 257--275.

[21]

Lunzer, A. and Hornbæk, K. Subjunctive Interfaces: Extending Applications to Support Parallel Setup, Viewing and Control of Alternative Scenarios. ACM TOCHI 14, 4 (2008), 17:1--17:44.

Digital Library

[22]

Ma, K.-L. Image graphs - a novel approach to visual data exploration. Visualization '99, (1999), 81--88.

Digital Library

[23]

Marks, J., et al. Design galleries: a general approach to setting parameters for computer graphics and animation. SIGGRAPH '97, ACM (1997), 389--400.

Digital Library

[24]

Menezes, A. and Lawson, B. How designers perceive sketches. Design Studies 27, 5 (2006), 571--585.

[25]

Newman, M.W. and Landay, J.A. Sitemaps, Storyboards, and Specifications: A Sketch of Web Site Design Practice. DIS 2000, ACM (2000), 263--274.

Digital Library

[26]

Sheikholeslami, M. You can get more than you make. 2011. http://summit.sfu.ca/item/9649.

[27]

Shneiderman, B. The eyes have it: a task by data type taxonomy for information visualizations. Visual Languages 1996, IEEE (1996), 336--343.

Digital Library

[28]

Simon, H.A. The sciences of the artificial. MIT press, 1996.

Digital Library

[29]

Smedt, T.D., Lechat, L., and Daelemans, W. Generative Art Inspired by Nature, Using NodeBox. In Applications of Evolutionary Computation. Springer Berlin Heidelberg, 2011, 264--272.

Digital Library

[30]

Smith, B.N., Xu, A., and Bailey, B.P. Improving interaction models for generating and managing alternative ideas during early design work. Graphics Interface 2010, (2010), 121--128.

Digital Library

[31]

Stephan, M. and Cordy, J.R. A survey of model comparison approaches and applications. Conference on Model-Driven Engineering and Software Development, (2013), 265--277.

[32]

Su, S.L. Visualizing, editing, and inferring structure in 2D graphics. Adjunct UIST 2007, ACM (2007), 29--32.

[33]

Su, S.L., Paris, S., Aliaga, F., Scull, C., Johnson, S., and Durand, F. Interactive Visual Histories for Vector Graphics. MIT, 2009.

[34]

Terry, M. and Mynatt, E.D. Recognizing creative needs in user interface design. Creativity and Cognition 2002, ACM (2002), 38--44.

Digital Library

[35]

Terry, M., Mynatt, E.D., Nakakoji, K., and Yamamoto, Y. Variation in element and action: supporting simultaneous development of alternative solutions. CHI 2004, ACM (2004), 711--718.

Digital Library

[36]

Wang, L., Shen, W., Xie, H., Neelamkavil, J., and Pardasani, A. Collaborative conceptual design-state of the art and future trends. Computer-Aided Design 34, 13 (2002), 981--996.

[37]

Woodbury, R. Elements of Parametric Design. Routledge, 2010.

[38]

Woodbury, R.F. and Burrow, A.L. Whither design space? Artif. Intell. Eng. Des. Anal. Manuf. 20, 2 (2006), 63--82.

Digital Library

[39]

Xu, K., Zhang, H., Cohen-Or, D., and Chen, B. Fit and diverse: set evolution for inspiring 3D shape galleries. ACM TOG, 31, 4, (2012), 57:1--57:10.

Digital Library

Cited By

Davis RWambsganss TJiang WKim KKäser TDillenbourg P(2024)Fashioning Creative Expertise with Generative AI: Graphical Interfaces for Design Space Exploration Better Support Ideation Than Text PromptsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642908(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642908
Wang SSu WChen STsai CMisztal MCheng KLin AChen YChen M(2024)RoomDreaming: Generative-AI Approach to Facilitating Iterative, Preliminary Interior Design ExplorationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642901(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642901
Almeda SZamfirescu-Pereira JKim KMani Rathnam PHartmann B(2024)Prompting for Discovery: Flexible Sense-Making for AI Art-Making with DreamsheetsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642858(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642858
Show More Cited By

Index Terms

GEM-NI: A System for Creating and Managing Alternatives In Generative Design
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Dream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

This paper presents Dream Lens, an interactive visual analysis tool for exploring and visualizing large-scale generative design datasets. Unlike traditional computer aided design, where users create a single model, with generative design, users specify ...
MACE: A New Interface for Comparing and Editing of Multiple Alternative Documents for Generative Design
DocEng '17: Proceedings of the 2017 ACM Symposium on Document Engineering

We present a new interface for interactive comparisons of more than two alternative documents in the context of a generative design system that uses generative data-flow networks defined via directed acyclic graphs. To better show differences between ...
GEM-NI+: Leveraging Difference Visualization and Multiple Displays for Supporting Multiple Complex Generative Design Alternatives
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

In the conceptual design phase, designers routinely generate dozens of alternatives based on a single idea. This is especially relevant in generative design where an algorithm can generate a large number of viable design options. While solutions for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

GRAND NCE
NSERC Discovery

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
825
Total Downloads

Downloads (Last 12 months)66
Downloads (Last 6 weeks)8

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Davis RWambsganss TJiang WKim KKäser TDillenbourg P(2024)Fashioning Creative Expertise with Generative AI: Graphical Interfaces for Design Space Exploration Better Support Ideation Than Text PromptsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642908(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642908
Wang SSu WChen STsai CMisztal MCheng KLin AChen YChen M(2024)RoomDreaming: Generative-AI Approach to Facilitating Iterative, Preliminary Interior Design ExplorationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642901(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642901
Almeda SZamfirescu-Pereira JKim KMani Rathnam PHartmann B(2024)Prompting for Discovery: Flexible Sense-Making for AI Art-Making with DreamsheetsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642858(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642858
Wang ZHuang YSong DMa LZhang T(2024)PromptCharm: Text-to-Image Generation through Multi-modal Prompting and RefinementProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642803(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642803
Choi DHong SPark JChung JKim J(2024)CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642794(1-25)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642794
Lin RRamesh RPandhare PTay KDutta PHartmann BMehta A(2024)Design Space Exploration for Board-level Circuits: Exploring Alternatives in Component-based DesignProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642009(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642009
Kim TLee YChang MKim J(2023)Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language ModelsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606833(1-18)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606833
Brade SWang BSousa MOore SGrossman T(2023)Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language ModelsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606725(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606725
Angert TSuzara MHan JPondoc CSubramonyam H(2023)Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language PromptsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606719(1-22)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606719
Rawn ELi JPaulos EChasins S(2023)Understanding Version Control as Material Interaction with QuickposeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581394(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581394
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents