poster

Open access

GeneratiVR: Spatial Interactions in Virtual Reality to Explore Generative Design Spaces

Authors:

Nicholas Jennings,

Bjoern HartmannAuthors Info & Claims

CHI EA '22: CHI Conference on Human Factors in Computing Systems Extended Abstracts

Article No.: 366, Pages 1 - 6

https://doi.org/10.1145/3491101.3519616

Published: 28 April 2022 Publication History

All formats PDF

Abstract

Computational design tools can automatically generate large quantities of viable designs for a given design problem. This raises the challenge of how to enable designers to efficiently and effectively evaluate and select preferred designs from a large set of alternatives. In GeneratiVR, we present two novel interaction techniques to address this challenge, by leveraging Virtual Reality for rich, spatial user input. With these interaction methods, users can directly manipulate designs or demonstrate desired design functionality. The interactions allow users to rapidly filter through an expansive design space to specify or find their preferred designs.

Supplementary Material

MP4 File (3491101.3519616-video-preview.mp4)

Video Preview

Download
43.48 MB

MP4 File (3491101.3519616-talk-video.mp4)

Talk Video

Download
198.90 MB

References

[1]

Carl Anderson, Carlo Bailey, Andrew Heumann, and Daniel Davis. 2018. Augmented Space Planning: Using Procedural Generation to Automate Desk Layouts. International Journal of Architectural Computing 16, 2 (June 2018), 164–177. https://doi.org/10.1177/1478077118778586

[2]

Fan Bao, Dong-Ming Yan, Niloy J. Mitra, and Peter Wonka. 2013. Generating and Exploring Good Building Layouts. ACM Transactions on Graphics 32, 4 (July 2013), 122:1–122:10. https://doi.org/10.1145/2461912.2461977

Digital Library

[3]

Xiang ’Anthony’ Chen, Ye Tao, Guanyun Wang, Runchang Kang, Tovi Grossman, Stelian Coros, and Scott E. Hudson. 2018. Forte: User-Driven Generative Design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.

Digital Library

[4]

Halil Erhan, Ivy Y. Wang, and Naghmi Shireen. 2014. Interacting with Thousands: A Parametric-Space Exploration Method in Generative Design. In ACADIA 14: Design Agency [Proceedings of the 34th Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA)] (Los Angeles, CA, USA). ACADIA/ Riverside Architectural Press, Cambridge, ON, Canada, 619–626. https://doi.org/10.13140/RG.2.1.4223.2167

[5]

Halil Erhan, Ivy Y. Wang, and Naghmi Shireen. 2015. Harnessing Design Space: A Similarity-Based Exploration Method for Generative Design. International Journal of Architectural Computing 13, 2 (June 2015), 217–236. https://doi.org/10.1260/1478-0771.13.2.217

[6]

Manolya Kavakli, Meredith Taylor, and Anatoly Trapeznikov. 2007. Designing in Virtual Reality (DesIRe): A Gesture-Based Interface. In Proceedings of the 2nd International Conference on Digital Interactive Media in Entertainment and Arts(DIMEA ’07). Association for Computing Machinery, New York, NY, USA, 131–136. https://doi.org/10.1145/1306813.1306842

Digital Library

[7]

Rubaiat Habib Kazi, Tovi Grossman, Hyunmin Cheong, Ali Hashemi, and George Fitzmaurice. 2017. DreamSketch: Early Stage 3D Design Explorations with Sketching and Generative Design. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology(UIST ’17). Association for Computing Machinery, New York, NY, USA, 401–414. https://doi.org/10.1145/3126594.3126662

Digital Library

[8]

Mohammad Keshavarzi, Ardavan Bidgoli, and Hans Kellner. 2020. V-Dream: Immersive Exploration of Generative Design Solution Space. In HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence(Lecture Notes in Computer Science), Constantine Stephanidis, Masaaki Kurosu, Helmut Degen, and Lauren Reinerman-Jones (Eds.). Springer International Publishing, Cham, 477–494. https://doi.org/10.1007/978-3-030-60117-1_35

[9]

Sivam Krish. 2011. A Practical Generative Design Method. Computer-Aided Design 43, 1 (Jan. 2011), 88–100. https://doi.org/10.1016/j.cad.2010.09.009

Digital Library

[10]

Manfred Lau, Masaki Hirose, Akira Ohgawara, Jun Mitani, and Takeo Igarashi. 2012. Situated Modeling: A Shape-Stamping Interface with Tangible Primitives. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction(TEI ’12). Association for Computing Machinery, New York, NY, USA, 275–282. https://doi.org/10.1145/2148131.2148190

Digital Library

[11]

J. Marks, B. Andalman, P. A. Beardsley, W. Freeman, S. Gibson, J. Hodgins, T. Kang, B. Mirtich, H. Pfister, W. Ruml, K. Ryall, J. Seims, and S. Shieber. 1997. Design Galleries: A General Approach to Setting Parameters for Computer Graphics and Animation. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., USA, 389–400. https://doi.org/10.1145/258734.258887

Digital Library

[12]

Justin Matejka, Michael Glueck, Erin Bradner, Ali Hashemi, Tovi Grossman, and George Fitzmaurice. 2018. Dream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173943

Digital Library

[13]

Arefin Mohiuddin and Robert Woodbury. 2020. Interactive Parallel Coordinates for Parametric Design Space Exploration. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3334480.3383101

[14]

Danil Nagy, Damon Lau, John Locke, Jim Stoddart, Lorenzo Villaggi, Ray Wang, Dale Zhao, and David Benjamin. 2017. Project Discover: An Application of Generative Design for Architectural Space Planning. In Proceedings of the Symposium on Simulation for Architecture and Urban Design(SIMAUD ’17). Society for Computer Simulation International, San Diego, CA, USA, 1–8.

[15]

Adriana Schulz, Harrison Wang, Eitan Grinspun, Justin Solomon, and Wojciech Matusik. 2018. Interactive Exploration of Design Trade-Offs. ACM Transactions on Graphics 37, 4 (July 2018), 131:1–131:14. https://doi.org/10.1145/3197517.3201385

Digital Library

[16]

Adriana Schulz, Jie Xu, Bo Zhu, Changxi Zheng, Eitan Grinspun, and Wojciech Matusik. 2017. Interactive Design Space Exploration and Optimization for CAD Models. ACM Transactions on Graphics 36, 4 (July 2017), 157:1–157:14. https://doi.org/10.1145/3072959.3073688

Digital Library

[17]

Maria Shugrina, Ariel Shamir, and Wojciech Matusik. 2015. Fab forms: Customizable objects for fabrication with validity and geometry caching. ACM Transactions on Graphics (TOG) 34, 4 (2015), 1–12. https://doi.org/10.1145/27669

Digital Library

[18]

Noah Tovares, Peter Boatwright, and Jonathan Cagan. 2014. Experiential Conjoint Analysis: An Experience-Based Method for Eliciting, Capturing, and Modeling Consumer Preference. Journal of Mechanical Design 136, 10 (July 2014), 101404. https://doi.org/10.1115/1.4027985

[19]

Josh Urban Davis, Fraser Anderson, Merten Stroetzel, Tovi Grossman, and George Fitzmaurice. 2021. Designing Co-Creative AI for Virtual Environments. In Creativity and Cognition. Association for Computing Machinery, New York, NY, USA, Article 26, 11 pages.

[20]

Peng Wang, Shusheng Zhang, Mark Billinghurst, Xiaoliang Bai, Weiping He, Shuxia Wang, Mengmeng Sun, and Xu Zhang. 2020. A Comprehensive Survey of AR/MR-Based Co-Design in Manufacturing. Engineering with Computers 36, 4 (Oct. 2020), 1715–1738. https://doi.org/10.1007/s00366-019-00792-3

Digital Library

[21]

Loutfouz Zaman, Wolfgang Stuerzlinger, Christian Neugebauer, Rob Woodbury, Maher Elkhaldi, Naghmi Shireen, and Michael Terry. 2015. GEM-NI: A System for Creating and Managing Alternatives In Generative Design. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 1201–1210. https://doi.org/10.1145/2702123.2702398

Digital Library

Cited By

Drogemuller AMatthews BCunningham AYu RGu NThomas B(2024)Hey Building! Novel Interfaces for Parametric Design Manipulations in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981408:ISS(330-355)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698140
Liu PKitson APicard-Deland CCarr MLiu SLc RZhu-Tian C(2024)Virtual Dream Reliving: Exploring Generative AI in Immersive Environment for Dream Re-experiencingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3644054(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3644054
Stemasov EDemharter SRädler MGugenheimer JRukzio E(2024)pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642083(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642083
Show More Cited By

Recommendations

Experiencing 3D interactions in virtual reality and augmented reality
EUSAI '04: Proceedings of the 2nd European Union symposium on Ambient intelligence

We demonstrate basic 2D and 3D interactions in both a Virtual Reality (VR) system, called the Personal Space Station, and an Augmented Reality (AR) system, called the Visual Interaction Platform. Since both platforms use identical (optical) tracking ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
A Pilot Study Comparing User Interactions Between Augmented and Virtual Reality
Advances in Visual Computing
Abstract
Immersive Analytics (IA) and consumer adoption of augmented reality (AR) and virtual reality (VR) head-mounted displays (HMDs) are both rapidly growing. When used in conjunction, stereoscopic IA environments can offer improved user understanding ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

3066 pages

ISBN:9781450391566

DOI:10.1145/3491101

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
1,148
Total Downloads

Downloads (Last 12 months)340
Downloads (Last 6 weeks)77

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Drogemuller AMatthews BCunningham AYu RGu NThomas B(2024)Hey Building! Novel Interfaces for Parametric Design Manipulations in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981408:ISS(330-355)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698140
Liu PKitson APicard-Deland CCarr MLiu SLc RZhu-Tian C(2024)Virtual Dream Reliving: Exploring Generative AI in Immersive Environment for Dream Re-experiencingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3644054(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3644054
Stemasov EDemharter SRädler MGugenheimer JRukzio E(2024)pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642083(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642083
Lin RRamesh RPandhare PTay KDutta PHartmann BMehta A(2024)Design Space Exploration for Board-level Circuits: Exploring Alternatives in Component-based DesignProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642009(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642009
Drogemuller ASakhaei HCunningham AYu RGu NThomas B(2023)Envisioning Paramersive Design: An Immersive Approach to Architectural Design and Review2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00060(261-265)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00060

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents