research-article

Open access

BrickStARt: Enabling In-situ Design and Tangible Exploration for Personal Fabrication using Mixed Reality

Authors:

Evgeny Stemasov,

Maurice Cordts,

Jan GugenheimerAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 7, Issue ISS

Article No.: 429, Pages 64 - 92

https://doi.org/10.1145/3626465

Published: 01 November 2023 Publication History

Abstract

3D-printers enable end-users to design and fabricate unique physical artifacts but maintain an increased entry barrier and friction. End users must design tangible artifacts through intangible media away from the main problem space (ex-situ) and transfer spatial requirements to an abstract software environment. To allow users to evaluate dimensions, balance, or fit early and in-situ, we developed BrickStARt, a design tool using tangible construction blocks paired with a mixed-reality headset. Users assemble a physical block model at the envisioned location of the fabricated artifact. Designs can be tested tangibly, refined, and digitally post-processed, remaining continuously in-situ. We implemented BrickStARt using a Magic Leap headset and present walkthroughs, highlighting novel interactions for 3D-design. In a user study (n=16), first-time 3D-modelers succeeded more often using BrickStARt than Tinkercad. Our results suggest that BrickStARt provides an accessible and explorative process while facilitating quick, tangible design iterations that allow users to detect physics-related issues (e.g., clearance) early on.

Supplementary Material

Video (iss23main-p1728-p-video.mp4)

Pre-recorded presentation video.

Download
251.42 MB

Teaser (iss23main-p1728-p-teaser.mp4)

Preview video.

Download
56.23 MB

References

[1]

Muhammad Abdullah, Romeo Sommerfeld, Bjarne Sievers, Leonard Geier, Jonas Noack, Marcus Ding, Christoph Thieme, Laurenz Seidel, Lukas Fritzsche, Erik Langenhan, Oliver Adameck, Moritz Dzingel, Thomas Kern, Martin Taraz, Conrad Lempert, Shohei Katakura, Hany Mohsen Elhassany, Thijs Roumen, and Patrick Baudisch. 2022. HingeCore: Laser-Cut Foamcore for Fast Assembly. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22). Association for Computing Machinery, New York, NY, USA. 1–13. isbn:978-1-4503-9320-1 https://doi.org/10.1145/3526113.3545618

Digital Library

[2]

Harshit Agrawal, Udayan Umapathi, Robert Kovacs, Johannes Frohnhofen, Hsiang-Ting Chen, Stefanie Mueller, and Patrick Baudisch. 2015. Protopiper: Physically Sketching Room-Sized Objects at Actual Scale. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA. 427–436. isbn:978-1-4503-3779-3 https://doi.org/10.1145/2807442.2807505

Digital Library

[3]

Robert Aish and Peter Noakes. 1984. Architecture without Numbers — CAAD Based on a 3D Modelling System. Computer-Aided Design, 16, 6 (1984), Nov., 321–328. issn:0010-4485 https://doi.org/10.1016/0010-4485(84)90116-7

[4]

Celena Alcock, Nathaniel Hudson, and Parmit K. Chilana. 2016. Barriers to Using, Customizing, and Printing 3D Designs on Thingiverse. In Proceedings of the 19th International Conference on Supporting Group Work (GROUP ’16). ACM, New York, NY, USA. 195–199. isbn:978-1-4503-4276-6 https://doi.org/10.1145/2957276.2957301

Digital Library

[5]

David Anderson, James L. Frankel, Joe Marks, Aseem Agarwala, Paul Beardsley, Jessica Hodgins, Darren Leigh, Kathy Ryall, Eddie Sullivan, and Jonathan S. Yedidia. 2000. Tangible Interaction + Graphical Interpretation: A New Approach to 3D Modeling. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA. 393–402. isbn:978-1-58113-208-3 https://doi.org/10.1145/344779.344960

Digital Library

[6]

Daniel Ashbrook, Shitao Stan Guo, and Alan Lambie. 2016. Towards Augmented Fabrication: Combining Fabricated and Existing Objects. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16). ACM, New York, NY, USA. 1510–1518. isbn:978-1-4503-4082-3 https://doi.org/10.1145/2851581.2892509

Digital Library

[7]

Autodesk Inc. 2021. To Create Revolved Features | Inventor 2019 | Autodesk Knowledge Network. https://knowledge.autodesk.com/support/inventor/learn-explore/caas/CloudHelp/cloudhelp/2019/ENU/Inventor-Help/files/GUID-401BABD2-8D5B-4300-BA8D-70037445044F-htm.html

[8]

Autodesk Inc. 2022. Extrude Reference | Fusion 360 Help | Autodesk. https://help.autodesk.com/view/fusion360/ENU/?guid=SLD-REF-EXTRUDE

[9]

Patrick Baudisch and Stefanie Mueller. 2017. Personal Fabrication. Foundations and Trends® in Human– Computer Interaction, 10, 3– 4 (2017), May, 165–293. issn:1551-3955, 1551-3963 https://doi.org/10.1561/1100000055

[10]

Patrick Baudisch, Arthur Silber, Yannis Kommana, Milan Gruner, Ludwig Wall, Kevin Reuss, Lukas Heilman, Robert Kovacs, Daniel Rechlitz, and Thijs Roumen. 2019. Kyub: A 3D Editor for Modeling Sturdy Laser-Cut Objects. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, Glasgow, Scotland Uk. 1–12. isbn:978-1-4503-5970-2 https://doi.org/10.1145/3290605.3300796

Digital Library

[11]

Alexander Berman, Francis Quek, Robert Woodward, Osazuwa Okundaye, and Jeeeun Kim. 2020. ’Anyone Can Print’: Supporting Collaborations with 3D Printing Services to Empower Broader Participation in Personal Fabrication. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (NordiCHI ’20). Association for Computing Machinery, New York, NY, USA. 1–13. isbn:978-1-4503-7579-5 https://doi.org/10.1145/3419249.3420068

Digital Library

[12]

Srinjita Bhaduri, Quentin L Biddy, Jeffrey Bush, Abhijit Suresh, and Tamara Sumner. 2021. 3DnST: A Framework Towards Understanding Children’s Interaction with Tinkercad and Enhancing Spatial Thinking Skills. In Interaction Design and Children (IDC ’21). Association for Computing Machinery, New York, NY, USA. 257–267. isbn:978-1-4503-8452-0 https://doi.org/10.1145/3459990.3460717

Digital Library

[13]

John Brooke. 1996. SUS-A Quick and Dirty Usability Scale. Usability evaluation in industry, 189, 194 (1996), 4–7.

[14]

James E. Cutting and Peter M. Vishton. 1995. Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth. In Perception of Space and Motion, William Epstein and Sheena Rogers (Eds.). Academic Press, San Diego. 69–117. isbn:978-0-12-240530-3 https://doi.org/10.1016/B978-012240530-3/50005-5

[15]

Mustafa Doga Dogan, Patrick Baudisch, Hrvoje Benko, Michael Nebeling, Huaishu Peng, Valkyrie Savage, and Stefanie Mueller. 2022. Fabricate It or Render It? Digital Fabrication vs. Virtual Reality for Creating Objects Instantly. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA ’22). Association for Computing Machinery, New York, NY, USA. 1–4. isbn:978-1-4503-9156-6 https://doi.org/10.1145/3491101.3516510

Digital Library

[16]

Ilker Etikan, Sulaiman Abubakar Musa, and Rukayya Sunusi Alkassim. 2016. Comparison of Convenience Sampling and Purposive Sampling. American journal of theoretical and applied statistics, 5, 1 (2016), 1–4.

[17]

Sebastian S. Feger, Lars Semmler, Albrecht Schmidt, and Thomas Kosch. 2022. ElectronicsAR: Design and Evaluation of a Mobile and Tangible High-Fidelity Augmented Electronics Toolkit. Proceedings of the ACM on Human-Computer Interaction, 6, ISS (2022), Nov., 700–721. issn:2573-0142 https://doi.org/10.1145/3567740

Digital Library

[18]

Sean Follmer, David Carr, Emily Lovell, and Hiroshi Ishii. 2010. CopyCAD: Remixing Physical Objects with Copy and Paste from the Real World. In Adjunct Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST ’10). ACM, New York, NY, USA. 381–382. isbn:978-1-4503-0462-7 https://doi.org/10.1145/1866218.1866230

Digital Library

[19]

Sean Follmer and Hiroshi Ishii. 2012. KidCAD: Digitally Remixing Toys through Tangible Tools. In Proceedings of the 2012 SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY. 2401–2410. isbn:978-1-4503-1015-4 https://doi.org/10.1145/2207676.2208403

Digital Library

[20]

María-Elena García-Ruiz and Francisco-Javier Lena-Acebo. 2022. FabLabs: The Road to Distributed and Sustainable Technological Training through Digital Manufacturing. Sustainability, 14, 7 (2022), March, 3938. issn:2071-1050 https://doi.org/10.3390/su14073938

[21]

Constance Garnier and Ignasi Capdevila. 2021. Making, Hacking, Coding: Fablabs as Intermediary Platforms for Modes of Social Manufacturing:. Journal of Innovation Economics & Management, Prépublication, 0 (2021), Dec., I–XXII. issn:2032-5355 https://doi.org/10.3917/jie.pr1.0128

[22]

Neil Gershenfeld. 2005. Fab: The Coming Revolution on Your Desktop– from Personal Computers to Personal Fabrication. Basic Books (AZ), New York, NY, USA. isbn:978-0-465-02746-0

[23]

Neil Gershenfeld, Alan Gershenfeld, and Joel Cutcher-Gershenfeld. 2017. Designing Reality: How to Survive and Thrive in the Third Digital Revolution. Basic Books, Inc., USA. isbn:978-0-465-09347-2

Digital Library

[24]

Stéphane Ginier. 2022. Triplanar - Scene | Nomad Sculpt. https://nomadsculpt.com/manual/scene#triplanar

[25]

Leo Gombač, Klen Čopič Pucihar, Matjaž Kljun, Paul Coulton, and Jan Grbac. 2016. 3D Virtual Tracing and Depth Perception Problem on Mobile AR. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16). Association for Computing Machinery, New York, NY, USA. 1849–1856. isbn:978-1-4503-4082-3 https://doi.org/10.1145/2851581.2892412

Digital Library

[26]

Phillip Gough, Praneeth Bimsara Perera, Michael A. Kertesz, and Anusha Withana. 2023. Design, Mould, Grow!: A Fabrication Pipeline for Growing 3D Designs Using Myco-Materials. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA. 1–15. isbn:978-1-4503-9421-5 https://doi.org/10.1145/3544548.3580958

Digital Library

[27]

Emrecan Gulay and Andrés Lucero. 2019. Integrated Workflows: Generating Feedback Between Digital and Physical Realms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, Glasgow, Scotland Uk. 1–15. isbn:978-1-4503-5970-2 https://doi.org/10.1145/3290605.3300290

Digital Library

[28]

Sandra G. Hart. 2006. NASA-task Load Index (NASA-TLX); 20 Years Later. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 50, Sage Publications Sage CA: Los Angeles, CA, Los Angeles, California, USA. 904–908.

[29]

Florian Heller, Jan Thar, Dennis Lewandowski, Mirko Hartmann, Pierre Schoonbrood, Sophy Stönner, Simon Voelker, and Jan Borchers. 2018. CutCAD - An Open-source Tool to Design 3D Objects in 2D. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS ’18). Association for Computing Machinery, New York, NY, USA. 1135–1139. isbn:978-1-4503-5198-0 https://doi.org/10.1145/3196709.3196800

Digital Library

[30]

Gary T. Henry. 1990. Practical Sampling (Applied Social Research Methods, Vol. 21). SAGE Publications, Inc., London, UK. isbn:978-0-8039-2959-3

[31]

Eva Hornecker and Jacob Buur. 2006. Getting a Grip on Tangible Interaction: A Framework on Physical Space and Social Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’06). Association for Computing Machinery, New York, NY, USA. 437–446. isbn:978-1-59593-372-0 https://doi.org/10.1145/1124772.1124838

Digital Library

[32]

Yi-Jheng Huang, Kang-Yi Liu, Suiang-Shyan Lee, and I-Cheng Yeh. 2021. Evaluation of a Hybrid of Hand Gesture and Controller Inputs in Virtual Reality. International Journal of Human– Computer Interaction, 37, 2 (2021), Jan., 169–180. issn:1044-7318 https://doi.org/10.1080/10447318.2020.1809248

[33]

Nathaniel Hudson, Celena Alcock, and Parmit K. Chilana. 2016. Understanding Newcomers to 3D Printing: Motivations, Workflows, and Barriers of Casual Makers. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA. 384–396. isbn:978-1-4503-3362-7 https://doi.org/10.1145/2858036.2858266

Digital Library

[34]

Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 1999. Teddy: A Sketching Interface for 3D Freeform Design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’99). ACM Press/Addison-Wesley Publishing Co., USA. 409–416. isbn:978-0-201-48560-8 https://doi.org/10.1145/311535.311602

Digital Library

[35]

Hiroshi Ishii. 2008. Tangible Bits: Beyond Pixels. In Proceedings of the 2Nd International Conference on Tangible and Embedded Interaction (TEI ’08). ACM, New York, NY, USA. xv–xxv. isbn:978-1-60558-004-3 https://doi.org/10.1145/1347390.1347392

Digital Library

[36]

Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-Based Interaction: A Framework for Post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’08). Association for Computing Machinery, Florence, Italy. 201–210. isbn:978-1-60558-011-1 https://doi.org/10.1145/1357054.1357089

Digital Library

[37]

Yunwoo Jeong, Hyungjun Cho, Taewan Kim, and Tek-Jin Nam. 2023. AutomataStage: An AR-mediated Creativity Support Tool for Hands-on Multidisciplinary Learning. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA. 1–16. isbn:978-1-4503-9421-5 https://doi.org/10.1145/3544548.3581408

Digital Library

[38]

Michael D. Jones, Kevin Seppi, and Dan R. Olsen. 2016. What You Sculpt Is What You Get: Modeling Physical Interactive Devices with Clay and 3D Printed Widgets. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA. 876–886. isbn:978-1-4503-3362-7 https://doi.org/10.1145/2858036.2858493

Digital Library

[39]

Hiroki Kaimoto, Kyzyl Monteiro, Mehrad Faridan, Jiatong Li, Samin Farajian, Yasuaki Kakehi, Ken Nakagaki, and Ryo Suzuki. 2022. Sketched Reality: Sketching Bi-Directional Interactions Between Virtual and Physical Worlds with AR and Actuated Tangible UI. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22). Association for Computing Machinery, New York, NY, USA. 1–12. isbn:978-1-4503-9320-1 https://doi.org/10.1145/3526113.3545626

Digital Library

[40]

Jeeeun Kim, Anhong Guo, Tom Yeh, Scott E. Hudson, and Jennifer Mankoff. 2017. Understanding Uncertainty in Measurement and Accommodating Its Impact in 3D Modeling and Printing. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS ’17). ACM, New York, NY, USA. 1067–1078. isbn:978-1-4503-4922-2 https://doi.org/10.1145/3064663.3064690

Digital Library

[41]

Robert Kovacs, Lukas Rambold, Lukas Fritzsche, Dominik Meier, Jotaro Shigeyama, Shohei Katakura, Ran Zhang, and Patrick Baudisch. 2021. Trusscillator: A System for Fabricating Human-Scale Human-Powered Oscillating Devices. In The 34th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA. 1074–1088. isbn:978-1-4503-8635-7 https://doi.org/10.1145/3472749.3474807

Digital Library

[42]

Robert Kovacs, Anna Seufert, Ludwig Wall, Hsiang-Ting Chen, Florian Meinel, Willi Müller, Sijing You, Maximilian Brehm, Jonathan Striebel, Yannis Kommana, Alexander Popiak, Thomas Bläsius, and Patrick Baudisch. 2017. TrussFab: Fabricating Sturdy Large-Scale Structures on Desktop 3D Printers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, Denver, Colorado, USA. 2606–2616. isbn:978-1-4503-4655-9 https://doi.org/10.1145/3025453.3026016

Digital Library

[43]

Ben Lafreniere and Tovi Grossman. 2018. Blocks-to-CAD: A Cross-Application Bridge from Minecraft to 3D Modeling. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST ’18). Association for Computing Machinery, New York, NY, USA. 637–648. isbn:978-1-4503-5948-1 https://doi.org/10.1145/3242587.3242602

Digital Library

[44]

Manfred Lau, Greg Saul, Jun Mitani, and Takeo Igarashi. 2010. Modeling-in-Context: User Design of Complementary Objects with a Single Photo. In Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium (SBIM ’10). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland. 17–24. isbn:978-3-905674-25-5 http://dl.acm.org/citation.cfm?id=1923363.1923367

Digital Library

[45]

Danny Leen, Raf Ramakers, and Kris Luyten. 2017. StrutModeling: A Low-Fidelity Construction Kit to Iteratively Model, Test, and Adapt 3D Objects. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17). ACM, New York, NY, USA. 471–479. isbn:978-1-4503-4981-9 https://doi.org/10.1145/3126594.3126643

Digital Library

[46]

Maximilian Letter and Katrin Wolf. 2022. Tangible Version Control: Exploring a Physical Object’s Alternative Versions. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA ’22). Association for Computing Machinery, New York, NY, USA. 1–7. isbn:978-1-4503-9156-6 https://doi.org/10.1145/3491101.3519686

Digital Library

[47]

James R. Lewis. 1992. Psychometric Evaluation of the Post-Study System Usability Questionnaire: The PSSUQ. In Proceedings of the Human Factors Society Annual Meeting. 36, Sage Publications Sage CA: Los Angeles, CA, Washington, DC, USA. 1259–1260.

[48]

Changjian Li, Hao Pan, Adrien Bousseau, and Niloy J. Mitra. 2020. Sketch2CAD: Sequential CAD Modeling by Sketching in Context. ACM Transactions on Graphics, 39, 6 (2020), Nov., 164:1–164:14. issn:0730-0301 https://doi.org/10.1145/3414685.3417807

Digital Library

[49]

Chen Liang, Anhong Guo, and Jeeeun Kim. 2022. CustomizAR: Facilitating Interactive Exploration and Measurement of Adaptive 3D Designs. In Designing Interactive Systems Conference (DIS ’22). Association for Computing Machinery, New York, NY, USA. 898–912. isbn:978-1-4503-9358-4 https://doi.org/10.1145/3532106.3533561

Digital Library

[50]

Can Liu, Chenyue Dai, Qingzhou Ma, Brinda Mehra, and Alvaro Cassinelli. 2022. AngleCAD: Surface-Based 3D Modelling Techniques on Foldable Touchscreens. Proceedings of the ACM on Human-Computer Interaction, 6, ISS (2022), Nov., 582:592–582:616. https://doi.org/10.1145/3567735

Digital Library

[51]

Chandan Mahapatra, Jonas Kjeldmand Jensen, Michael McQuaid, and Daniel Ashbrook. 2019. Barriers to End-User Designers of Augmented Fabrication. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). ACM, New York, NY, USA. 383:1–383:15. isbn:978-1-4503-5970-2 https://doi.org/10.1145/3290605.3300613

Digital Library

[52]

James McCrae, Nobuyuki Umetani, and Karan Singh. 2014. FlatFitFab: Interactive Modeling with Planar Sections. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST ’14). ACM, New York, NY, USA. 13–22. isbn:978-1-4503-3069-5 https://doi.org/10.1145/2642918.2647388

Digital Library

[53]

Daniela Mitterberger. 2022. Augmented Human, Extended Machine: Extended Reality Systems for Robotic Fabrication in Architecture, Engineering, and Construction. XRDS: Crossroads, The ACM Magazine for Students, 29, 1 (2022), Oct., 48–53. issn:1528-4972 https://doi.org/10.1145/3558196

Digital Library

[54]

Daniela Mitterberger, Evgenia-Makrina Angelaki, Foteini Salveridou, Romana Rust, Lauren Vasey, Fabio Gramazio, and Matthias Kohler. 2023. Extended Reality Collaboration: Virtual and Mixed Reality System for Collaborative Design and Holographic-Assisted On-site Fabrication. In Towards Radical Regeneration, Christoph Gengnagel, Olivier Baverel, Giovanni Betti, Mariana Popescu, Mette Ramsgaard Thomsen, and Jan Wurm (Eds.). Springer International Publishing, Cham. 283–295. isbn:978-3-031-13249-0 https://doi.org/10.1007/978-3-031-13249-0_24

[55]

Daniela Mitterberger, Kathrin Dörfler, Timothy Sandy, Foteini Salveridou, Marco Hutter, Fabio Gramazio, and Matthias Kohler. 2020. Augmented Bricklaying. Construction Robotics, 4, 3 (2020), Dec., 151–161. issn:2509-8780 https://doi.org/10.1007/s41693-020-00035-8

[56]

Stefanie Mueller. 2017. 3D Printing for Human-computer Interaction. Interactions, 24, 5 (2017), Aug., 76–79. issn:1072-5520 https://doi.org/10.1145/3125399

Digital Library

[57]

Stefanie Mueller. 2018. Toward Direct Manipulation for Personal Fabrication. IEEE Pervasive Computing, 17, 1 (2018), Jan., 75–81. issn:1558-2590 https://doi.org/10.1109/MPRV.2018.011591064

Digital Library

[58]

Stefanie Mueller, Sangha Im, Serafima Gurevich, Alexander Teibrich, Lisa Pfisterer, François Guimbretière, and Patrick Baudisch. 2014. WirePrint: 3D Printed Previews for Fast Prototyping. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST ’14). ACM, New York, NY, USA. 273–280. isbn:978-1-4503-3069-5 https://doi.org/10.1145/2642918.2647359

Digital Library

[59]

Stefanie Mueller, Bastian Kruck, and Patrick Baudisch. 2013. LaserOrigami: Laser-Cutting 3D Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA. 2585–2592. isbn:978-1-4503-1899-0 https://doi.org/10.1145/2470654.2481358

Digital Library

[60]

Stefanie Mueller, Tobias Mohr, Kerstin Guenther, Johannes Frohnhofen, and Patrick Baudisch. 2014. faBrickation: Fast 3D Printing of Functional Objects by Integrating Construction Kit Building Blocks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA. 3827–3834. isbn:978-1-4503-2473-1 https://doi.org/10.1145/2556288.2557005

Digital Library

[61]

Benjamin Nuernberger, Eyal Ofek, Hrvoje Benko, and Andrew D. Wilson. 2016. SnapToReality: Aligning Augmented Reality to the Real World. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA. 1233–1244. isbn:978-1-4503-3362-7 https://doi.org/10.1145/2858036.2858250

Digital Library

[62]

Keunwoo Park, Conrad Lempert, Muhammad Abdullah, Shohei Katakura, Jotaro Shigeyama, Thijs Roumen, and Patrick Baudisch. 2022. FoolProofJoint: Reducing Assembly Errors of Laser Cut 3D Models by Means of Custom Joint Patterns. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA. 1–12. isbn:978-1-4503-9157-3 https://doi.org/10.1145/3491102.3501919

Digital Library

[63]

Huaishu Peng, Jimmy Briggs, Cheng-Yao Wang, Kevin Guo, Joseph Kider, Stefanie Mueller, Patrick Baudisch, and François Guimbretière. 2018. RoMA: Interactive Fabrication with Augmented Reality and a Robotic 3D Printer. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA. 579:1–579:12. isbn:978-1-4503-5620-6 https://doi.org/10.1145/3173574.3174153

Digital Library

[64]

Pixologic Inc. 2021. ShadowBox | ZBrush Docs. http://docs.pixologic.com/user-guide/3d-modeling/modeling-basics/creating-meshes/shadowbox/

[65]

Cecil Piya, Vinayak, Yunbo Zhang, and Karthik Ramani. 2016. RealFusion: An Interactive Workflow for Repurposing Real-World Objects towards Early-stage Creative Ideation. In Graphics Interface. 42, Canadian Human-Computer Communications Society - Société canadienne du dialogue humain-machine, Victoria, British Columbia, Canada. 8. isbn:978-0-9947868-1-4 https://doi.org/10.20380/GI2016.11

[66]

Raf Ramakers, Danny Leen, Jeeeun Kim, Kris Luyten, Steven Houben, and Tom Veuskens. 2023. Measurement Patterns: User-Oriented Strategies for Dealing with Measurements and Dimensions in Making Processes. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA. 1–17. isbn:978-1-4503-9421-5 https://doi.org/10.1145/3544548.3581157

Digital Library

[67]

Thierry Rayna and Ludmila Striukova. 2016. From Rapid Prototyping to Home Fabrication: How 3D Printing Is Changing Business Model Innovation. Technological Forecasting and Social Change, 102 (2016), Jan., 214–224. issn:0040-1625 https://doi.org/10.1016/j.techfore.2015.07.023

[68]

Patrick Reipschläger and Raimund Dachselt. 2019. DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (ISS ’19). Association for Computing Machinery, Daejeon, Republic of Korea. 29–41. isbn:978-1-4503-6891-9 https://doi.org/10.1145/3343055.3359718

Digital Library

[69]

Mitchel Resnick, John Maloney, Andrés Monroy-Hernández, Natalie Rusk, Evelyn Eastmond, Karen Brennan, Amon Millner, Eric Rosenbaum, Jay Silver, Brian Silverman, and Yasmin Kafai. 2009. Scratch: Programming for All. Commun. ACM, 52, 11 (2009), Nov., 60–67. issn:0001-0782 https://doi.org/10.1145/1592761.1592779

Digital Library

[70]

Carsten Rother, Vladimir Kolmogorov, and Andrew Blake. 2004. "GrabCut": Interactive Foreground Extraction Using Iterated Graph Cuts. In ACM SIGGRAPH 2004 Papers (SIGGRAPH ’04). Association for Computing Machinery, New York, NY, USA. 309–314. isbn:978-1-4503-7823-9 https://doi.org/10.1145/1186562.1015720

Digital Library

[71]

Thijs Jan Roumen, Willi Müller, and Patrick Baudisch. 2018. Grafter: Remixing 3D-Printed Machines. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA. 63:1–63:12. isbn:978-1-4503-5620-6 https://doi.org/10.1145/3173574.3173637

Digital Library

[72]

Calvin Rubens, Sean Braley, Julie Torpegaard, Nicklas Lind, Roel Vertegaal, and Timothy Merritt. 2020. Flying LEGO Bricks: Observations of Children Constructing and Playing with Programmable Matter. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, Sydney NSW Australia. 193–205. isbn:978-1-4503-6107-1 https://doi.org/10.1145/3374920.3374948

Digital Library

[73]

Greg Saul, Manfred Lau, Jun Mitani, and Takeo Igarashi. 2011. SketchChair: An All-in-one Chair Design System for End Users. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’11). ACM, New York, NY, USA. 73–80. isbn:978-1-4503-0478-8 https://doi.org/10.1145/1935701.1935717

Digital Library

[74]

Valkyrie Savage, Sean Follmer, Jingyi Li, and Björn Hartmann. 2015. Makers’ Marks: Physical Markup for Designing and Fabricating Functional Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA. 103–108. isbn:978-1-4503-3779-3 https://doi.org/10.1145/2807442.2807508

Digital Library

[75]

Stefan Schneegass, Alireza Sahami Shirazi, Tanja Döring, David Schmid, and Albrecht Schmidt. 2014. NatCut: An Interactive Tangible Editor for Physical Object Fabrication. In Proceedings of the Extended Abstracts of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI EA ’14). ACM, New York, NY, USA. 1441–1446. isbn:978-1-4503-2474-8 https://doi.org/10.1145/2559206.2581189

Digital Library

[76]

Rita Shewbridge, Amy Hurst, and Shaun K. Kane. 2014. Everyday Making: Identifying Future Uses for 3D Printing in the Home. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS ’14). ACM, New York, NY, USA. 815–824. isbn:978-1-4503-2902-6 https://doi.org/10.1145/2598510.2598544

Digital Library

[77]

Ben Shneiderman and Anne Rose. 1996. Social Impact Statements: Engaging Public Participation in Information Technology Design. In Proceedings of the Symposium on Computers and the Quality of Life (CQL ’96). Association for Computing Machinery, New York, NY, USA. 90–96. isbn:978-0-89791-827-5 https://doi.org/10.1145/238339.238378

Digital Library

[78]

Evgeny Stemasov. 2021. Enabling Ubiquitous Personal Fabrication by Deconstructing Established Notions of Artifact Modeling. In The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21). Association for Computing Machinery, New York, NY, USA. 166–170. isbn:978-1-4503-8655-5 https://doi.org/10.1145/3474349.3477589

Digital Library

[79]

Evgeny Stemasov, Alexander Botner, Enrico Rukzio, and Jan Gugenheimer. 2022. Ephemeral Fabrication: Exploring a Ubiquitous Fabrication Scenario of Low-Effort, In-Situ Creation of Short-Lived Physical Artifacts. In Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’22). ACM, New York, NY, USA. 1–17. https://doi.org/10.1145/3490149.3501331

Digital Library

[80]

Evgeny Stemasov, David Ledo, George Fitzmaurice, and Fraser Anderson. 2023. Immersive Sampling: Exploring Sampling for Future Creative Practices in Media-Rich, Immersive Spaces. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS ’23). Association for Computing Machinery, New York, NY, USA. 212–229. isbn:978-1-4503-9893-0 https://doi.org/10.1145/3563657.3596131

Digital Library

[81]

Evgeny Stemasov, Enrico Rukzio, and Jan Gugenheimer. 2021. The Road to Ubiquitous Personal Fabrication: Modeling-Free Instead of Increasingly Simple. IEEE Pervasive Computing, 20, 1 (2021), 1–9. https://doi.org/10.1109/MPRV.2020.3029650

[82]

Evgeny Stemasov, Tobias Wagner, Jan Gugenheimer, and Enrico Rukzio. 2020. Mix&Match: Towards Omitting Modelling Through In-situ Remixing of Model Repository Artifacts in Mixed Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). ACM, New York, NY, USA. 1–12. isbn:978-1-4503-6708-0 https://doi.org/10.1145/3313831.3376839

Digital Library

[83]

Evgeny Stemasov, Tobias Wagner, Jan Gugenheimer, and Enrico Rukzio. 2022. ShapeFindAR: Exploring In-Situ Spatial Search for Physical Artifact Retrieval Using Mixed Reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA. 1–12. isbn:978-1-4503-9157-3 https://doi.org/10.1145/3491102.3517682

Digital Library

[84]

Ryo Suzuki, Junichi Yamaoka, Daniel Leithinger, Tom Yeh, Mark D. Gross, Yoshihiro Kawahara, and Yasuaki Kakehi. 2018. Dynablock: Dynamic 3D Printing for Instant and Reconstructable Shape Formation. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST ’18). ACM, New York, NY, USA. 99–111. isbn:978-1-4503-5948-1 https://doi.org/10.1145/3242587.3242659

Digital Library

[85]

Haruki Takahashi and Jeeeun Kim. 2019. 3D Pen + 3D Printer: Exploring the Role of Humans and Fabrication Machines in Creative Making. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). ACM, New York, NY, USA. 295:1–295:12. isbn:978-1-4503-5970-2 https://doi.org/10.1145/3290605.3300525

Digital Library

[86]

Keiichiro Taniguchi and Tomoko Hashida. 2018. Rapid Prototyping System Using Transformable and Adherable PCL Blocks. In SIGGRAPH Asia 2018 Posters (SA ’18). ACM, New York, NY, USA. 50:1–50:2. isbn:978-1-4503-6063-0 https://doi.org/10.1145/3283289.3283308

Digital Library

[87]

George Tattersall, Dizhong Zhu, William A. P. Smith, Sebastian Deterding, and Patrik Huber. 2021. Reconstructing Creative Lego Models. In Computer Vision – ACCV 2020, Hiroshi Ishikawa, Cheng-Lin Liu, Tomas Pajdla, and Jianbo Shi (Eds.). 12622, Springer International Publishing, Cham. 55–70. isbn:978-3-030-69524-8 978-3-030-69525-5 https://doi.org/10.1007/978-3-030-69525-5_4

Digital Library

[88]

Udayan Umapathi, Hsiang-Ting Chen, Stefanie Mueller, Ludwig Wall, Anna Seufert, and Patrick Baudisch. 2015. LaserStacker: Fabricating 3D Objects by Laser Cutting and Welding. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA. 575–582. isbn:978-1-4503-3779-3 https://doi.org/10.1145/2807442.2807512

Digital Library

[89]

Tom Valkeneers, Danny Leen, Daniel Ashbrook, and Raf Ramakers. 2019. StackMold: Rapid Prototyping of Functional Multi-Material Objects with Selective Levels of Surface Details. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19). Association for Computing Machinery, New York, NY, USA. 687–699. isbn:978-1-4503-6816-2 https://doi.org/10.1145/3332165.3347915

Digital Library

[90]

Russell Wade, Nigel P. Garland, and Gary Underwood. 2017. Challenges of 3D Printing for Home Users. In 19th International Conference on Engineering and Product Design Education, A. Berg, E. Bohemia, L. Buck, T. Gulden, A. Kovacevic, and N. Pavel (Eds.). Design Society and IED, Oslo, Norway. 478–484. http://eprints.bournemouth.ac.uk/29947/

[91]

Ludwig Wilhelm Wall, Alec Jacobson, Daniel Vogel, and Oliver Schneider. 2021. Scrappy: Using Scrap Material as Infill to Make Fabrication More Sustainable. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA. 1–12. isbn:978-1-4503-8096-6 https://doi.org/10.1145/3411764.3445187

Digital Library

[92]

Christian Weichel, Jason Alexander, Abhijit Karnik, and Hans Gellersen. 2015. SPATA: Spatio-Tangible Tools for Fabrication-Aware Design. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’15). ACM, New York, NY, USA. 189–196. isbn:978-1-4503-3305-4 https://doi.org/10.1145/2677199.2680576

Digital Library

[93]

Christian Weichel, John Hardy, Jason Alexander, and Hans Gellersen. 2015. ReForm: Integrating Physical and Digital Design Through Bidirectional Fabrication. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA. 93–102. isbn:978-1-4503-3779-3 https://doi.org/10.1145/2807442.2807451

Digital Library

[94]

Christian Weichel, Manfred Lau, David Kim, Nicolas Villar, and Hans W. Gellersen. 2014. MixFab: A Mixed-reality Environment for Personal Fabrication. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA. 3855–3864. isbn:978-1-4503-2473-1 https://doi.org/10.1145/2556288.2557090

Digital Library

[95]

Michael Wessely, Theophanis Tsandilas, and Wendy E. Mackay. 2018. Shape-Aware Material: Interactive Fabrication with ShapeMe. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST ’18). ACM, New York, NY, USA. 127–139. isbn:978-1-4503-5948-1 https://doi.org/10.1145/3242587.3242619

Digital Library

[96]

Wikibooks. 2022. 2D to 3D Extrusion - OpenSCAD User Manual. https://en.wikibooks.org/wiki/OpenSCAD_User_Manual/2D_to_3D_Extrusion

[97]

Shanel Wu and Laura Devendorf. 2020. Unfabricate: Designing Smart Textiles for Disassembly. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA. 1–14. isbn:978-1-4503-6708-0 https://doi.org/10.1145/3313831.3376227

Digital Library

[98]

Tom Yeh and Jeeeun Kim. 2018. CraftML: 3D Modeling Is Web Programming. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). Association for Computing Machinery, Montreal QC, Canada. 1–12. isbn:978-1-4503-5620-6 https://doi.org/10.1145/3173574.3174101

Digital Library

[99]

Nur Yildirim, James McCann, and John Zimmerman. 2020. Digital Fabrication Tools at Work: Probing Professionals’ Current Needs and Desired Futures. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA. 1–13. isbn:978-1-4503-6708-0 https://doi.org/10.1145/3313831.3376621

Digital Library

[100]

Derek M. Yip-Hoi and Jeffrey L. Newcomer. 2011. Teaching CAD Modeling Using LEGO. In 2011 ASEE Annual Conference & Exposition. American Society for Engineering Education, Washington DC. 22.1374.1–22.1374.12. issn:2153-5965 https://peer.asee.org/teaching-cad-modeling-using-lego

[101]

Ya-Ting Yue, Xiaolong Zhang, Yongliang Yang, Gang Ren, Yi-King Choi, and Wenping Wang. 2017. WireDraw: 3D Wire Sculpturing Guided with Mixed Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA. 3693–3704. isbn:978-1-4503-4655-9 https://doi.org/10.1145/3025453.3025792

Digital Library

[102]

Kening Zhu, Alexandru Dancu, and Shengdong (Shen) Zhao. 2016. FusePrint: A DIY 2.5D Printing Technique Embracing Everyday Artifacts. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS ’16). ACM, New York, NY, USA. 146–157. isbn:978-1-4503-4031-1 https://doi.org/10.1145/2901790.2901792

Digital Library

Cited By

Stemasov EWagner TAskari AJanek JRajabi OSchikorr AFrommel JGugenheimer JRukzio E(2024)DungeonMaker: Embedding Tangible Creation and Destruction in Hybrid Board Games through Personal Fabrication TechnologyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642243(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642243
Stemasov EDemharter SRädler MGugenheimer JRukzio E(2024)pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642083(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642083

Index Terms

BrickStARt: Enabling In-situ Design and Tangible Exploration for Personal Fabrication using Mixed Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Touch-Space: Mixed Reality Game Space Based on Ubiquitous, Tangible, and Social Computing

This paper presents a novel computer entertainment system which recaptures human touch and physical interaction with the real-world environment as essential elements of the game play, whilst also maintaining the exciting fantasy features of traditional ...
Data Cubes in Hand: A Design Space of Tangible Cubes for Visualizing 3D Spatio-Temporal Data in Mixed Reality
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Tangible interfaces in mixed reality (MR) environments allow for intuitive data interactions. Tangible cubes, with their rich interaction affordances, high maneuverability, and stable structure, are particularly well-suited for exploring multi-...
Mixed Reality MIDI Keyboard Demonstration
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences

The Mixed Reality MIDI Keyboard is a prototype designed to augment virtual reality experiences through the inclusion of a physical interface which aligns the user's senses with the virtual environment. It also serves as a platform on which the uses of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue ISS

December 2023

482 pages

EISSN:2573-0142

DOI:10.1145/3554314

Editor:
Jeffrey Nichols
Apple, USA

Issue’s Table of Contents

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution 4.0 International License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2023

Published in PACMHCI Volume 7, Issue ISS

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
440
Total Downloads

Downloads (Last 12 months)440
Downloads (Last 6 weeks)27

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Stemasov EWagner TAskari AJanek JRajabi OSchikorr AFrommel JGugenheimer JRukzio E(2024)DungeonMaker: Embedding Tangible Creation and Destruction in Hybrid Board Games through Personal Fabrication TechnologyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642243(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642243
Stemasov EDemharter SRädler MGugenheimer JRukzio E(2024)pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642083(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642083

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents