Get Your Hands Dirty? A Comparative Study of Tool Usage and Perceptual Engagement in Physical and Digital Sculpting
Authors: 
Xinyu Ma, Zhe Yan, Hengyu Meng, Zhihao Cao, Yanan Jin, 
Zeyu WangAuthors Info & Claims
Pages 358 - 373
Abstract
The creation of 3D content, crucial in various applications, is often challenging and time-intensive. While digital tools are prevalent for 3D content creation, traditional clay sculpting offers an embodied experience that fosters artists’ perceptual engagement with physical space, enhancing their interactive and cognitive connection with the creation process. We conducted an eight-day live sculpting session at an art academy, systematically comparing the creative workflows of eight professional artists in both physical and digital mediums. Our qualitative and quantitative analysis include artists’ differences in tool usage between physical and digital sculpting, variations in visual and tactile perceptual engagement, and the potential for future integration of the two modalities. Our study provides insights into the benefits of physical and digital sculpting and may inform future design of hybrid interfaces for 3D content creation.
Supplemental Material
MOV File
Supplymentary video - short version
- Download
- 261.63 MB
References
[1]
Inc. 3D Systems. 2023. Haptic Devices. https://www.3dsystems.com/scanners-haptics
[2]
Botirov Muhammadjon Abdikodirovich. 2022. Methodology of Getting a Human Body in Sculpture. International Journal of Development and Public Policy 2, 5 (Jun. 2022), 160–163. https://openaccessjournals.eu/index.php/ijdpp/article/view/1382
[3]
Adobe. 2023. Medium by Adobe. https://www.adobe.com/ca/products/medium.html
[4]
Rudolf Arnheim. 1954. Art and Visual Perception: A Psychology of the Creative Eye. Univ of California Press.
[5]
Rudolf Arnheim. 1954. Art and Visual Perception: A Psychology of the Creative Eye. University of California Press.
[6]
Autodesk. 2023. Autodesk Maya. https://www.autodesk.com/products/maya
[7]
Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2008. ILoveSketch: As-Natural-as-Possible Sketching System for Creating 3d Curve Models. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (Monterey, CA, USA) (UIST ’08). Association for Computing Machinery, New York, NY, USA, 151–160. https://doi.org/10.1145/1449715.1449740
[8]
Olav W. Bertelsen, Morten Breinbjerg, and Søren Pold. 2007. Instrumentness for Creativity Mediation, Materiality & Metonymy. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition (Washington, DC, USA) (C&C ’07). Association for Computing Machinery, New York, NY, USA, 233–242. https://doi.org/10.1145/1254960.1254992
[9]
P.J. Besl and Neil D. McKay. 1992. A Method for Registration of 3-D Shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2 (1992), 239–256. https://doi.org/10.1109/34.121791
[10]
Blender. 2023. Blender. https://www.blender.org
[11]
George B. Bridgman. 1973. Constructive Anatomy. Dover Publications.
[12]
W. Buxton and B. Myers. 1986. A Study in Two-Handed Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’86). Association for Computing Machinery, New York, NY, USA, 321–326. https://doi.org/10.1145/22627.22390
[13]
Edouard Callens, Fabien Danieau, Antoine Costes, and Philippe Guillotel. 2018. A Tangible Surface for Digital Sculpting in Virtual Environments. In Haptics: Science, Technology, and Applications, Domenico Prattichizzo, Hiroyuki Shinoda, Hong Z. Tan, Emanuele Ruffaldi, and Antonio Frisoli (Eds.). Springer International Publishing, Cham, 157–168.
[14]
Claudia Cialone, Thora Tenbrink, and Hugo J. Spiers. 2018. Sculptors, Architects, and Painters Conceive of Depicted Spaces Differently. Cognitive Science 42, 2 (2018), 524–553. https://doi.org/10.1111/cogs.12510 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/cogs.12510
[15]
Jonathan M. Cohen, Lee Markosian, Robert C. Zeleznik, John F. Hughes, and Ronen Barzel. 1999. An Interface for Sketching 3D Curves. In Proceedings of the 1999 Symposium on Interactive 3D Graphics (Atlanta, Georgia, USA) (I3D ’99). Association for Computing Machinery, New York, NY, USA, 17–21. https://doi.org/10.1145/300523.300655
[16]
I. Dancyger. 1974. Clay Models and Stone Carving. Drake Publishers. https://books.google.com.hk/books?id=lBlQAAAAMAAJ
[17]
Marek Dvorožňák, Daniel Sýkora, Cassidy Curtis, Brian Curless, Olga Sorkine-Hornung, and David Salesin. 2020. Monster Mash: A Single-View Approach to Casual 3D Modeling and Animation. ACM Transactions on Graphics 39, 6, Article 214 (2020).
[18]
Lesley Fosh, Steve Benford, Stuart Reeves, Boriana Koleva, and Patrick Brundell. 2013. See Me, Feel Me, Touch Me, Hear Me: Trajectories and Interpretation in a Sculpture Garden(CHI ’13). Association for Computing Machinery, New York, NY, USA, 149–158. https://doi.org/10.1145/2470654.2470675
[19]
Connie Golsteijn, Elise Hoven, David Frohlich, and Abigail Sellen. 2014. Hybrid crafting: towards an integrated practice of crafting with physical and digital components. Personal Ubiquitous Comput. 18, 3 (mar 2014), 593–611. https://doi.org/10.1007/s00779-013-0684-9
[20]
Shu Han, Shuxia Wang, and Peng Wang. 2020. An Augmented Reality Approach to 3D Solid Modeling and Demonstration. In HCI International 2020 – Late Breaking Papers: Virtual and Augmented Reality: 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings (Copenhagen, Denmark). Springer-Verlag, Berlin, Heidelberg, 121–140. https://doi.org/10.1007/978-3-030-59990-4_11
[21]
Haptx. 2023. HaptX Gloves. https://www.innovia3d.com/products/geomagic-digital-clay-sculpting-software
[22]
Robert Hopkins. 2003. Sculpture and Space. In Imagination, Philosophy, and the Arts, Matthew Kieran and Dominic Lopes (Eds.). Routledge, 272–290.
[23]
Ke Huo. 2017. Exploring Advance Interactions for Augmented Reality: From Casual Activities to In-Situ 3D Modeling. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (Yokohama, Japan) (TEI ’17). Association for Computing Machinery, New York, NY, USA, 725–728. https://doi.org/10.1145/3024969.3025044
[24]
Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 2023. Teddy: A Sketching Interface for 3D Freeform Design (1 ed.). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3596711.3596722
[25]
Innovia3d. 2023. Digital Clay Sculpting Software. https://www.innovia3d.com/products/geomagic-digital-clay-sculpting-software
[26]
Sung-A Jang, Hyung-il Kim, Woontack Woo, and Graham Wakefield. 2014. AiRSculpt: A Wearable Augmented Reality 3D Sculpting System. In Distributed, Ambient, and Pervasive Interactions, Norbert Streitz and Panos Markopoulos (Eds.). Springer International Publishing, Cham, 130–141.
[27]
Geraldine A. Johnson. 2002. Touch, Tactility, and the Reception of Sculpture in Early Modern Italy. John Wiley & Sons, Ltd, Chapter 5, 61–74. https://doi.org/10.1002/9780470998434.ch6 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/9780470998434.ch6
[28]
Kenrick Kin, Maneesh Agrawala, and Tony DeRose. 2009. Determining the Benefits of Direct-Touch, Bimanual, and Multifinger Input on a Multitouch Workstation. In Proceedings of Graphics Interface 2009 (Kelowna, British Columbia, Canada) (GI ’09). Canadian Information Processing Society, CAN, 119–124.
[29]
K. Koffka. 1935. Principles of Gestalt psychology.Harcourt, Brace, Oxford, England. Pages: 720.
[30]
Carol Kühn. 2009. Digital Sculpture: Conceptually Motivated Sculptural Models Through the Application of Three-Dimensional Computer-aided Design and Additive Fabrication Technologies. Thesis. Central University of Technology, Free State. http://ir.cut.ac.za/handle/11462/50
[31]
Edouard Lanteri. 1985. Modelling and Sculpting the Human Figure. Dover Publications.
[32]
SK Lee, William Buxton, and K. C. Smith. 1985. A Multi-Touch Three Dimensional Touch-Sensitive Tablet. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Francisco, California, USA) (CHI ’85). Association for Computing Machinery, New York, NY, USA, 21–25. https://doi.org/10.1145/317456.317461
[33]
Serena Lee-Cultura and Michail Giannakos. 2020. Embodied Interaction and Spatial Skills: A Systematic Review of Empirical Studies. Interacting with Computers 32, 4 (11 2020), 331–366. https://doi.org/10.1093/iwcomp/iwaa023 arXiv:https://academic.oup.com/iwc/article-pdf/32/4/331/38855595/iwaa023.pdf
[34]
Changjian Li, Hao Pan, Yang Liu, Xin Tong, Alla Sheffer, and Wenping Wang. 2017. BendSketch: Modeling Freeform Surfaces through 2D Sketching. ACM Trans. Graph. 36, 4, Article 125 (jul 2017), 14 pages. https://doi.org/10.1145/3072959.3073632
[35]
Bruno Lucchesi. 1996. Modeling the Figure in Clay (30th anniversary edition ed.). Watson-Guptill Publications.
[36]
Zhongjin Luo, Jie Zhou, Heming Zhu, Dong Du, Xiaoguang Han, and Hongbo Fu. 2021. SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Design. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 854–863. https://doi.org/10.1145/3472749.3474791
[37]
Brian Magerko, Waleed Manzoul, Mark Riedl, Allan Baumer, Daniel Fuller, Kurt Luther, and Celia Pearce. 2009. An Empirical Study of Cognition and Theatrical Improvisation. In Proceedings of the Seventh ACM Conference on Creativity and Cognition (Berkeley, California, USA) (C&C ’09). Association for Computing Machinery, New York, NY, USA, 117–126. https://doi.org/10.1145/1640233.1640253
[38]
Manus. 2023. Virtual Reality Gloves. https://www.manus-meta.com/vr-gloves
[39]
F. David Martin. 1976. The Autonomy of Sculpture. Journal of Aesthetics and Art Criticism 34, 3 (1976), 273–286. https://doi.org/10.2307/430009
[40]
Anthony Martinet, Géry Casiez, and Laurent Grisoni. 2010. The design and evaluation of 3D positioning techniques for multi-touch displays. In 2010 IEEE Symposium on 3D User Interfaces (3DUI). 115–118. https://doi.org/10.1109/3DUI.2010.5444709
[41]
Maxon. 2023. ZBrush. https://www.maxon.net/en/zbrush
[42]
Maurice Merleau-Ponty. 2002. Phenomenology of Perception (2 ed.). Routledge. https://doi.org/10.4324/9780203994610
[43]
Joss Kingdom Moo-Young, Andrew Hogue, and Veronika Szkudlarek. 2021. Virtual Materiality: Realistic Clay Sculpting in VR. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play (Virtual Event, Austria) (CHI PLAY ’21). Association for Computing Machinery, New York, NY, USA, 105–110. https://doi.org/10.1145/3450337.3483475
[44]
Antonius Naumann and Paul Methfessel. 2022. Improving 3D-Editing Workflows via Acoustic Levitation. In Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22 Adjunct). Association for Computing Machinery, New York, NY, USA, Article 104, 4 pages. https://doi.org/10.1145/3526114.3561353
[45]
Patrick Paczkowski, Julie Dorsey, Holly Rushmeier, and Min H. Kim. 2014. Paper3D: Bringing Casual 3D Modeling to a Multi-Touch Interface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 23–32. https://doi.org/10.1145/2642918.2647416
[46]
Ken Pfeuffer, Abdullatif Dinc, Jan Obernolte, Radiah Rivu, Yasmeen Abdrabou, Franziska Shelter, Yomna Abdelrahman, and Florian Alt. 2021. Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on Tablets. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 149–161. https://doi.org/10.1145/3472749.3474741
[47]
Linda Puppe, Helen Jossberger, and Hans Gruber. 2021. Creation Processes of Professional Artists and Art Students in Sculpting. Empirical Studies of the Arts 39, 2 (2021), 171–193. https://doi.org/10.1177/0276237420942716
[48]
Jeba Rezwana and Mary Lou Maher. 2023. User Perspectives on Ethical Challenges in Human-AI Co-Creativity: A Design Fiction Study. In Proceedings of the 15th Conference on Creativity and Cognition (Virtual Event, USA) (C&C ’23). Association for Computing Machinery, New York, NY, USA, 62–74. https://doi.org/10.1145/3591196.3593364
[49]
Brian J. Rogers. 2017. Perception: A Very Short Introduction. Oxford University Press.
[50]
Jarek Rossignac, Mark Allen, Wayne J. Book, Ari Glezer, Imme Ebert-Uphoff, Chris Shaw, David Rosen, Stephen Askins, Jing Bai, Paul Bosscher, Joshua Gargus, ByungMoon Kim, Ignacio Llamas, Austina Nguyen, Guang Yuan, and Haihong Zhu. 2003. Finger Sculpting with Digital Clay: 3D Shape Input and Output through a Computer-Controlled Real Surface. In Proceedings of the Shape Modeling International 2003(SMI ’03). IEEE Computer Society, USA, 229.
[51]
Nathan Rowe. 2023. SculptVR. https://www.sculptrvr.com
[52]
Fabio Scotto. 2022. Sculpting in Augmented Reality. In Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry, Jessie Y. C. Chen and Gino Fragomeni (Eds.). Springer International Publishing, Cham, 91–107.
[53]
SenseGlove. 2023. Nova. https://www.senseglove.com/product/nova
[54]
Hyunyoung Song, François Guimbretière, Chang Hu, and Hod Lipson. 2006. ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (Montreux, Switzerland) (UIST ’06). Association for Computing Machinery, New York, NY, USA, 13–22. https://doi.org/10.1145/1166253.1166258
[55]
Isabell Stein, Helen Jossberger, and Hans Gruber. 2022. Investigating visual expertise in sculpture: A methodological approach using eye tracking. Journal of Eye Movement Research 15, 2 (Jun. 2022). https://doi.org/10.16910/jemr.15.2.5
[56]
Masterpiece Studio. 2023. Masterpiece Studio. https://masterpiecestudio.com
[57]
Ivan E. Sutherland. 1963. Sketchpad: A Man-Machine Graphical Communication System. In Proceedings of the May 21-23, 1963, Spring Joint Computer Conference (Detroit, Michigan) (AFIPS ’63 (Spring)). Association for Computing Machinery, New York, NY, USA, 329–346. https://doi.org/10.1145/1461551.1461591
[58]
Ted Toadvine. 2023. Maurice Merleau-Ponty. In The Stanford Encyclopedia of Philosophy (Winter 2023 ed.), Edward N. Zalta and Uri Nodelman (Eds.). Metaphysics Research Lab, Stanford University.
[59]
Albert Toft. 2012. Modelling and Sculpture A Guide to Traditional Methods. Courier Corporation.
[60]
Adolf von Hildebrand. 1932. The Problem of Form in Painting and Sculpture. Garland Publishing.
[61]
Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014. True2Form: 3D Curve Networks from 2D Sketches via Selective Regularization. ACM Trans. Graph. 33, 4, Article 131 (jul 2014), 13 pages. https://doi.org/10.1145/2601097.2601128
[62]
Yun Zhang and Linda Candy. 2007. An In-depth Case Study of Art-Technology Collaboration. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition (Washington, DC, USA) (C&C ’07). Association for Computing Machinery, New York, NY, USA, 53–62. https://doi.org/10.1145/1254960.1254969
[63]
Amit Zoran and Joseph A. Paradiso. 2013. FreeD: A Freehand Digital Sculpting Tool. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2613–2616. https://doi.org/10.1145/2470654.2481361
[64]
Rachel Zuckert. 2009. Sculpture and Touch: Herder’s Aesthetics of Sculpture. The Journal of Aesthetics and Art Criticism 67, 3 (2009), 285–299. http://www.jstor.org/stable/25622078
Index Terms
- Get Your Hands Dirty? A Comparative Study of Tool Usage and Perceptual Engagement in Physical and Digital Sculpting
Recommendations
DreamWorks Art-Driven Shot Sculpting Toolset
SIGGRAPH '21: ACM SIGGRAPH 2021 TalksThis talk presents DreamWorks’ art-driven shot sculpting toolset used by the Character Effects (CFX) Department to efficiently and logically sculpt shapes of character skin, clothing, hair/fur, and props in shots. The ability to visualize an Animator’s ...
Stylized robotic clay sculpting
Highlights- An interactive design system to design sculpting styles and robotically fabricate on clay material.
Graphical abstractDisplay Omitted
AbstractThis paper presents an interactive design system that allows the user to create and fabricate stylized sculptures in water-based clay, using a standard 6-axis robot arm. This system facilitates the materialization of abstract design ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2024
718 pages
ISBN:9798400704857
DOI:10.1145/3635636
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 23 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- CCF-Tencent Rhino-Bird Open Research Fund
- Zhejiang Provincial Department of Education
Conference
C&C '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 108 of 371 submissions, 29%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 72Total Downloads
- Downloads (Last 12 months)72
- Downloads (Last 6 weeks)13
Reflects downloads up to 02 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format