research-article

The Effect of Spatial Ability on Immersive 3D Drawing

Authors:

Mayra Donaji Barrera Machuca,

Wolfgang Stuerzlinger,

Paul AsenteAuthors Info & Claims

C&C '19: Proceedings of the 2019 Conference on Creativity and Cognition

Pages 173 - 186

https://doi.org/10.1145/3325480.3325489

Published: 13 June 2019 Publication History

Abstract

Virtual Reality (VR) headsets have made immersive 3D drawing available to the general public. However, compared to 2D drawing, the presence of an additional dimension makes sketching in VR challenging, since creating precise strokes that are positioned as intended in all three dimensions imposes higher demands on the users' perception, motor and spatial skills. Another challenge users face is creating accurate shapes in which strokes are positioned correctly relative to previous ones, as they may need to use different views to plan their next hand movement. In this paper, we analyze the behaviours of users with different spatial abilities while drawing in VR. Our results indicate that there are different types of behaviours that affect different aspects of the sketches. We also found that the user's spatial ability affects the shape of the drawing, but not the line precision. Finally, we give recommendations for designing 3D drawing interfaces.

Supplementary Material

MP4 File (ccfp1071.mp4)

Supplemental video

Download
124.86 MB

References

[1]

Armbrüster, C. et al. 2008. Depth Perception in Virtual Reality: Distance Estimations in Peri- and Extrapersonal Space. CyberPsychology & Behavior. 11, 1: 9--15.

[2]

Arora, R. et al. 2017. Experimental Evaluation of Sketching on Surfaces in VR. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '17), 5643--5654.

Digital Library

[3]

Arora, R. et al. 2018. SymbiosisSketch?: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '18), 1--15.

Digital Library

[4]

Baker Cave, C. and Kosslyn, S.M. 1993. The role of parts and spatial relations in object identification. Perception. 22, 2: 229--248.

[5]

Barrera Machuca, M.D. et al. 2018. Multiplanes: Assisted freehand VR Sketching. Proceedings of the ACM Symposium on Spatial User Interaction (SUI'18), 36--47.

Digital Library

[6]

Barrera Machuca, M.D. and Stuerzlinger, W. 2019. The Effect of Stereo Display Deficiencies on Virtual Hand Pointing. Proceedings of SIGCHI Conference on Human Factors in Computing Systems Proceedings (CHI '19), 14.

[7]

Batmaz, A.U. et al. 2019. Do Head-MountedDisplay Stereo Deficiencies Affect 3D Pointing Tasks in AR and VR? IEEE Conference on Virtual Reality and 3D UserInterfaces (VR '19).

[8]

Bowman, D.A. et al. 1997. Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques. Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality (VR' 97), 45--52.

Digital Library

[9]

Branoff, T. and Dobelis, M. 2013. The Relationship Between Students' Ability to Model Objects from Assembly Drawing Information and Spatial Visualization Ability as Measured by the PSVT:R and MCT. ASEE Annual Conference Proceedings (ASEE '013).

[10]

Chamberlain, R. et al. 2011. The Perceptual Foundations of Drawing Ability. Proceedings of an interdisciplinary symposium on drawing, cognition and education, 95--10.

[11]

Christou, C.G. et al. 2003. Extrinsic cues aid shape recognition from novel viewpoints. Journal of Vision. 3, 3: 183--198.

[12]

Cohen, D.J. and Bennett, S. 1997. Why Can't Most People Draw What They See? Journal of Experimental Psychology: Human Perception and Performance. 23, 3: 609--621.

[13]

Deering, M.F. 1996. The HoloSketch VR sketching system. Communications of the ACM. 39, 5 : 54--61.

Digital Library

[14]

Dünser, A. et al. 2006. Virtual and augmented reality as spatial ability training tools. Proceedings of the ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: design centered HCI (CHINZ '06), 125--132.

Digital Library

[15]

Ekstrom, R.B. et al. 1976. Manual for kit of factor-referenced cognitive tests. Princeton NJ Educational Testing Service. 102, 41: 117.

[16]

Facebook 2018. Quill.

[17]

La Femina, F. et al. 2009. A battery for the assessment of visuo-spatial abilities involved in drawing tasks. Clinical Neuropsychologist. 23, 4: 691--714.

[18]

Fiorentino, M. et al. 2003. 3D Sketch Stroke Segmentation and Fitting in Virtual Reality. International Conference on the Computer Graphics and Vision (CGV '03), 188--191.

[19]

Fitzmaurice, G. et al. 2008. Safe 3D navigation. Proceedings of the 2008 symposium on Interactive 3D graphics and games (SI3D '08), 7.

Digital Library

[20]

Google 2016. Tilt Brush.

[21]

Gowen, E. and Miall, R.C. 2006. Eye-hand interactions in tracing and drawing tasks. Human Movement Science. 25, 4--5: 568--585.

[22]

Grossman, T. et al. 2002. Creating principal 3D curves with digital tape drawing. Proceedings of the SIGCHI conference on Human factors in computing systems Changing our world, changing ourselves (CHI '02), 121.

Digital Library

[23]

Hegarty, M. and Waller, D. 2004. A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence. 32, 2: 175--191.

[24]

Hess, R.F. et al. 2015. Stereo Vision: The Haves and Have-Nots. i-Perception. 6, 3: 1--5.

[25]

HTC 2016. VIVE.

[26]

Israel, J.H. et al. 2009. Investigating three-dimensional sketching for early conceptual design-Results from expert discussions and user studies. Computers & Graphics. 33, 4: 462--473.

Digital Library

[27]

Jackson, B. and Keefe, D.F. 2016. Lift-Off: Using Reference Imagery and Freehand Sketching to Create 3D Models in VR. IEEE Transactions on Visualization and Computer Graphics. 22, 4: 1442--1451.

Digital Library

[28]

Jin, Y. and Chusilp, P. 2006. Study of mental iteration in different design situations. Design Studies. 27, 1: 25--55.

[29]

Keefe, D.F. et al. 2001. CavePainting: A Fully Immersive 3D Artistic Medium and Interactive Experience. Proceedings of the ACM Symposium on Interactive 3D Graphics (I3D '01), 85--93.

Digital Library

[30]

Keefe, D.F. et al. 2007. Drawing on Air: Input Techniques for Controlled 3D Line Illustration. IEEE Transactions on Visualization and Computer Graphics. 13, 5: 1067--1081.

Digital Library

[31]

Kenyon, R. V. and Ellis, S.R. 2014. Virtual Reality for Physical and Motor Rehabilitation. Springer New York.

Digital Library

[32]

Khan, A. et al. 2008. ViewCube. Proceedings of the 2008 symposium on Interactive 3D graphics and games (SI3D '08), 17.

[33]

Klatzky, R.L. et al. 1998. Spatial Updating of Self-Position and Orientation During Real, Imagined, and Virtual Locomotion. Psychological Science. 9, 4: 293--298.

[34]

Kozhevnikov, M. and Hegarty, M. 2001. A dissociation between object manipulation spatial ability and spatial orientation ability. Memory and Cognition. 29, 5: 745--756.

[35]

Lages, W.S. and Bowman, D.A. 2018. Move the Object or Move Myself? Walking vs. Manipulation for the Examination of 3D Scientific Data. Frontiers in ICT. 5: 1--12.

[36]

McDonald, A. et al. 2012. Spatial dependency of shoulder muscle demands in horizontal pushing and pulling. Applied Ergonomics. 43, 6: 971--978.

[37]

Murugappan, S. et al. 2009. Towards beautification of freehand sketches using suggestions. Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling (SBIM '09), 69.

Digital Library

[38]

Oculus 2016. Rift.

[39]

Orde, B.J. 1997. Drawing as Visual-Perceptual and Spatial Ability Training. Proceedings of Selected Research and Development Presentations at the 1997 National Convention of the Association for Educational Communications and Technology.

[40]

Perkunder, H. et al. 2010. Shape Modeling with Sketched Feature Lines in Immersive 3D Environments. Proceedings of the Eurographics Symposium on Sketch-Based Interfaces and Modeling (Expressive'10), 127--134.

Digital Library

[41]

Pittalis, M. and Christou, C. 2010. Types of reasoning in 3D geometry thinking and their relation with spatial ability. Educational Studies in Mathematics. 75, 2: 191--212.

[42]

Renner, R.S. et al. 2013. The perception of egocentric distances in virtual environments - A review. ACM Computing Surveys. 46, 2: 1--40.

Digital Library

[43]

Riecke, B.E. et al. 2007. Spatial Updating in Virtual Reality: The Sufficiency of Visual Information. Psychological Research. 71, 3: 298--313.

[44]

Robinett, W. and Holloway, R. 1992. Implementation of flying, scaling and grabbing in virtual worlds. Proceedings of the 1992 symposium on Interactive 3D graphics (SI3D '92), 189--192.

Digital Library

[45]

Rock, I. et al. 1989. Can we imagine how objects look from other viewpoints? Cognitive Psychology. 21, 2: 185--210.

[46]

Samsudin, K. et al. 2016. Training in Mental Rotation and Spatial Visualization and Its Impact on Orthographic Drawing Performance. Journal of Educational Technology and Society. 14, 1:179--186.

[47]

Shelton, A.L.M.Y.L. and McNamara, T.P. 1997. Multiple views of spatial memory. Psychonomic Bulletin & Review. 4, 1: 102--106.

[48]

Shepard, R.N. and Metzler, J. 1971. Mental Rotation of Three-Dimensional Objects. Science. 171, 3972: 701--703.

[49]

Tano, S. et al. 2013. Truly useful 3D drawing system for professional designer by "life-sized and operable" feature and new interaction. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 8117 LNCS, PART 1: 37--55.

[50]

Tarr, M.J. et al. 1998. Three-dimensional object recognition is viewpoint dependent. Nature Neuroscience. 1, 4: 275--277.

[51]

Tchalenko, J. 2009. Segmentation and accuracy in copying and drawing: Experts and beginners. Vision Research. 49, 8: 791--800.

[52]

Teramoto, W. and Riecke, B.E. 2010. Dynamic visual information facilitates object recognition from novel viewpoints. Journal of Vision. 10, 13: 1--13.

[53]

Tramper, J.J. and Gielen, S. 2011. Visuomotor coordination is different for different directions in three-dimensional space. The Journal of Neuroscience. 31, 21: 7857--7866.

[54]

Ullman, D.G. et al. 1990. The importance of drawing in the mechanical design process. Computers & Graphics. 14, 2: 263--274.

[55]

Usoh, M. et al. 1999. Walking -> Walking-in-Place -> Flying, in Virtual Environments. Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99), 359--364.

Digital Library

[56]

Wesche, G. and Seidel, H.-P. 2001. FreeDrawer: A Free-Form Sketching System on the Responsive Workbench. Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST '01), 167.

Digital Library

[57]

Wiese, E. et al. 2010. Investigating the learnability of immersive free-hand sketching. Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium (SBIM'10), 135--142.

[58]

Wobbrock, J.O. et al. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 143.

Digital Library

[59]

Yogev-Seligmann, G. et al. 2008. The role of executive function and attention in gait. Movement Disorders. 23, 3: 329--342.

Cited By

Rangarajan VShahbaz Badr ADe Amicis R(2024)Evaluating Virtual Reality in Education: An Analysis of VR through the Instructors’ LensMultimodal Technologies and Interaction10.3390/mti80800728:8(72)Online publication date: 12-Aug-2024
https://doi.org/10.3390/mti8080072
Tung YChang C(2024)How three-dimensional sketching environments affect spatial thinking: A functional magnetic resonance imaging study of virtual realityPLOS ONE10.1371/journal.pone.029445119:3(e0294451)Online publication date: 11-Mar-2024
https://doi.org/10.1371/journal.pone.0294451
Fox-Gieg N(2024)Lightning Artist Toolkit: A Hand-Drawn Volumetric Animation PipelineProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36642217:4(1-7)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3664221
Show More Cited By

Index Terms

The Effect of Spatial Ability on Immersive 3D Drawing
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

C&C '19: Proceedings of the 2019 Conference on Creativity and Cognition

June 2019

745 pages

ISBN:9781450359177

DOI:10.1145/3325480

General Chairs:
Steven Dow
UC San Diego, USA
,
Mary Lou Maher
UNC Charlotte, USA
,
Program Chairs:
Andruid Kerne
Texas A&M University
,
Celine Latulipe
UNC Charlotte, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

C&C '19

Sponsor:

SIGCHI

C&C '19: Creativity and Cognition

June 23 - 26, 2019

CA, San Diego, USA

Acceptance Rates

C&C '19 Paper Acceptance Rate 30 of 101 submissions, 30%;

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
706
Total Downloads

Downloads (Last 12 months)110
Downloads (Last 6 weeks)10

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rangarajan VShahbaz Badr ADe Amicis R(2024)Evaluating Virtual Reality in Education: An Analysis of VR through the Instructors’ LensMultimodal Technologies and Interaction10.3390/mti80800728:8(72)Online publication date: 12-Aug-2024
https://doi.org/10.3390/mti8080072
Tung YChang C(2024)How three-dimensional sketching environments affect spatial thinking: A functional magnetic resonance imaging study of virtual realityPLOS ONE10.1371/journal.pone.029445119:3(e0294451)Online publication date: 11-Mar-2024
https://doi.org/10.1371/journal.pone.0294451
Fox-Gieg N(2024)Lightning Artist Toolkit: A Hand-Drawn Volumetric Animation PipelineProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36642217:4(1-7)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3664221
Yu EChevalier FSingh KBousseau A(2024)3D-Layers: Bringing Layer-Based Color Editing to VR PaintingACM Transactions on Graphics10.1145/365818343:4(1-15)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658183
Hoffmann PWehbe RMühlhäuser MBarrera Machuca M(2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656191
Zhang YHan RZhou RGyory PZheng CShih PDo EJung MJu WLeithinger DCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Wizard of Props: Mixed Reality Prototyping with Physical Props to Design Responsive EnvironmentsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633395(1-15)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633395
Rodriguez RSullivan BBarrera Machuca MBatmaz ATornatzky COrtega F(2024)An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642758(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642758
Tan XHe ZLiu CFan MLuo TLiu ZTian MHan TTian F(2024)WieldingCanvas: Interactive Sketch Canvases for Freehand Drawing in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642047(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642047
Turkmen RGelmez ZBatmaz AStuerzlinger WAsente PSarac MPfeuffer KBarrera Machuca M(2024)EyeGuide & EyeConGuide: Gaze-based Visual Guides to Improve 3D Sketching SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641947(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641947
Machuca MIsrael JKeefe DStuerzlinger W(2024)Toward More Comprehensive Evaluations of 3D Immersive Sketching, Drawing, and PaintingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.327629130:8(4648-4664)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3276291
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents