research-article

Investigating the Use of Spatial Interaction for 3D Data Visualization on Mobile Devices

Authors:

Wolfgang Büschel,

Patrick Reipschläger,

Ricardo Langner,

Raimund DachseltAuthors Info & Claims

ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

Pages 62 - 71

https://doi.org/10.1145/3132272.3134125

Published: 17 October 2017 Publication History

Abstract

Three-dimensional visualizations employing traditional input and output technologies have well-known limitations. Immersive technologies, natural interaction techniques, and recent developments in data physicalization may help to overcome these issues. In this context, we are specifically interested in the usage of spatial interaction with mobile devices for improved 3D visualizations. To contribute to a better understanding of this interaction style, we implemented example visualizations on a spatially-tracked tablet and investigated their usage and potential. In this paper, we report on a qualitative study comparing spatial interaction with inplace 3D visualizations to classic touch interaction regarding typical visualization tasks: navigation of unknown datasets, comparison of individual data objects, and the understanding and memorization of structures in the data. We identify several distinct usage patterns and derive recommendations for using spatial interaction in 3D data visualization.

References

[1]

Arvola, M., and Holm, A. Device-orientation is More Engaging Than Drag (at Least in Mobile Computing). In Proc. NordiCHI '14, ACM (2014), 939--942.

Digital Library

[2]

Bach, B., Dachselt, R., Carpendale, S., Dwyer, T., Collins, C., and Lee, B. Immersive Analytics: Exploring Future Interaction and Visualization Technologies for Data Analytics. In Proc. ISS '16, ACM (2016), 529--533.

Digital Library

[3]

Bach, B., Pietriga, E., and Fekete, J.-D. Visualizing Dynamic Networks with Matrix Cubes. In Proc. CHI '14, ACM (2014), 877--886.

Digital Library

[4]

Ball, R., North, C., and Bowman, D. A. Move to Improve: Promoting Physical Navigation to Increase User Performance with Large Displays. In Proc. CHI '07 (2007), 191--200.

Digital Library

[5]

Bergé, L.-P., Serrano, M., Perelman, G., and Dubois, E. Exploring Smartphone-based Interaction with Overview+Detail Interfaces on 3D Public Displays. In Proc. MobileHCI '14, ACM (2014), 125--134.

Digital Library

[6]

Besançon, L., Issartel, P., Ammi, M., and Isenberg, T. Hybrid Tactile/Tangible Interaction for 3D Data Exploration. IEEE Trans. Vis. Comput. Graphics 22, 1 (2017), 881--890.

Digital Library

[7]

Besançon, L., Issartel, P., Ammi, M., and Isenberg, T. Mouse, Tactile, and Tangible Input for 3D Manipulation. In Proc. CHI '17, ACM (2017), 4727--1740.

Digital Library

[8]

Betella, A., Carvalho, R., Sanchez-Palencia, J., Bernardet, U., and Verschure, P. F. M. J. Embodied Interaction with Complex Neuronal Data in Mixed-reality. In Proc. VRIC '12, ACM (2012), 3:1--3:8.

Digital Library

[9]

Brath, R. 3D InfoVis Is Here to Stay: Deal with It. In 2014 IEEE VIS Int. Workshop on 3DVis (2014), 25--31.

[10]

Büring, T., Gerken, J., and Reiterer, H. User Interaction with Scatterplots on Small Screens - A Comparative Evaluation of Geometric-Semantic Zoom and Fisheye Distortion. IEEE Trans. Vis. Comput. Graphics 12, 5 (2006), 829--836.

Digital Library

[11]

Büschel, W., Reipschläger, P., and Dachselt, R. Improving 3D Visualizations: Exploring Spatial Interaction with Mobile Devices. In Proc. ISS '16 Companion, ACM (2016), 63--69.

Digital Library

[12]

Chandler, T., Cordeil, M., Czauderna, T., Dwyer, T., Glowacki, J., Goncu, C., Klapperstueck, M., Klein, K., Marriott, K., Schreiber, F., and Wilson, E. Immersive Analytics. In Proc. BDVA '15 (Sept. 2015), 73--80.

[13]

Coffey, D., Malbraaten, N., Le, T. B., Borazjani, I., Sotiropoulos, F., Erdman, A. G., and Keefe, D. F. Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface. IEEE Trans. Vis. Comput. Graphics 18, 10 (Oct 2012), 1614--1626.

Digital Library

[14]

Cohé, A., Dècle, F., and Hachet, M. tBox: A 3D Transformation Widget Designed for Touch-screens. In Proc. CHI '11, ACM (2011), 3005--3008.

Digital Library

[15]

Drochtert, D., and Geiger, C. Collaborative Magic Lens Graph Exploration. In SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, ACM (2015), 25:1--25:3.

Digital Library

[16]

Elmqvist, N., Dragicevic, P., and Fekete, J.-D. Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation. IEEE Trans. Vis. Comput. Graphics 14, 6 (2008), 1539--1148.

[17]

Fitzmaurice, G. W. Situated Information Spaces and Spatially Aware Palmtop Computers. Commun. ACM 36, 7 (1993), 39--49.

Digital Library

[18]

Hancock, M., ten Cate, T., and Carpendale, S. Sticky Tools: Full 6DOF Force-based Interaction for Multi-touch Tables. In Proc. ITS '09, ACM (2009), 133--140.

Digital Library

[19]

Hürst, W., and Bilyalov, T. Dynamic Versus Static Peephole Navigation of VR Panoramas on Handheld Devices. In Proc. MUM '10, ACM (2010), 25:1--25:8.

Digital Library

[20]

Jakobsen, M. R., and Hornbæk, K. Is Moving Improving?: Some Effects of Locomotion in Wall-Display Interaction. In Proc. CHI '15, ACM (2015), 4169--4178.

Digital Library

[21]

Jankowski, J., and Hachet, M. Advances in Interaction with 3D Environments. Computer Graphics Forum 34, 1 (2015), 152--190.

Digital Library

[22]

Karstens, B., Kreuseler, M., and Schumann, H. Visualization of Complex Structures on Mobile Handhelds. In Proc. Int. Workshop on Mobile Computing (2003), 17--18.

[23]

Kaufmann, B., and Ahlström, D. Studying spatial memory and map navigation performance on projector phones with peephole interaction. In Proc CHI '13, ACM (2013), 3173--3176.

Digital Library

[24]

Keefe, D., Krüger, A., Steinicke, F., and de la Rivière, J.-B. Touching the 3rd Dimension (Dagstuhl Seminar 12151). Dagstuhl Reports 2, 4 (2012), 1--20.

[25]

Klein, T., Guéniat, F., Pastur, L., Vernier, F., and Isenberg, T. A Design Study of Direct-Touch Interaction for Exploratory 3D Scientific Visualization. Computer Graphics Forum 31, 3 (2012), 1225--1234.

Digital Library

[26]

Lee, B., Isenberg, P., Riche, N. H., and Carpendale, S. Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Trans. Vis. Comput. Graphics 18, 12 (2012), 2689--2698.

Digital Library

[27]

Liu, C., Chapuis, O., Beaudouin-Lafon, M., Lecolinet, E., and Mackay, W. E. Effects of Display Size and Navigation Type on a Classification Task. In Proc. CHI '14, ACM (2014), 4147--4156.

Digital Library

[28]

Marzo, A., Bossavit, B., and Hachet, M. Combining Multi-touch Input and Device Movement for 3D Manipulations in Mobile Augmented Reality Environments. In Proc. SUI '14, ACM (2014), 13--16.

Digital Library

[29]

Medeiros, D., Teixeira, L., Carvalho, F., Santos, I., and Raposo, A. A Tablet-based 3D Interaction Tool for Virtual Engineering Environments. In Proc. VRCAI '13, ACM (2013), 211--218.

Digital Library

[30]

Meiguins, B. S., do Carmo, R. M. C., Almeida, L., Gonçalves, A. S. o., Pinheiro, S. C. V., de Brito Garcia, M., and Godinho, P. I. A. Multidimensional Information Visualization Using Augmented Reality. In Proc. VRCIA '06, ACM (2006), 391--394.

Digital Library

[31]

Morrison, A., Oulasvirta, A., Peltonen, P., Lemmela, S., Jacucci, G., Reitmayr, G., Näsänen, J., and Juustila, A. Like Bees Around the Hive: A Comparative Study of a Mobile Augmented Reality Map. In Proc. CHI '09, ACM (2009), 1889--1898.

Digital Library

[32]

Müller, J., Rädle, R., Jetter, H.-C., and Reiterer, H. An Experimental Comparison of Vertical and Horizontal Dynamic Peephole Navigation. In Proc. CHI '15, ACM (2015), 1523--1526.

Digital Library

[33]

Müller, J., Rädle, R., and Reiterer, H. Remote Collaboration With Mixed Reality Displays: How Shared Virtual Landmarks Facilitate Spatial Referencing. In Proc. CHI '17, ACM (2017), 6481--6486.

Digital Library

[34]

Pietroszek, K., Wallace, J. R., and Lank, E. Tiltcasting: 3D Interaction on Large Displays Using a Mobile Device. In Proc. UIST '15, ACM (2015), 57--62.

Digital Library

[35]

Preim, B., Baer, A., Cunningham, D., Isenberg, T., and Ropinski, T. A Survey of Perceptually Motivated 3D Visualization of Medical Image Data. Computer Graphics Forum 35, 3 (2016), 501--525.

Digital Library

[36]

Qi, W., Taylor, II, R. M., Healey, C. G., and Martens, J.-B. A Comparison of Immersive HMD, Fish Tank VR and Fish Tank with Haptics Displays for Volume Visualization. In Proc. APGV '06, ACM (2006), 51--58.

Digital Library

[37]

Rädle, R., Jetter, H.-C., Butscher, S., and Reiterer, H. The Effect of Egocentric Body Movements on Users' Navigation Performance and Spatial Memory in Zoomable User Interfaces. In Proc. ITS '13, ACM (2013), 23--32.

Digital Library

[38]

Raja, D., Bowman, D. A., Lucas, J., and North, C. Exploring the Benefits of Immersion in Abstract Information Visualization. In Proc. Immersive Projection Technology Workshop (2004), 61--69.

[39]

Roberts, J. C., Ritsos, P. D., Badam, S. K., Brodbeck, D., Kennedy, J., and Elmqvist, N. Visualization beyond the Desktop -- the Next Big Thing. IEEE Comput. Graph. Appl. 34, 6 (2014), 26--34.

[40]

Rohs, M., Essl, G., Schöning, J., Krüger, A., and Raubal, M. Map Navigation with Mobile Devices: Virtual versus Physical Movement with and without Visual Context. In Proc. ICMI '07, ACM (2007), 146--153.

Digital Library

[41]

Rosenbaum, R., Bottleson, J., Liu, Z., and Hamann, B. Involve Me and I Will Understand!-Abstract Data Visualization in Immersive Environments. In Proc. ISVC'11, Springer-Verlag (2011), 530--540.

[42]

Rousset, E., Bérard, F., and Ortega, M. Two-finger 3D Rotations for Novice Users: Surjective and Integral Interactions. In Proc. AVI '14, ACM (2014), 217--224.

Digital Library

[43]

Sadana, R., and Stasko, J. Designing and Implementing an Interactive Scatterplot Visualization for a Tablet Computer. In Proc. AVI '14, ACM (2014), 265--272.

Digital Library

[44]

Sanftmann, H., and Weiskopf, D. 3D Scatterplot Navigation. IEEE Trans. Vis. Comput. Graphics 18, 11 (2012), 1969--1978.

Digital Library

[45]

Schiewe, A., Anstoots, M., and Krger, J. State of the Art in Mobile Volume Rendering on iOS Devices. In Proc. EuroVis '15, E. Bertini, J. Kennedy, and E. Puppo, Eds., The Eurographics Association (2015).

[46]

Spindler, M., Büschel, W., and Dachselt, R. Use Your Head: Tangible Windows for 3D Information Spaces in a Tabletop Environment. In Proc. ITS '12, ACM (2012), 245--254.

Digital Library

[47]

Spindler, M., Schuessler, M., Martsch, M., and Dachselt, R. Pinch-drag-flick vs. Spatial Input: Rethinking Zoom & Pan on Mobile Displays. In Proc. CHI '14, ACM (2014), 1113--1122.

Digital Library

[48]

Spindler, M., Tominski, C., Schumann, H., and Dachselt, R. Tangible Views for Information Visualization. In Proc. ITS '10, ACM (2010), 157--166.

Digital Library

[49]

Steinicke, F., Benko, H., Krüger, A., Keefe, D., de la Riviére, J.-B., Anderson, K., Häkkilä, J., Arhippainen, L., and Pakanen, M. The 3rd Dimension of CHI (3DCHI): Touching and Designing 3D User Interfaces. In Proc. CHI EA '12, ACM (2012), 2695--2698.

Digital Library

[50]

Telkenaroglu, C., and Capin, T. Dual-Finger 3D Interaction Techniques for Mobile Devices. Personal and Ubiquitous Computing 17, 7 (2013), 1551--1572.

Digital Library

[51]

Thomason, J., and Wang, J. Exploring Multi-dimensional Data on Mobile Devices with Single Hand Motion and Orientation Gestures. In Proc. MobileHCI '12, ACM (2012), 173--176.

Digital Library

[52]

Walther-Franks, B., Herrlich, M., and Malaka, R. A Multi-touch System for 3D Modelling and Animation. In Smart Graphics, L. Dickmann, G. Volkmann, R. Malaka, S. Boll, A. Krüger, and P. Olivier, Eds., no. 6815 in Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2011, 48--59.

[53]

Yee, K.-P. Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In Proc. CHI '03, ACM (2003), 1--8.

Digital Library

[54]

Yu, L., Svetachov, P., Isenberg, P., Everts, M. H., and Isenberg, T. FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces. IEEE Trans. Vis. Comput. Graphics 16, 6 (2010), 1613--1622.

Digital Library

[55]

Ziegeler, S., Moorhead, R. J., Croft, P. J., and Lu, D. The MetVR Case Study: Meteorological Visualization in an Immersive Virtual Environment. In Proc. VIS '01, IEEE Computer Society (2001), 489--492.

Cited By

Svalina ABanić DKovačević D(2024)Interpreting Bar Charts: Effects of 3D Depth Cues on Human Gaze and User UnderstandingDigital10.3390/digital40400464:4(932-946)Online publication date: 3-Nov-2024
https://doi.org/10.3390/digital4040046
Friedl‐Knirsch JPointecker FPfistermüller SStach CAnthes CRoth D(2024)A Systematic Literature Review of User Evaluation in Immersive AnalyticsComputer Graphics Forum10.1111/cgf.1511143:3Online publication date: 10-Jun-2024
https://doi.org/10.1111/cgf.15111
Shin SBatch AButcher PRitsos PElmqvist N(2024)The Reality of the Situation: A Survey of Situated AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.328554630:8(5147-5164)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3285546
Show More Cited By

Index Terms

Investigating the Use of Spatial Interaction for 3D Data Visualization on Mobile Devices
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Data Visualization on Mobile Devices
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

As mobile visualization is increasingly used and new mobile device form factors and hardware capabilities continuously emerge, it is timely to reflect on what has been discovered to date and to look into the future. This workshop will bring together ...
A geoscience perspective on immersive 3D gridded data visualization

We describe visualization software, Visualizer, that was developed specifically for interactive, visual exploration in immersive virtual reality (VR) environments. Visualizer uses carefully optimized algorithms and data structures to support the high ...
Remote Rendering and User Interaction on Mobile Devices for Scientific Visualization
VINCI '15: Proceedings of the 8th International Symposium on Visual Information Communication and Interaction

Scientific data is typically analyzed using visualizations. Large high-resolution displays can facilitate the analysis process since they offer more screen real estate than desktop monitors, which allows visualizing more data in greater detail and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

October 2017

504 pages

ISBN:9781450346917

DOI:10.1145/3132272

General Chairs:
Sriram Subramanian
University of Sussex, UK
,
Jürgen Steimle
Saarland University, Germany
,
Program Chairs:
Raimund Dachselt
Technische Universität Dresden, Germany
,
Diego Martinez Plasencia
University of Sussex, UK
,
Tovi Grossman
Autodesk Research

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Bundesministerium für Bildung und Forschung

Conference

ISS '17

Sponsor:

SIGCHI

ISS '17: Interactive Surfaces and Spaces

October 17 - 20, 2017

Brighton, United Kingdom

Acceptance Rates

ISS '17 Paper Acceptance Rate 32 of 119 submissions, 27%;

Overall Acceptance Rate 147 of 533 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
897
Total Downloads

Downloads (Last 12 months)100
Downloads (Last 6 weeks)7

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Svalina ABanić DKovačević D(2024)Interpreting Bar Charts: Effects of 3D Depth Cues on Human Gaze and User UnderstandingDigital10.3390/digital40400464:4(932-946)Online publication date: 3-Nov-2024
https://doi.org/10.3390/digital4040046
Friedl‐Knirsch JPointecker FPfistermüller SStach CAnthes CRoth D(2024)A Systematic Literature Review of User Evaluation in Immersive AnalyticsComputer Graphics Forum10.1111/cgf.1511143:3Online publication date: 10-Jun-2024
https://doi.org/10.1111/cgf.15111
Shin SBatch AButcher PRitsos PElmqvist N(2024)The Reality of the Situation: A Survey of Situated AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.328554630:8(5147-5164)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3285546
Wang XWang JZhang Y(2023)Research on 3D Visualization of Real Scene in Subway Engineering Based on 3D ModelBuildings10.3390/buildings1309231713:9(2317)Online publication date: 12-Sep-2023
https://doi.org/10.3390/buildings13092317
Kintscher MHuang JArunkumar AAmresh ABryan C(2023)Measuring and Comparing Collaborative Visualization Behaviors in Desktop and Augmented Reality EnvironmentsProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615691(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615691
Gryphon KVu VChung H(2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614516
Jansen PBritten JHäusele ASegschneider TColley MRukzio E(2023)AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction StudiesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580760(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580760
Lee BSatyanarayan ACordeil MProuzeau AJenny BDwyer T(2023)Deimos: A Grammar of Dynamic Embodied Immersive Visualisation Morphs and TransitionsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580754(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580754
Jadhav SKaufman A(2023) MD-Cave : An Immersive Visualization Workbench for Radiologists IEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.319367229:12(4832-4844)Online publication date: Dec-2023
https://doi.org/10.1109/TVCG.2022.3193672
Song TEck UNavab N(2023)Leveraging Motion Tracking for Intuitive Interactions in a Tablet-Based 3D Scene Annotation System2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00071(563-572)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00071
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents