research-article

Investigating Smartphone-based Pan and Zoom in 3D Data Spaces in Augmented Reality

Authors:

Wolfgang Büschel,

Annett Mitschick,

Raimund DachseltAuthors Info & Claims

MobileHCI '19: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 2, Pages 1 - 13

https://doi.org/10.1145/3338286.3340113

Published: 01 October 2019 Publication History

Abstract

In this paper, we investigate mobile devices as interactive controllers to support the exploration of 3D data spaces in head-mounted Augmented Reality (AR). In future mobile contexts, applications such as immersive analysis or ubiquitous information retrieval will involve large 3D data sets, which must be visualized in limited physical space. This necessitates efficient interaction techniques for 3D panning and zooming. Smartphones as additional input devices are promising because they are familiar and widely available in mobile usage contexts. They also allow more casual and discreet interaction compared to free-hand gestures or voice input. We introduce smartphone-based pan & zoom techniques for 3D data spaces and present a user study comparing five techniques. Our results show that spatial device gestures can outperform both touch-based techniques and hand gestures in terms of task completion times and user preference. We discuss our findings in detail and suggest suitable techniques for specific AR navigation tasks.

References

[1]

Laurent Aguerreche, Thierry Duval, and Anatole Lécuyer. 2010. Reconfigurable Tangible Devices for 3D Virtual Object Manipulation by Single or Multiple Users. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology (VRST '10). ACM, New York, NY, USA, 227--230. https://doi.org/10.1145/1889863.1889913

Digital Library

[2]

Adrien Arnaud, Jean-Baptiste Corrégé, Céline Clavel, Michèle Gouiffès, and Mehdi Ammi. 2016. Exploration of Virtual Environments on Tablet: Comparison Between Tactile and Tangible Interaction Techniques. In Proceedings of the 18th ACM International Conference on Multimodal Interaction (ICMI 2016). ACM, New York, NY, USA, 357--361. https://doi.org/10.1145/2993148.2993186

Digital Library

[3]

Michel Beaudouin-Lafon. 2000. Instrumental Interaction: An Interaction Model for Designing post-WIMP User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '00). ACM, New York, NY, USA, 446--453. https://doi.org/10.1145/332040.332473

Digital Library

[4]

Louis-Pierre Bergé, Emmanuel Dubois, and Mathieu Raynal. 2015. Design and Evaluation of an "Around the SmartPhone" Technique for 3D Manipulations on Distant Display. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI '15). ACM, New York, NY, USA, 69--78. https://doi.org/10.1145/2788940.2788941

Digital Library

[5]

Louis-Pierre Bergé, Marcos Serrano, Gary Perelman, and Emmanuel Dubois. 2014. Exploring Smartphone-based Interaction with Overview+Detail Interfaces on 3D Public Displays. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 125--134. https://doi.org/10.1145/2628363.2628374

Digital Library

[6]

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg. 2017. Hybrid Tactile/Tangible Interaction for 3D Data Exploration. IEEE Transactions on Visualization and Computer Graphics 23, 1 (Jan. 2017), 881--890. https://doi.org/10.1109/TVCG.2016.2599217

Digital Library

[7]

Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg. 2017. Mouse, Tactile, and Tangible Input for 3D Manipulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4727--4740. https://doi.org/10.1145/3025453.3025863

Digital Library

[8]

Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A Survey of Augmented Reality. Foundations and Trends® in Human--Computer Interaction 8, 2-3 (2015), 73--272. https://doi.org/10.1561/1100000049

Digital Library

[9]

Frédéric Bourgeois, Yves Guiard, and Michel Beaudouin-Lafon. 2001. Pan-Zoom Coordination in Multi-Scale Pointing. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (CHI EA '01). ACM, New York, NY, USA, 157--158. https://doi.org/10.1145/634067.634163

[10]

Wolfgang Büschel, Annett Mitschick, and Raimund Dachselt. 2018. Here and Now: Reality-Based Information Retrieval. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (CHIIR '18). ACM, New York, NY, USA, 171--180. https://doi.org/10.1145/3176349.3176384

Digital Library

[11]

Wolfgang Büschel, Patrick Reipschläger, Ricardo Langner, and Raimund Dachselt. 2017. Investigating the Use of Spatial Interaction for 3D Data Visualization on Mobile Devices. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 62--71. https://doi.org/10.1145/3132272.3134125

Digital Library

[12]

William Buxton and Brad Myers. 1986. A Study in Two-handed Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '86). ACM, New York, NY, USA, 321--326. https://doi.org/10.1145/22627.22390

Digital Library

[13]

Tom Chandler, Maxime Cordeil, Tobias Czauderna, Tim Dwyer, Jaroslaw Glowacki, Cagatay Goncu, Matthias Klapperstueck, Karsten Klein, Kim Marriott, Falk Schreiber, et al. 2015. Immersive Analytics. In 2015 Big Data Visual Analytics (BDVA). 1--8. https://doi.org/10.1109/BDVA.2015.7314296

[14]

Huiwen Chang and Michael F. Cohen. 2017. Panning and Zooming High-Resolution Panoramas in Virtual Reality Devices. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 279--288. https://doi.org/10.1145/3126594.3126617

[15]

Aurélie Cohé, Fabrice Dècle, and Martin Hachet. 2011. tBox: A 3D Transformation Widget Designed for Touch-Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3005--3008. https://doi.org/10.1145/1978942.1979387

Digital Library

[16]

Raimund Dachselt and Robert Buchholz. 2009. Natural Throw and Tilt Interaction Between Mobile Phones and Distant Displays. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, New York, NY, USA, 3253--3258. https://doi.org/10.1145/1520340.1520467

[17]

Florian Daiber, Marco Speicher, Sven Gehring, Markus Löchtefeld, and Antonio Krüger. 2014. Interacting with 3D Content on Stereoscopic Displays. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14). ACM, New York, NY, USA, 32:32--32:37. https://doi.org/10.1145/2611009.2611024

Digital Library

[18]

Dragoş Datcu, Stephan Lukosch, and Frances Brazier. 2015. On the Usability and Effectiveness of Different Interaction Types in Augmented Reality. International Journal of Human--Computer Interaction 31, 3 (2015), 193--209. https://doi.org/10.1080/10447318.2014.994193arXiv:https://doi.org/10.1080/10447318.2014.994193

[19]

David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2017. PocketThumb: A Wearable Dual-Sided Touch Interface for Cursor-based Control of Smart-Eyewear. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 9 (June 2017), 17 pages. https://doi.org/10.1145/3090055

Digital Library

[20]

Neven AM ElSayed, Bruce H Thomas, Kim Marriott, Julia Piantadosi, and Ross T Smith. 2015. Situated Analytics. In 2015 Big Data Visual Analytics (BDVA). 1--8. https://doi.org/10.1109/BDVA.2015.7314302

[21]

Barrett Ens, Ahmad Byagowi, Teng Han, Juan David Hincapié-Ramos, and Pourang Irani. 2016. Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI '16). ACM, New York, NY, USA, 99--102. https://doi.org/10.1145/2983310.2985757

Digital Library

[22]

Jinbo Feng, Isaac Cho, and Zachary Wartell. 2015. Comparison of Device-Based, One and Two-Handed 7DOF Manipulation Techniques. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI '15). ACM, New York, NY, USA, 2--9. https://doi.org/10.1145/2788940.2788942

Digital Library

[23]

Gene V Glass, Percy D Peckham, and James R Sanders. 1972. Consequences of Failure to Meet Assumptions Underlying the Fixed Effects Analyses of Variance and Covariance. Review of educational research 42, 3 (1972), 237--288.

[24]

Jerônimo Gustavo Grandi, Henrique Galvan Debarba, Luciana Nedel, and Anderson Maciel. 2017. Design and Evaluation of a Handheld-Based 3D User Interface for Collaborative Object Manipulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5881--5891. https://doi.org/10.1145/3025453.3025935

Digital Library

[25]

Mark Hancock, Otmar Hilliges, Christopher Collins, Dominikus Baur, and Sheelagh Carpendale. 2009. Exploring Tangible and Direct Touch Interfaces for Manipulating 2D and 3D Information on a Digital Table. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 77--84. https://doi.org/10.1145/1731903.1731921

Digital Library

[26]

Chris Hand. 1997. A Survey of 3D Interaction Techniques. Computer Graphics Forum 16, 5 (Dec. 1997), 269--281. https://doi.org/10.1111/1467-8659.00194

[27]

Anders Henrysson, Joe Marshall, and Mark Billinghurst. 2007. Experiments in 3D Interaction for Mobile Phone AR. In Proceedings of the 5th International Conference on Computer Graphics and Interactive Techniques in Australia and Southeast Asia (GRAPHITE '07). ACM, New York, NY, USA, 187--194. https://doi.org/10.1145/1321261.1321295

Digital Library

[28]

Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. A Survey of Design Issues in Spatial Input. In Proceedings of the 7th Annual ACM Symposium on User Interface Software and Technology (UIST '94). ACM, New York, NY, USA, 213--222. https://doi.org/10.1145/192426.192501

Digital Library

[29]

Teresa Hirzle, Jan Gugenheimer, Florian Geiselhart, Andreas Bulling, and Enrico Rukzio. 2019. A Design Space for Gaze Interaction on Head-mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 625, 12 pages. https://doi.org/10.1145/3290605.3300855

Digital Library

[30]

Paul Issartel, Florimond Guéniat, and Mehdi Ammi. 2014. A Portable Interface for Tangible Exploration of Volumetric Data. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology (VRST '14). ACM, New York, NY, USA, 209--210. https://doi.org/10.1145/2671015.2671130

Digital Library

[31]

Paul Issartel, Florimond Guéniat, Tobias Isenberg, and Mehdi Ammi. 2017. Analysis of Locally Coupled 3D Manipulation Mappings Based on Mobile Device Motion. Presence: Teleoper. Virtual Environ. 26, 1 (Feb. 2017), 66--95. https://doi.org/10.1162/PRES_a_00287

[32]

Bret Jackson, Tung Yuen Lau, David Schroeder, Kimani C. Toussaint Jr., and Daniel F. Keefe. 2013. A Lightweight Tangible 3D Interface for Interactive Visualization of Thin Fiber Structures. IEEE Transactions on Visualization and Computer Graphics 19, 12 (Dec. 2013), 2802--2809. https://doi.org/10.1109/TVCG.2013.121

Digital Library

[33]

Bret Jackson, Tung Yuen Lau, David Schroeder, Kimani C. Toussaint Jr., and Daniel F. Keefe. 2013. A Lightweight Tangible 3D Interface for Interactive Visualization of Thin Fiber Structures. IEEE Transactions on Visualization and Computer Graphics 19, 12, 2802--2809. https://doi.org/10.1109/TVCG.2013.121

Digital Library

[34]

Robert J. K. Jacob and Linda E. Sibert. 1992. The Perceptual Structure of Multidimensional Input Device Selection. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92). ACM, New York, NY, USA, 211--218. https://doi.org/10.1145/142750.142792

[35]

Jacek Jankowski and Martin Hachet. 2013. A Survey of Interaction Techniques for Interactive 3D Environments. In Eurographics 2013 - STAR. Girona, Spain. https://hal.inria.fr/hal-00789413

[36]

Brett Jones, Rajinder Sodhi, David Forsyth, Brian Bailey, and Giuliano Maciocci. 2012. Around Device Interaction for Multiscale Navigation. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 83--92. https://doi.org/10.1145/2371574.2371589

Digital Library

[37]

Konstantin Klamka and Raimund Dachselt. 2015. Elasticcon: Elastic Controllers for Casual Interaction. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, USA, 410--419. https://doi.org/10.1145/2785830.2785849

Digital Library

[38]

Konstantin Klamka and Raimund Dachselt. 2018. ARCord: Visually Augmented Interactive Cords for Mobile Interaction. In Proceedings of the 2018 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, 6. https://doi.org/10.1145/3170427.3188456

Digital Library

[39]

Sven Kratz, Michael Rohs, Dennis Guse, Jörg Müller, Gilles Bailly, and Michael Nischt. 2012. PalmSpace: Continuous Around-Device Gestures vs. Multitouch for 3D Rotation Tasks on Mobile Devices. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12). ACM, New York, NY, USA, 181--188. https://doi.org/10.1145/2254556.2254590

Digital Library

[40]

Max Krichenbauer, Goshiro Yamamoto, Takafumi Taketom, Christian Sandor, and Hirokazu Kato. 2018. Augmented Reality versus Virtual Reality for 3D Object Manipulation. IEEE Transactions on Visualization and Computer Graphics 24, 2 (Feb. 2018), 1038--1048. https://doi.org/10.1109/TVCG.2017.2658570

[41]

Mikko Kytö, Barrett Ens, Thammathip Piumsomboon, Gun A. Lee, and Mark Billinghurst. 2018. Pinpointing: Precise Head- and Eye-Based Target Selection for Augmented Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 81:1--81:14. https://doi.org/10.1145/3173574.3173655

Digital Library

[42]

Chi-Jung Lee and Hung-Kuo Chu. 2018. Dual-MR: Interaction with Mixed Reality Using Smartphones. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (VRST '18). ACM, New York, NY, USA, Article 79, 2 pages. https://doi.org/10.1145/3281505.3281618

Digital Library

[43]

Andrea Leganchuk, Shumin Zhai, and William Buxton. 1998. Manual and Cognitive Benefits of Two-handed Input: An Experimental Study. ACM Trans. Comput.-Hum. Interact. 5, 4 (Dec. 1998), 326--359. https://doi.org/10.1145/300520.300522

Digital Library

[44]

David López, Lora Oehlberg, Candemir Doger, and Tobias Isenberg. 2016. Towards An Understanding of Mobile Touch Navigation in a Stereoscopic Viewing Environment for 3D Data Exploration. IEEE Transactions on Visualization and Computer Graphics 22, 5 (May 2016), 1616--1629. https://doi.org/10.1109/TVCG.2015.2440233

Digital Library

[45]

Paul Lubos, Gerd Bruder, and Frank Steinicke. 2014. Analysis of direct selection in head-mounted display environments. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). 11--18. https://doi.org/10.1109/3DUI.2014.6798834

[46]

Asier Marzo, Benoît Bossavit, and Martin Hachet. 2014. Combining Multi-Touch Input and Device Movement for 3D Manipulations in Mobile Augmented Reality Environments. In Proceedings of the 2Nd ACM Symposium on Spatial User Interaction (SUI '14). ACM, New York, NY, USA, 13--16. https://doi.org/10.1145/2659766.2659775

Digital Library

[47]

Daniel Mendes, Fabio Marco Caputo, Andrea Giachetti, Alfredo Ferreira, and J. Jorge. 2018. A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments. Computer Graphics Forum 0, 0 (2018). https://doi.org/10.1111/cgf.13390

[48]

Alexandre Millette and Michael J. McGuffin. 2016. DualCAD: Integrating Augmented Reality with a Desktop GUI and Smartphone Interaction. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). 21--26. https://doi.org/10.1109/ISMAR-Adjunct.2016.0030

[49]

Mark R. Mine, Frederick P. Brooks, Jr., and Carlo H. Sequin. 1997. Moving Objects in Space: Exploiting Proprioception in Virtual-environment Interaction. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '97). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 19--26. https://doi.org/10.1145/258734.258747

[50]

Atsuo Murata and Hirokazu Iwase. 2001. Extending Fitts' law to a three-dimensional pointing task. Human movement science 20, 6 (2001), 791--805.

[51]

Mathieu Nancel, Julie Wagner, Emmanuel Pietriga, Olivier Chapuis, and Wendy Mackay. 2011. Mid-air Pan-and-zoom on Wall-sized Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 177--186. https://doi.org/10.1145/1978942.1978969

Digital Library

[52]

Anh Nguyen and Amy Banic. 2015. 3DTouch: A Wearable 3D Input Device for 3D Applications. In 2015 IEEE Virtual Reality (VR). 55--61. https://doi.org/10.1109/VR.2015.7223324

[53]

Alex Olwal and Steven Feiner. 2009. Spatially Aware Handhelds for High-Precision Tangible Interaction with Large Displays. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI '09). ACM, New York, NY, USA, 181--188. https://doi.org/10.1145/1517664.1517705

Digital Library

[54]

Ivan Poupyrev, Suzanne Weghorst, Mark Billinghurst, and Tadao Ichikawa. 1997. A Framework and Testbed for Studying Manipulation Techniques for Immersive VR. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST '97). ACM, New York, NY, USA, 21--28. https://doi.org/10.1145/261135.261141

Digital Library

[55]

Alejandro Rodríguez and Alejandro León. 2015. Smartphone-based remote 3D interaction for digital heritage applications. In 2015 Digital Heritage, Vol. 1. 297--300. https://doi.org/10.1109/DigitalHeritage.2015.7413886

[56]

Shun Sekiguchi and Takashi Komuro. 2017. VolGrab: Realizing 3D View Navigation by Aerial Hand Gestures. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 2064--2069. https://doi.org/10.1145/3027063.3053108

Digital Library

[57]

Mickael Sereno, Lonni Besançon, and Tobias Isenberg. 2019. Supporting Volumetric Data Visualization and Analysis by Combining Augmented Reality Visuals with Multi-Touch Input. EuroVis., 3 pages. https://hal.inria.fr/hal-02123904 Poster.

[58]

Jie Song, Gábor Sörös, Fabrizio Pece, Sean Ryan Fanello, Shahram Izadi, Cem Keskin, and Otmar Hilliges. 2014. In-Air Gestures Around Unmodified Mobile Devices. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 319--329. https://doi.org/10.1145/2642918.2647373

Digital Library

[59]

Peng Song, Wooi Boon Goh, Chi-Wing Fu, Qiang Meng, and Pheng-Ann Heng. 2011. WYSIWYF: Exploring and Annotating Volume Data with a Tangible Handheld Device. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1333--1342. https://doi.org/10.1145/1978942.1979140

Digital Library

[60]

Marco Speicher, Florian Daiber, Sven Gehring, and Antonio Krüger. 2016. Exploring 3D Manipulation on Large Stereoscopic Displays. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis '16). ACM, New York, NY, USA, 59--66. https://doi.org/10.1145/2914920.2915018

Digital Library

[61]

Martin Spindler, Wolfgang Büschel, and Raimund Dachselt. 2012. Use Your Head: Tangible Windows for 3D Information Spaces in a Tabletop Environment. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 245--254. https://doi.org/10.1145/2396636.2396674

Digital Library

[62]

Martin Spindler, Martin Schuessler, Marcel Martsch, and Raimund Dachselt. 2014. Pinch-Drag-Flick vs. Spatial Input: Rethinking Zoom & Pan on Mobile Displays. In Proceedings of the Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1113--1122. http://doi.acm.org/10.1145/2556288.2557028

Digital Library

[63]

Sophie Stellmach and Raimund Dachselt. 2012. Investigating Gaze-supported Multimodal Pan and Zoom. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '12). ACM, New York, NY, USA, 357--360. https://doi.org/10.1145/2168556.2168636

Digital Library

[64]

Junwei Sun, Wolfgang Stuerzlinger, and Dmitri Shuralyov. 2016. SHIFT-Sliding and DEPTH-POP for 3D Positioning. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI '16). ACM, New York, NY, USA, 69--78. https://doi.org/10.1145/2983310.2985748

Digital Library

[65]

Vanessa Vuibert, Wolfgang Stuerzlinger, and Jeremy R. Cooperstock. 2015. Evaluation of Docking Task Performance Using Mid-Air Interaction Techniques. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI '15). ACM, New York, NY, USA, 44--52. https://doi.org/10.1145/2788940.2788950

[66]

Philipp Wacker, Oliver Nowak, Simon Voelker, and Jan Borchers. 2019. ARPen: Mid-Air Object Manipulation Techniques for a Bimanual AR System with Pen & Smartphone. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 619, 12 pages. https://doi.org/10.1145/3290605.3300849

Digital Library

[67]

Chadwick A. Wingrave, Yonca Haciahmetoglu, and Doug A. Bowman. 2006. Overcoming World in Miniature Limitations by a Scaled and Scrolling WIM. In 3D User Interfaces (3DUI'06). 11--16. https://doi.org/10.1109/VR.2006.106

[68]

Robert Xiao, Julia Schwarz, Nick Throm, Andrew D Wilson, and Hrvoje Benko. 2018. MRTouch: Adding Touch Input to Head-Mounted Mixed Reality. IEEE Transactions on Visualization and Computer Graphics 24, 4 (April 2018), 1653--1660. https://doi.org/10.1109/TVCG.2018.2794222

Digital Library

[69]

Wenge Xu, Hai-Ning Liang, Yuxuan Zhao, Difeng Yu, and Diego Monteiro. 2019. DMove: Directional Motion-based Interaction for Augmented Reality Head-Mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 444, 14 pages. https://doi.org/10.1145/3290605.3300674

Digital Library

[70]

Lingyun Yu, Pjotr Svetachov, Petra Isenberg, Maarten H Everts, and Tobias Isenberg. 2010. FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces. IEEE Transactions on Visualization and Computer Graphics 16, 6 (Nov. 2010), 1613--1622. https://doi.org/10.1109/TVCG.2010.157

Cited By

Zhou XLee BOrtega FBatmaz AYang Y(2024)Lights, Headset, Tablet, Action: Exploring the Use of Hybrid User Interfaces for Immersive Situated AnalyticsProceedings of the ACM on Human-Computer Interaction10.1145/36981478:ISS(517-539)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698147
Takeyama YNagayama KChoi MShizuki B(2024)PhoneCanvas: 3D Sketching System Using a Depth Camera-Equipped Smartphone as a CanvasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682078(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682078
Perelman GSerrano MDubois E(2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3648613
Show More Cited By

Index Terms

Investigating Smartphone-based Pan and Zoom in 3D Data Spaces in Augmented Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
    2. Interaction techniques

Recommendations

Moving Inside the Box: Interacting with Interpretation of Historical Artefacts Through Tangible Augmented Reality
MMAsia '23: Proceedings of the 5th ACM International Conference on Multimedia in Asia

We present ARcheoBox, a walk-up-and-use prototype for interacting with interpretation of historical artefacts using tangible augmented reality. ARcheoBox enables users to manipulate virtual representations and interact with interpretation of historical ...
Smartphone as an augmented reality authoring tool via multi-touch based 3D interaction method
VRCAI '12: Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

In this paper we present an Augmented Reality (AR) authoring tool for smartphones which facilitates intuitive interactions that manipulate the augmented virtual objects in real-time. A novel 3D interaction method using multi-touch interface and camera ...
Design and Evaluation of Zoom-based 3D Interaction Technique for Augmented Reality
VRIC '17: Proceedings of the Virtual Reality International Conference - Laval Virtual 2017

Real-time 3D interaction with augmented reality environments is one of the main features of any AR system. However, selecting and manipulating distal 3D virtual objects in AR still suffer from lack of accuracy and precision. In this paper, we propose an ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '19: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

October 2019

646 pages

ISBN:9781450368254

DOI:10.1145/3338286

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

MobileHCI '19

Sponsor:

SIGCHI

MobileHCI '19: 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

October 1 - 4, 2019

Taipei, Taiwan

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
937
Total Downloads

Downloads (Last 12 months)125
Downloads (Last 6 weeks)20

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou XLee BOrtega FBatmaz AYang Y(2024)Lights, Headset, Tablet, Action: Exploring the Use of Hybrid User Interfaces for Immersive Situated AnalyticsProceedings of the ACM on Human-Computer Interaction10.1145/36981478:ISS(517-539)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698147
Takeyama YNagayama KChoi MShizuki B(2024)PhoneCanvas: 3D Sketching System Using a Depth Camera-Equipped Smartphone as a CanvasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682078(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682078
Perelman GSerrano MDubois E(2024)Exploiting Physical Referent Features as Input for Multidimensional Data Selection in Augmented RealityACM Transactions on Computer-Human Interaction10.1145/364861331:4(1-40)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3648613
Wu GQian JCastelo Quispe SChen SRulff JSilva C(2024)ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642772(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642772
Friedl‐Knirsch JPointecker FPfistermüller SStach CAnthes CRoth D(2024)A Systematic Literature Review of User Evaluation in Immersive AnalyticsComputer Graphics Forum10.1111/cgf.1511143:3Online publication date: 10-Jun-2024
https://doi.org/10.1111/cgf.15111
Chulpongsatorn NWillett WSuzuki R(2023)HoloTouch: Interacting with Mixed Reality Visualizations Through Smartphone ProxiesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585738(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585738
Büschel WKrug KKlamka KDachselt R(2023)Demonstrating CleAR Sight: Transparent Interaction Panels for Augmented RealityExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583891(1-5)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583891
Schön DKosch TMüller FSchmitz MGünther SBommhardt LMühlhäuser M(2023)Tailor Twist: Assessing Rotational Mid-Air Interactions for Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581461(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581461
Hubenschmid SZagermann JLeicht DReiterer HFeuchtner T(2023)ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial MemoryProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581438(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581438
Bang SWoo W(2023)Enhancing the Reading Experience on AR HMDs by Using Smartphones as Assistive Displays2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00053(378-386)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00053
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents