poster

HoloLens is more than air Tap: natural and intuitive interaction with holograms

Authors:

Markus Funk,

Mareike Kritzler,

Florian MichahellesAuthors Info & Claims

IoT '17: Proceedings of the Seventh International Conference on the Internet of Things

Article No.: 31, Pages 1 - 2

https://doi.org/10.1145/3131542.3140267

Published: 22 October 2017 Publication History

Get Access

Abstract

Augmented Reality (AR) is becoming more and more popular and many applications across multiple domains are developed on AR hardware such as the Microsoft HoloLens or similar Head-Mounted Displays (HMD). Most of the AR applications are visualizing information that was not visible before and enable interaction with this information using voice input, gaze tracking, and gesture interaction. However, to be consistent across all applications running on an AR device, the gestures that are available for developers are very limited. In our use case, using a Microsoft HoloLens, this is just an Air Tap and a Manipulation gesture. While this is great for users, as they only have to learn a defined amount of gestures, it is not always easy for developers to create a natural interaction experience, as the gestures that are considered natural, depend on the scenario. In this paper, we are using an additional sensor, a Microsoft Kinect, in order to allow users to interact naturally and intuitively with holographic content that is displayed on a HoloLens. As a proof-of-concept we give five examples of gestures using natural interaction for HoloLens.

References

[1]

Volkert Buchmann, Stephen Violich, Mark Billinghurst, and Andy Cockburn. 2004. FingARtips: gesture based direct manipulation in Augmented Reality. In Proc. GRAPHITE'04. ACM, 212--221.

Digital Library

Google Scholar

[2]

Tilman Dingler, Markus Funk, and Florian Alt. 2015. Interaction proxemics: Combining physical spaces for seamless gesture interaction. In Proceedings of the 4th International Symposium on Pervasive Displays. ACM, 107--114.

Digital Library

Google Scholar

[3]

Thammathip Piumsomboon, Adrian Clark, Mark Billinghurst, and Andy Cockburn. 2013. User-defined gestures for augmented reality. In CHI'13 EA. ACM, 955--960.

Digital Library

Google Scholar

Cited By

View all

Liu YBitter JSpierling U(2023)Evaluating Interaction Challenges of Head-Mounted Device-Based Augmented Reality Applications for First-Time Users at Museums and ExhibitionsCulture and Computing10.1007/978-3-031-34732-0_11(150-163)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-34732-0_11
Xing YShell JFahy CXie TKwan HXie W(2022)Web XR User Interface Research: Design 3D Layout Framework in Static WebsitesApplied Sciences10.3390/app1211560012:11(5600)Online publication date: 31-May-2022
https://doi.org/10.3390/app12115600
Long ZDong HSaddik A(2022)Interacting With New York City Data by HoloLens Through Remote RenderingIEEE Consumer Electronics Magazine10.1109/MCE.2022.316596111:5(64-72)Online publication date: 1-Sep-2022
https://doi.org/10.1109/MCE.2022.3165961
Show More Cited By

Recommendations

ShARe: Enabling Co-Located Asymmetric Multi-User Interaction for Augmented Reality Head-Mounted Displays
UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

Head-Mounted Displays (HMDs) are the dominant form of enabling Virtual Reality (VR) and Augmented Reality (AR) for personal use. One of the biggest challenges of HMDs is the exclusion of people in the vicinity, such as friends or family. While recent ...
Experiencing Social Augmented Reality in Public Spaces
UbiComp/ISWC '21 Adjunct: Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers

We present various views on the future use of augmented reality in public spaces. The views address enhanced walking, social activity, appropriation of public spaces, and futuristic social aspects of future outdoor augmented reality. Although we often ...
FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

Optically see-through (OST) augmented reality glasses can overlay spatially-registered computer-generated content onto the real world. However, current optical designs and weight considerations limit their diagonal field of view to less than 40 degrees, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IoT '17: Proceedings of the Seventh International Conference on the Internet of Things

October 2017

211 pages

ISBN:9781450353182

DOI:10.1145/3131542

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2017

Check for updates

Author Tags

Qualifiers

Poster

Conference

IoT '17

IoT '17: 7th International Conference on the Internet of Things

October 22 - 25, 2017

Linz, Austria

Acceptance Rates

Overall Acceptance Rate 28 of 84 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
675
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)8

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liu YBitter JSpierling U(2023)Evaluating Interaction Challenges of Head-Mounted Device-Based Augmented Reality Applications for First-Time Users at Museums and ExhibitionsCulture and Computing10.1007/978-3-031-34732-0_11(150-163)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-34732-0_11
Xing YShell JFahy CXie TKwan HXie W(2022)Web XR User Interface Research: Design 3D Layout Framework in Static WebsitesApplied Sciences10.3390/app1211560012:11(5600)Online publication date: 31-May-2022
https://doi.org/10.3390/app12115600
Long ZDong HSaddik A(2022)Interacting With New York City Data by HoloLens Through Remote RenderingIEEE Consumer Electronics Magazine10.1109/MCE.2022.316596111:5(64-72)Online publication date: 1-Sep-2022
https://doi.org/10.1109/MCE.2022.3165961
Bhatia NMatar O(2022)Learning and Teaching Fluid Dynamics using Augmented and Mixed Reality2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct57072.2022.00186(865-869)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00186
Wang TQian XHe FHu XCao YRamani K(2021)GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality ApplicationsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474769(552-567)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474769
Jin YMa MZhu Y(2021)A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented realityMultimedia Tools and Applications10.1007/s11042-021-11723-0Online publication date: 30-Dec-2021
https://doi.org/10.1007/s11042-021-11723-0
Zhou ZJiang SYang ZXu BJiang B(2021)Surgical navigation system for brachytherapy based on mixed reality using a novel stereo registration methodVirtual Reality10.1007/s10055-021-00503-8Online publication date: 15-Feb-2021
https://doi.org/10.1007/s10055-021-00503-8
ERDOĞAN KDURDU ACEYLAN R(2020)RESHAPING HUMAN INTENTION ON HUMAN-MACHINE INTERACTION BY USING HOLOGRAMSİnsan - Makine Etkileşiminde Hologram Kullanılarak İnsan Niyetinin YönlendirilmesiKonya Journal of Engineering Sciences10.36306/konjes.8221268(1-8)Online publication date: 31-Dec-2020
https://doi.org/10.36306/konjes.822126
ISHIKAWA DFUKUDA TYABUKI N(2020)A REMOTE SHARING METHOD USING MIXED REALITY FOR 3D PHYSICAL OBJECTS THAT ENABLES HIGH-SPEED POINT CLOUD SEGMENTATION AND RECEIVER'S OBJECT MANIPULATION高速点群セグメンテーションと受信者のオブジェクト操作を可能とする３次元実物体の複合現実による遠隔共有手法Journal of Environmental Engineering (Transactions of AIJ)10.3130/aije.85.101785:778(1017-1026)Online publication date: 2020
https://doi.org/10.3130/aije.85.1017
Essmiller KAsino TIbukun AAlvarado-Albertorio FChaivisit SDo TKim Y(2020)Exploring mixed reality based on self-efficacy and motivation of usersResearch in Learning Technology10.25304/rlt.v28.233128Online publication date: 21-Feb-2020
https://doi.org/10.25304/rlt.v28.2331
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

ShARe: Enabling Co-Located Asymmetric Multi-User Interaction for Augmented Reality Head-Mounted Displays

Experiencing Social Augmented Reality in Public Spaces

FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality