short-paper

Project Esky: Enabling High Fidelity Augmented Reality on an Open Source Platform

Authors:

Rompapas Damien Constantine,

Daniel Flores Quiros,

Charlton Rodda,

Bryan Christopher Brown,

Noah Benjamin Zerkin,

Alvaro CassinelliAuthors Info & Claims

ISS Companion '20: Companion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces

Pages 61 - 63

https://doi.org/10.1145/3380867.3426220

Published: 08 November 2020 Publication History

Get Access

Abstract

This demonstration showcases a complete Open-Source Augmented Reality (AR) modular platform capable of high fidelity natural hand-interactions with virtual content, high field of view, and spatial mapping for environment interactions. We do this via several live desktop demonstrations. Finally, included in this demonstration is a completed open source schematic, allowing anyone interested in utilizing our proposed platform to engage with high fidelity AR. It is our hope that the work described in this demo will be a stepping stone towards bringing high-fidelity AR content to researchers and commodity users alike.

Supplemental Material

MP4 File

Supplemental video

Download
152.73 MB

References

[1]

Ronald T Azuma et al. 1999. The challenge of making augmented reality work outdoors. Mixed reality: Merging real and virtual worlds (1999), 379--390.

Google Scholar

[2]

Magic Leap Company. [n.d.]. Magic leap. https://www.magicleap.com/en-us

Google Scholar

[3]

Douglas Lanman and Gabriel Taubin. 2009. Build your own 3D scanner: 3D photography for beginners. In ACM SIGGRAPH 2009 Courses. 1--94.

Digital Library

Google Scholar

[4]

Microsoft. [n.d.]. Microsoft HoloLens 2. https://en.wikipedia.org/wiki/HoloLens_2

Google Scholar

[5]

Wayne Piekarski, Ben Avery, Bruce H Thomas, and Pierre Malbezin. 2004. Integrated head and hand tracking for indoor and outdoor augmented reality. In IEEE Virtual Reality 2004. IEEE, 11--276.

Crossref

Google Scholar

[6]

Wayne Piekarski and Bruce Thomas. 2002. ARQuake: the outdoor augmented reality gaming system. Commun. ACM, Vol. 45, 1 (2002), 36--38.

Digital Library

Google Scholar

[7]

Damien Constantine Rompapas, Christian Sandor, Alexander Plopski, Daniel Saakes, Joongi Shin, Takafumi Taketomi, and Hirokazu Kato. 2019. Towards large scale high fidelity collaborative augmented reality. Computers & Graphics, Vol. 84 (2019), 24--41.

Digital Library

Google Scholar

[8]

Ultraleap. [n.d.]. Project North Star. https://project-north-star.gitbook.io/project-north-star/

Google Scholar

Cited By

View all

Spallone RVitali MPalma VRibotta LPupi E(2023)Castello di Mirafiori: Reconstructive Modelling and WebARBeyond Digital Representation10.1007/978-3-031-36155-5_20(309-327)Online publication date: 2-Sep-2023
https://doi.org/10.1007/978-3-031-36155-5_20
Campbell JCassinelli ASaakes DRompapas D(2022)B-Handy: An Augmented Reality System for Biomechanical Measurement2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00339(976-977)Online publication date: Mar-2022
https://doi.org/10.1109/VRW55335.2022.00339
Lawrence LLee GBillinghurst MRompapas D(2022)3DColAR: Exploring 3D Color Selection and Surface Painting for Head Worn Augmented Reality using Hand Gestures2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00338(974-975)Online publication date: Mar-2022
https://doi.org/10.1109/VRW55335.2022.00338
Show More Cited By

Index Terms

Project Esky: Enabling High Fidelity Augmented Reality on an Open Source Platform
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
    2. Interactive systems and tools
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments

Recommendations

Project Esky: Enabling High Fidelity Extended Reality on an Open Source Platform
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

This demonstration showcases the improvements made to Project Esky[2], an open source Extended Reality (XR) software framework capable of high fidelity natural hand-interactions with virtual content. In combination with showing our temporal re-...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical Systems

As shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ISS Companion '20: Companion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces

November 2020

127 pages

ISBN:9781450375269

DOI:10.1145/3380867

General Chairs:
Joaquim Jorge
INESC-ID Lisboa, University of Lisbon
,
Alfredo Ferreira
INESC-ID Lisboa, University of Lisbon
,
Program Chairs:
Nicolai Marquardt
University College London
,
Fanny Chevalier
University of Toronto

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ISS '20

Sponsor:

SIGCHI

ISS '20: Interactive Surfaces and Spaces

November 8 - 11, 2020

Virtual Event, Portugal

Acceptance Rates

Overall Acceptance Rate 147 of 533 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
143
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Spallone RVitali MPalma VRibotta LPupi E(2023)Castello di Mirafiori: Reconstructive Modelling and WebARBeyond Digital Representation10.1007/978-3-031-36155-5_20(309-327)Online publication date: 2-Sep-2023
https://doi.org/10.1007/978-3-031-36155-5_20
Campbell JCassinelli ASaakes DRompapas D(2022)B-Handy: An Augmented Reality System for Biomechanical Measurement2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00339(976-977)Online publication date: Mar-2022
https://doi.org/10.1109/VRW55335.2022.00339
Lawrence LLee GBillinghurst MRompapas D(2022)3DColAR: Exploring 3D Color Selection and Surface Painting for Head Worn Augmented Reality using Hand Gestures2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00338(974-975)Online publication date: Mar-2022
https://doi.org/10.1109/VRW55335.2022.00338
Campbell JTa VCassinelli ARompapas D(2021)Project Ariel: An Open Source Augmented Reality Headset for Industrial ApplicationsAdjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460418.3479359(462-466)Online publication date: 21-Sep-2021
https://dl.acm.org/doi/10.1145/3460418.3479359
Rompapas DRodda CBrown BZerkin NCassinelli A(2021)Project Esky: an Open Source Software Framework for High Fidelity Extended RealityExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451804(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451804
Rompapas DRodda CBrown BZerkin NCassinelli A(2021)Project Esky: Enabling High Fidelity Extended Reality on an Open Source PlatformExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451535(1-2)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451535

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Project Esky: Enabling High Fidelity Extended Reality on an Open Source Platform

Haptics in Augmented Reality

Augmented reality as perceptual reality