research-article

Open access

Aristo: An Augmented Reality Platform for Immersion and Interactivity

Authors:

Bo Wang,

Edward Y. ChangAuthors Info & Claims

MM '17: Proceedings of the 25th ACM international conference on Multimedia

Pages 690 - 698

https://doi.org/10.1145/3123266.3123308

Published: 19 October 2017 Publication History

PDF eReader

Abstract

This paper introduces our augmented reality platform, Aristo, which aims to provide users with physical feedback when interacting with virtual objects. We use Vivepaper, a product we launched on Aristo in 2016, to illustrate the platform's performance requirements and key algorithms. We specifically depict Vivepaper's tracking and gesture recognition algorithms, which involve several trade-offs between speed and accuracy to achieve an immersive experience.

References

[1]

Lorenzo Baraldi, Francesco Paci, Giuseppe Serra, Luca Benini, and Rita Cucchiara. 2014. Gesture recognition in ego-centric videos using dense trajectories and hand segmentation Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 688--693.

Digital Library

Google Scholar

[2]

Ross Bencina, Martin Kaltenbrunner, and Sergi Jorda. 2005. Improved topological fiducial tracking in the reactivision system Computer Vision and Pattern Recognition-Workshops, 2005. CVPR Workshops. IEEE Computer Society Conference on. IEEE, 99--99.

Digital Library

Google Scholar

[3]

Filippo Bergamasco, Andrea Albarelli, Luca Cosmo, Emanuele Rodola, and Andrea Torsello. 2016. An accurate and robust artificial marker based on cyclic codes. IEEE transactions on pattern analysis and machine intelligence, Vol. 38, 12 (2016), 2359--2373.

Digital Library

Google Scholar

[4]

Alejandro Betancourt, Lucio Marcenaro, Emilia Barakova, Matthias Rauterberg, and Carlo Regazzoni. 2016. GPU accelerated left/right hand-segmentation in first person vision European Conference on Computer Vision. Springer, 504--517.

Google Scholar

[5]

Alejandro Betancourt, Pietro Morerio, Emilia Barakova, Lucio Marcenaro, Matthias Rauterberg, and Carlo Regazzoni. 2017. Left/right hand segmentation in egocentric videos. Computer Vision and Image Understanding Vol. 154 (2017), 73--81.

Digital Library

Google Scholar

[6]

Che-Han Chang, Chun-Nan Chou, and Edward Y. Chang. 2017. CLKN: Cascaded Lucas-Kanade Networks for Image Alignment The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Google Scholar

[7]

Kyusung Cho, Juho Lee, JS Lee, and HS Yang. 2007. A realistic e-learning system based on mixed reality 13th International Conference on Virtual Systems and Multimedia. 57--64.

Google Scholar

[8]

Andrew I Comport, Eric Marchand, Muriel Pressigout, and Francois Chaumette. 2006. Real-time markerless tracking for augmented reality: the virtual visual servoing framework. IEEE Transactions on visualization and computer graphics, Vol. 12, 4 (2006), 615--628.

Digital Library

Google Scholar

[9]

Enrico Costanza and John Robinson. 2003. A Region Adjacency Tree Approach to the Detection and Design of Fiducials. (2003).

Google Scholar

[10]

Mark Fiala. 2005 a. ARTag, a fiducial marker system using digital techniques Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, Vol. Vol. 2. IEEE, 590--596.

Digital Library

Google Scholar

[11]

Mark Fiala. 2005 b. Comparing artag and artoolkit plus fiducial marker systems Haptic Audio Visual Environments and their Applications, 2005. IEEE International Workshop on. IEEE, 6--pp.

Google Scholar

[12]

S. Garrido-Jurado, R. Mu noz Salinas, F.J. Madrid-Cuevas, and M.J. Marín-Jiménez. 2014. Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition, Vol. 47, 6 (2014), 2280--2292.

Digital Library

Google Scholar

Cited By

View all

Chao YHu SChiu HHuang PTsai HChuang Y(2021)The effects of an immersive 3d interactive video program on improving student nurses' nursing skill competence: A randomized controlled trial studyNurse Education Today10.1016/j.nedt.2021.104979103(104979)Online publication date: Aug-2021
https://doi.org/10.1016/j.nedt.2021.104979
Qiu XShishido HSakamoto RKitahara I(2020)Interactive e-Book Linking Text and Multi-View Video2020 IEEE 9th Global Conference on Consumer Electronics (GCCE)10.1109/GCCE50665.2020.9291752(813-817)Online publication date: 13-Oct-2020
https://doi.org/10.1109/GCCE50665.2020.9291752
Hoppe AKaucher Lvan de Camp FStiefelhagen R(2020)Calibration of Diverse Tracking Systems to Enable Local Collaborative Mixed Reality ApplicationsVirtual, Augmented and Mixed Reality. Design and Interaction10.1007/978-3-030-49695-1_5(63-80)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-49695-1_5
Show More Cited By

Index Terms

Aristo: An Augmented Reality Platform for Immersion and Interactivity
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Mixed / augmented reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Garden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Wearable head-mounted 3D tactile display application scenarios
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Current generation virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) usually include no or only a single vibration motor for haptic feedback and do not use it for guidance. In a previous work, we presented HapticHead, a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MM '17: Proceedings of the 25th ACM international conference on Multimedia

October 2017

2028 pages

ISBN:9781450349062

DOI:10.1145/3123266

General Chairs:
Qiong Liu
FXPAL, USA
,
Rainer Lienhart
Universität Augsburg, Germany
,
Haohong Wang
TCL America, USA
,
Program Chairs:
Sheng-Wei "Kuan-Ta" Chen
Academia Sinica, Taiwan
,
Susanne Boll
University of Oldenburg, Germany
,
Phoebe Chen
La Trobe University, Australia
,
Gerald Friedland
Lawrence Livermore National Lab, USA
,
Jia Li
Google, USA
,
Shuicheng Yan
Qihoo 360, China

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '17

Sponsor:

SIGMM

MM '17: ACM Multimedia Conference

October 23 - 27, 2017

California, Mountain View, USA

Acceptance Rates

MM '17 Paper Acceptance Rate 189 of 684 submissions, 28%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
756
Total Downloads

Downloads (Last 12 months)60
Downloads (Last 6 weeks)13

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chao YHu SChiu HHuang PTsai HChuang Y(2021)The effects of an immersive 3d interactive video program on improving student nurses' nursing skill competence: A randomized controlled trial studyNurse Education Today10.1016/j.nedt.2021.104979103(104979)Online publication date: Aug-2021
https://doi.org/10.1016/j.nedt.2021.104979
Qiu XShishido HSakamoto RKitahara I(2020)Interactive e-Book Linking Text and Multi-View Video2020 IEEE 9th Global Conference on Consumer Electronics (GCCE)10.1109/GCCE50665.2020.9291752(813-817)Online publication date: 13-Oct-2020
https://doi.org/10.1109/GCCE50665.2020.9291752
Hoppe AKaucher Lvan de Camp FStiefelhagen R(2020)Calibration of Diverse Tracking Systems to Enable Local Collaborative Mixed Reality ApplicationsVirtual, Augmented and Mixed Reality. Design and Interaction10.1007/978-3-030-49695-1_5(63-80)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-49695-1_5
Chang FChang JChou CChang E(2019)Toward Fusing Domain Knowledge with Generative Adversarial Networks to Improve Supervised Learning for Medical Diagnoses2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR)10.1109/MIPR.2019.00022(77-84)Online publication date: Mar-2019
https://doi.org/10.1109/MIPR.2019.00022
Epstein DFeldman D(2018)Quadcopter Tracks Quadcopter via Real-Time Shape FittingIEEE Robotics and Automation Letters10.1109/LRA.2017.27736683:1(544-550)Online publication date: Jan-2018
https://doi.org/10.1109/LRA.2017.2773668
Patil KNagwani NTripathi S(2018)Utilizing Clustering Techniques for Improving the BoxplotsCommunication, Networks and Computing10.1007/978-981-13-2372-0_11(121-132)Online publication date: 10-Oct-2018
https://doi.org/10.1007/978-981-13-2372-0_11
Chang ELiu QLienhart RWang HChen SBoll SChen PFriedland GLi JYan S(2017)DeepQProceedings of the 25th ACM international conference on Multimedia10.1145/3123266.3130875(1068-1068)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3123266.3130875

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction

Haptics in Augmented Reality

Wearable head-mounted 3D tactile display application scenarios