research-article

Digilog miniature: real-time, immersive, and interactive AR on miniatures

Authors:

Woontack WooAuthors Info & Claims

VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

Pages 161 - 168

https://doi.org/10.1145/1900179.1900214

Published: 12 December 2010 Publication History

Abstract

In this paper, we propose a framework to realize a real-time, immersive, and interactive Augmented Reality running on a miniature. We achieve these challenging goals by harmonizing unknown tracking data generation, structure-supported marker-less tracking, and user-event handling within VR authoring tool. We cluster unknown 3D keypoints by using selective keyframe-based 3D reconstruction for real-time parallel detection by tracking. Afterwards, we align 3D keypoints and CAD models by using user-assisted iterative fitting method to resolve occlusions and shadows between real and virtual objects. At last, we retrieve active/passive commands by interpreting events from users' speech, ray-pointing interface, and camera distance to interact with the augmented contents. We developed the digilog miniature system to show validity of the proposed framework. According to experimental results, the system worked about 20 frames per second: 7.82 ms for tracking, 38.35 ms for contents rendering. The proposed framework can be applied to storytelling, manufacturing simulation, urban planning and so on.

References

[1]

Billinghurst, M., Kato, H., and Poupyrev, I. 2001. The magicbook - moving seamlessly between reality and virtuality. Computer Graphics and Applications, IEEE 21, 3 (May), 6--8.

Digital Library

[2]

Castle, R. O., and Murray, D. W. 2009. Object Recognition and Localization while Tracking and Mapping. In IEEE/ACM International Symposium on Mixed and Augmented Reality.

Digital Library

[3]

Fischler, M. A., and Bolles, R. C. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6, 381--395.

Digital Library

[4]

F. Moreno-Noguer, V. Lepetit, and P. Fua. 2007. Accurate non-iterative o(n) solution to the pnp problem. In IEEE International Conference on Computer Vision.

[5]

Ha, T., Lee, Y., and Woo, W. 2010. Digilog book for temple bell tolling experience based on interactive augmented reality. Virtual Reality, 1--15. 10.1007/s10055-010-0164-8.

Digital Library

[6]

Kato, H., and Billinghurst, M. 1999. Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In IEEE/ACM International Workshop on Augmented Reality, 85--94.

Digital Library

[7]

Kim, K., Lepetit, V., and Woo, W. 2010. Scalable real-time planar targets tracking for digilog books. The Visual Computer 26, 1145--1154. 10.1007/s00371-010-0490-6.

Digital Library

[8]

Klein, G., and Murray, D. 2007. Parallel Tracking and Mapping for Small AR Workspaces. In IEEE/ACM International Symposium on Mixed and Augmented Reality.

Digital Library

[9]

Lee, T., and Hollerer, T. 2008. Hybrid feature tracking and user interaction for markerless augmented reality. Virtual Reality Conference, 2008. VR '08. IEEE (Feb), 145--152.

[10]

Lourakis, M. A., and Argyros, A. 2009. SBA: A Software Package for Generic Sparse Bundle Adjustment. ACM Trans. Math. Software 36, 1, 1--30.

Digital Library

[11]

Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2 (Nov), 91--110.

Digital Library

[12]

Nister, D., and Stewenius, H. 2006. Scalable recognition with a vocabulary tree. In IEEE Conference on Computer Vision and Pattern Recognition.

Digital Library

[13]

Open Computer Vision Library. 2010. http://sourceforge.net/projects/opencvlibrary/.

[14]

Pan, Q., Reitmayr, G., and Drummond, T. 2009. Interactive Model Reconstruction with User Guidance. In IEEE/ACM International Symposium on Mixed and Augmented Reality.

Digital Library

[15]

Park, H., Oh, J., Seo, B., and Park, J. 2010. Automatic confidence adjustment of visual cues in modelbased camera tracking. Computer Animation and Virtual Worlds (Jan).

Digital Library

[16]

Pilet, J., Geiger, A., Lagger, P., Lepetit, V., and Fua, P. 2006. An all-in-one solution to geometric and photometric calibration. In IEEE/ACM International Symposium on Mixed and Augmented Reality, 69--78.

Digital Library

[17]

Point Grey Research. 2010. FleaMV. http://www.ptgrey.com/.

[18]

Simon, G. 2010. In-Situ 3D Sketching Using a Video Camera as an Interaction and Tracking Device. In Eurographics.

[19]

Skrypnyk, I., and Lowe, D. 2004. Scene Modelling, Recognition and Tracking with Invariant Image Features. In IEEE/ACM International Symposium on Mixed and Augmented Reality.

Digital Library

[20]

Van den Hengel, A., Dick, A., Thormählen, T., Ward, B., and Torr, P. H. S. 2007. VideoTrace: Rapid Interactive Scene Modelling from Video. In SIGGRAPH.

Digital Library

[21]

Van den Hengel, A., Hill, R., Ward, B., and Dick, A. 2009. In Situ Image-Based Modeling. In IEEE/ACM International Symposium on Mixed and Augmented Reality.

Digital Library

[22]

Wu, C., 2007. SiftGPU: A GPU Implementation of Scale Invariant Feature Transform (SIFT).

[23]

Zhou, Z., Cheok, A., Pan, J., and Li, Y. 2004. Magic story cube: an interactive tangible interface for storytelling. ACM SIGCHI International Conference on Advances in computer entertainment technology (Jan).

Digital Library

[24]

Zhou, Z., Cheok, A., Tedjokusumo, J., and Omer, G. 2008. wizqubestm-a novel tangible interface for interactive storytelling in mixed reality. International Journal of Virtual Reality (Jan).

Cited By

Żydowicz WSkokowski JMarano LPolom K(2024)Current Trends and Beyond Conventional Approaches: Advancements in Breast Cancer Surgery through Three-Dimensional Imaging, Virtual Reality, Augmented Reality, and the Emerging MetaverseJournal of Clinical Medicine10.3390/jcm1303091513:3(915)Online publication date: 5-Feb-2024
https://doi.org/10.3390/jcm13030915
Liu TQuek FGomez G(2024)Engaging Children in Storytelling Through Tabletop Play: Exploring Construction of Story Ideas through Enactive Actions and VocalizationsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655751(371-378)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655751
Macedo MApolinario A(2023)Occlusion Handling in Augmented Reality: Past, Present and FutureIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311786629:2(1590-1609)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TVCG.2021.3117866
Show More Cited By

Index Terms

Digilog miniature: real-time, immersive, and interactive AR on miniatures
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Shape inference
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
    2. Shape modeling
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Miniature AR: Multi-view 6DOF Virtual Object Visualization for a Miniature Diorama
VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

We describe a miniature diorama AR system called ‘Miniature AR’ which can be applied to a mechanical diorama to extend the content’s feasibility by overlapping virtual objects on the complex diorama structure. The previous AR researches for the diorama ...
Miniature alive: augmented reality-based interactive digilog experience in miniature exhibition
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

In this paper, we present Miniature Alive, a next-generation interactive miniature exhibition that provides a DigiLog experience that combines aesthetic/spatial feelings with an analog miniature and dynamic interaction with digitalized 3D content by ...
Digilog book for temple bell tolling experience based on interactive augmented reality

We first present the concept of the Digilog Book, an augmented paper book that provides additional multimedia content stimulating readers' five senses using augmented reality (AR) technologies. We also develop a prototype to show the usefulness and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

December 2010

399 pages

ISBN:9781450304597

DOI:10.1145/1900179

General Chairs:
Hyun Seung Yang
KAIST, Korea
,
Kazumasa Enami
National Institute of Information and Communications Technology, Japan
,
Nadia Magnenat-Thalmann
MIRALab, University of Geneva, Switzerland
,
Jim Chen
George Mason University
,
Program Chairs:
Seiki Inoue
NHK Science and Technical Research Labs, Japan
,
Zhigeng Pan
State Key Lab of CAD&CG, Zhejiang University, China
,
Jong -IL Park
Hanyang University, Korea

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRCAI '10

Sponsor:

SIGGRAPH

VRCAI '10: Virtual Reality Continuum and its Applications in Industry

December 12 - 13, 2010

Seoul, South Korea

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
373
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Żydowicz WSkokowski JMarano LPolom K(2024)Current Trends and Beyond Conventional Approaches: Advancements in Breast Cancer Surgery through Three-Dimensional Imaging, Virtual Reality, Augmented Reality, and the Emerging MetaverseJournal of Clinical Medicine10.3390/jcm1303091513:3(915)Online publication date: 5-Feb-2024
https://doi.org/10.3390/jcm13030915
Liu TQuek FGomez G(2024)Engaging Children in Storytelling Through Tabletop Play: Exploring Construction of Story Ideas through Enactive Actions and VocalizationsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655751(371-378)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655751
Macedo MApolinario A(2023)Occlusion Handling in Augmented Reality: Past, Present and FutureIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311786629:2(1590-1609)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TVCG.2021.3117866
Liu TPowell LQuek F(2023)Catching Imagination: Enabling Children to Capture Imaginative Tabletop Play to Support Storytelling and Writing2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343196(01-08)Online publication date: 18-Oct-2023
https://doi.org/10.1109/FIE58773.2023.10343196
Apaza YTumailla RHancco WPaz-Valderrama ACorrales-Delgado CLoaiza M(2018)Systematic Mapping Study on High-Level Content Design Frameworks for Augmented Reality2018 20th Symposium on Virtual and Augmented Reality (SVR)10.1109/SVR.2018.00037(192-201)Online publication date: Oct-2018
https://doi.org/10.1109/SVR.2018.00037
Kim KPark NWoo W(2014)Vision-based all-in-one solution for augmented reality and its storytelling applicationsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-013-0865-630:4(417-429)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.1007/s00371-013-0865-6
Ha TKim KPark NSeo SWoo WKonstan JChi EHöök K(2012)Miniature aliveCHI '12 Extended Abstracts on Human Factors in Computing Systems10.1145/2212776.2212387(1067-1070)Online publication date: 5-May-2012
https://dl.acm.org/doi/10.1145/2212776.2212387

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten