Nothing Special   »   [go: up one dir, main page]

Skip to main content

Camera tracking by online learning of keypoint arrangements using LLAH in augmented reality applications

  • SI: Augmented Reality
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

We propose a camera-tracking method by on-line learning of keypoint arrangements in augmented reality applications. As target objects, we deal with intersection maps from GIS and text documents, which are not dealt with by the popular SIFT and SURF descriptors. For keypoint matching by keypoint arrangement, we use locally likely arrangement hashing (LLAH), in which the descriptors of the arrangement in a viewpoint are not invariant to the wide range of viewpoints because the arrangement is changeable with respect to viewpoints. In order to solve this problem, we propose online learning of descriptors using new configurations of keypoints at new viewpoints. The proposed method allows keypoint matching to proceed under new viewpoints. We evaluate the performance and robustness of our tracking method using view changes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Arya S, Mount DM, Netanyahu NS, Silverman R, Wu A (1998) An optimal algorithm for approximate nearest neighbor searching fixed dimensions. J ACM 45:891–923

    Article  MathSciNet  MATH  Google Scholar 

  • Bay H, Ess A, Tuytelaars T, Gool LV (2008) SURF: speeded up robust features. Comput Vis Image Underst 110:346–359

    Article  Google Scholar 

  • Datar M, Indyk P, Immorlica N, Mirrokni VS (2004) Locality-sensitive hashing scheme based on p-stable distributions. In: Proceedings of SCG, pp 253–262

  • Drummond T, Cipolla R (1999) Real-time tracking of complex structures with on-line camera calibration. In: Proceedings of BMVC, pp 574–583

  • Fiala M (2005) Artag, a fiducial marker system using digital techniques. In: Proc. CVPR, pp 590–596

  • Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24:381–395

    Google Scholar 

  • Harris C, Stephens M (1988) A combined corner and edge detector. In: Proceedings of AVC, pp 147–151

  • Hull J, Erol B, Graham J, Ke Q, Kishi H, Moraleda J, Van Olst D (2007) Paper-based augmented reality. In: Proceedings of ICAT, pp 205–209

  • Kato H, Billinghurst M (1999) Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In: Proceedings of IWAR

  • Klein G, Murray D (2008) Improving the agility of keyframe-based SLAM. In: Proceedings of ECCV, pp 802–815

  • Kotake D, Satoh K, Uchiyama S, Yamamoto H (2007) A fast initialization method for edge-based registration using an inclination constraint. In: Proceedings of ISMAR, pp 239–248

  • Lamdan Y, Wolfson H (1988) Geometric hashing: a general and efficient model-based recognition scheme. In: Proceedings of ICCV, pp 238–249

  • Lepetit V, Pilet J, Fua P (2004) Point matching as a classification problem for fast and robust object pose estimation. In: Proceedings of CVPR, pp 244–250

  • Lowe DG (2004) Distinctive image features from scale-invariant keypoints. IJCV 60:91–110

    Article  Google Scholar 

  • Mikolajczyk K, Schmid C (2005) A performance evaluation of local descriptors. PAMI 27:1615–1630

    Article  Google Scholar 

  • Nakai T, Kise K, Iwamura M (2005) Hashing with local combinations of feature points and its application to camera-based document image retrieval: Retrieval in 0.14 second from 10,000 pages. In: Proceedings of CBDAR, pp 87–94

  • Nakai T, Kise K, Iwamura M (2006) Use of affine invariants in locally likely arrangement hashing for camera-based document image retrieval. In: Proceedings of DAS, pp 541–552

  • Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. In: Proceedings of CVPR, pp 2161–2168

  • Pentenrieder K, Bade C, Doil F, Meier P (2007) Augmented reality-based factory planning—an application tailored to industrial needs. In: Proceedings of ISMAR, pp 1–9

  • Rosten E, Drummond T (2006) Machine learning for high speed corner detection. In: Proceedings of ECCV, pp 430–443

  • Sinha S, Frahm J, Pollefeys M, Genc Y (2006) GPU-based video feature tracking and matching. In: Proceedings of EDGE

  • Uchiyama H, Saito H (2009) Augmenting text document by on-line learning of local arrangement of keypoints. In: Proceedings of ISMAR, pp 95–98

  • Uchiyama H, Saito H, Servières M, Moreau G (2008) AR representation system for 3D GIS based on camera pose estimation using distribution of intersections. In: Proceedings of ICAT, pp 218–225

  • Uchiyama H, Saito H, Servières M, Moreau G (2009) AR GIS on a physical map based on map image retrieval using LLAH tracking. In: Proceedings of MVA, pp 382–385

  • Wagner D, Langlotz T, Schmalstieg D (2008a) Robust and unobtrusive marker tracking on mobile phones. In: Proceedings of ISMAR, pp 121–124

  • Wagner D, Reitmayr G, Mulloni A, Drummond T, Schmalstieg D (2008b) Pose tracking from natural features on mobile phones. In: Proceedings of ISMAR, pp 125–134

  • Willowgarage (2010) OpenCV 2.0. http://opencv.willowgarage.com/wiki/

Download references

Acknowledgments

We thank Dr. Julien Pilet for the discussion. This work was supported in part by Grant-in-Aid for JSPS Fellows and a Grant-in-Aid for the Global Center of Excellence for high-Level Global Cooperation for Leading-Edge Platform on Access Spaces from the Ministry of Education, Culture, Sport, Science, and Technology in Japan.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hideaki Uchiyama.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Uchiyama, H., Saito, H., Servières, M. et al. Camera tracking by online learning of keypoint arrangements using LLAH in augmented reality applications. Virtual Reality 15, 109–117 (2011). https://doi.org/10.1007/s10055-010-0173-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-010-0173-7

Keywords