Article

Detecting dynamic occlusion in front of static backgrounds for AR scenes

Authors:

Holger Regenbrecht,

Gregory BaratoffAuthors Info & Claims

EGVE '03: Proceedings of the workshop on Virtual environments 2003

Pages 153 - 161

https://doi.org/10.1145/769953.769971

Published: 22 May 2003 Publication History

Abstract

Correctly finding and handling occlusion between virtual and real objects in an Augmented Reality scene is essential for achieving visual realism. Here, we present an approach for detecting occlusion of virtual parts of the scene by natural occluders. Our algorithm is based on a graphical model of static backgrounds in the natural surroundings, which has to be acquired beforehand. The design of the approach aims at providing real-time performance and an easy integration into existing AR systems. No assumptions about the shape or color of occluding objects are required. The algorithm has been tested with several graphical models.

References

[1]

R. Azuma. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):355--385, 1997.]]

Digital Library

[2]

M.-O. Berger. Resolving occlusion in augmented reality: a contour based approach without 3D reconstruction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '97), pages 91--96, 1997.]]

Digital Library

[3]

David E. Breen, Ross T. Whitaker, Eric Rose, and Mihran Tuceryan. Interactive occlusion and automatic object placement for augmented reality. Computer Graphics Forum, 15(3):11--22, 1996.]]

[4]

J. Fischer. Interaktive Spezifikation von Domänen und Detektion partieller dynamischer Verdeckungen in Augmented-Reality Umgebungen. Diplomarbeit, Universität Ulm, 2002.]]

[5]

J. Foley, A. van Dam, S. Feiner, and J. Hughes. Computer Graphics - Principles and Practice. Addison-Wesley, second edition, 1997.]]

Digital Library

[6]

Anton Fuhrmann, Gerd Hesina, François Faure, and Michael Gervautz. Occlusion in collaborative augmented environments. Computers and Graphics, 23(6):809--819, 1999.]]

[7]

G. Gordon, M. Billinghurst, M. Bell, J. Woodfill, B. Kowalik, A. Erendi, and J. Tilander. The use of dense stereo range data in augmented reality. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR), September 2002.]]

Digital Library

[8]

R. Hartley and A. Zissermann. Multiple View Geometry in computer vision. Cambridge University Press, 2000.]]

Digital Library

[9]

Intel Corporation. Intel Image Processing Library Reference Manual, 2000.]]

[10]

Intel Corporation. Open Source Computer Vision Library Reference Manual, 2001.]]

[11]

M. Kanbara, T. Okuma, H. Takemura, and N. Yokoya. A stereoscopic video see-through augmented reality system based on real-time vision-based registration. In IEEE Virtual Reality 2000 International Conference(VR 2000), pages 255--262, March 2000.]]

Digital Library

[12]

H. Kato and M. Billinghurst. Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In Proceedings of IEEE and ACM International Workshop on Augmented Reality, pages 85--94, October 1999.]]

Digital Library

[13]

H. Kato, K. Tachibana, M. Billinghurst, and M. Grafe. Real-time tracking system based on matching templates generated from image texture (demo). In IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), September 2002.]]

[14]

G. Klinker. Praktikum augmented reality - occlusion handling between real and virtual objects. http://wwwbruegge.in.tum.de/teaching/ss01/AR-Praktikum01/presentation/occlusions.pdf, 2001.]]

[15]

V. Lepetit and M.-O. Berger. A semi-automatic method for resolving occlusion in augmented reality. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 2000.]]

[16]

S. Malik, C. McDonald, and G. Roth. Hand tracking for interactive pattern-based augmented reality. In Proceedings of IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), September 2002.]]

Digital Library

[17]

B. Paul. Mesa 4.0.4 (readme file). http://mesa3d.sourceforge.net/docs/mesa.html, 2002.]]

[18]

H. Regenbrecht, M. Wagner, and G. Baratoff. MagicMeeting - a collaborative tangible augmented reality system. Virtual Reality - Systems, Development and Applications, 6(3), 2002.]]

[19]

M. Sonka, V. Hlavac, and R. Boyle. Image processing, Analysis and Machine Vision. Chapman & Hall, 1993.]]

Digital Library

[20]

E. Trucco and A. Verri. Introductory Techniques for 3-D Computer Vision. Prentice-Hall, 1998.]]

Digital Library

[21]

J. Wernecke. The Inventor Mentor (Release 2). Addison-Wesley, 1994.]]

[22]

M. Wloka and B. Anderson. Resolving occlusion in augmented reality. In Symposium on Interactive 3D Graphics, pages 5--12, 1995.]]

Digital Library

Cited By

Kamińska DZwoliński GLaska-Leśniewicz ARaposo RVairinhos MPereira EUrem FLjubić Hinić MHaamer RAnbarjafari G(2023)Augmented Reality: Current and New Trends in EducationElectronics10.3390/electronics1216353112:16(3531)Online publication date: 21-Aug-2023
https://doi.org/10.3390/electronics12163531
Macedo MApolinario A(2023)Occlusion Handling in Augmented Reality: Past, Present and FutureIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311786629:2(1590-1609)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TVCG.2021.3117866
Odira JAndreff NPetiet LByiringiro J(2022)Visual servoing of a laser beam through a mirrorRobotica10.1017/S026357472200011X40:9(3157-3177)Online publication date: 24-Mar-2022
https://doi.org/10.1017/S026357472200011X
Show More Cited By

Index Terms

Detecting dynamic occlusion in front of static backgrounds for AR scenes
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Dynamic Occlusion Handling for Real-Time AR Applications
VRCAI '19: Proceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry

Augmented reality (AR) allows computer generated graphics to be overlaid in images or video captured by a camera in real time. This technology is often used to enhance perception by providing extra information or simply by enriching the experience of ...
GrabAR: Occlusion-aware Grabbing Virtual Objects in AR
UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

Existing augmented reality (AR) applications often ignore the occlusion between real hands and virtual objects when incorporating virtual objects in user's views. The challenges come from the lack of accurate depth and mismatch between real and virtual ...
Sensor Fusion and Occlusion Refinement for Tablet-Based AR
ISMAR '04: Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality

This paper presents a set of technologies which enable robust, accurate, high resolution augmentation of live video, delivered via a tablet PC to which a video camera has been attached. By combining several technologies this is achieved without the use ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

EGVE '03: Proceedings of the workshop on Virtual environments 2003

May 2003

211 pages

ISBN:1581136862

DOI:10.1145/769953

Conference Chairs:
Andreas Kunz
ICVR, ETH, Zurich, Switzerland
,
Joachim Deisinger
Fraunhofer IAO, Germany

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

EUROGRAPHICS: The European Association for Computer Graphics

In-Cooperation

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 May 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

IPT/EGVE03

Sponsor:

EUROGRAPHICS

IPT/EGVE03: Imersive Progection Technologies/Eurographics Virtual Environments

May 22 - 23, 2003

Zurich, Switzerland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
696
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kamińska DZwoliński GLaska-Leśniewicz ARaposo RVairinhos MPereira EUrem FLjubić Hinić MHaamer RAnbarjafari G(2023)Augmented Reality: Current and New Trends in EducationElectronics10.3390/electronics1216353112:16(3531)Online publication date: 21-Aug-2023
https://doi.org/10.3390/electronics12163531
Macedo MApolinario A(2023)Occlusion Handling in Augmented Reality: Past, Present and FutureIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311786629:2(1590-1609)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TVCG.2021.3117866
Odira JAndreff NPetiet LByiringiro J(2022)Visual servoing of a laser beam through a mirrorRobotica10.1017/S026357472200011X40:9(3157-3177)Online publication date: 24-Mar-2022
https://doi.org/10.1017/S026357472200011X
Zollmann SLanglotz TGrasset RLo WMori SRegenbrecht H(2021)Visualization Techniques in Augmented Reality: A Taxonomy, Methods and PatternsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.298624727:9(3808-3825)Online publication date: 1-Sep-2021
https://doi.org/10.1109/TVCG.2020.2986247
Montero AZarraonandia TDiaz PAedo I(2019)Designing and implementing interactive and realistic augmented reality experiencesUniversal Access in the Information Society10.1007/s10209-017-0584-218:1(49-61)Online publication date: 15-May-2019
https://dl.acm.org/doi/10.1007/s10209-017-0584-2
Fischer J(2015)Visual Consistency in Augmented Reality CompositingFundamentals of Wearable Computers and Augmented Reality, Second Edition10.1201/b18703-22(457-484)Online publication date: 9-Jul-2015
https://doi.org/10.1201/b18703-22
Regenbrecht HCollins JHoermann S(2013)A leap-supported, hybrid AR interface approachProceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration10.1145/2541016.2541053(281-284)Online publication date: 25-Nov-2013
https://dl.acm.org/doi/10.1145/2541016.2541053
Louis JMartinez J(2012)Rendering Stereoscopic Augmented Reality Scenes with Occlusions Using Depth from Stereo and Texture MappingConstruction Research Congress 201210.1061/9780784412329.138(1370-1380)Online publication date: 11-Jul-2012
https://doi.org/10.1061/9780784412329.138
Behzadan AKamat V(2010)Scalable Algorithm for Resolving Incorrect Occlusion in Dynamic Augmented Reality Engineering EnvironmentsComputer-Aided Civil and Infrastructure Engineering10.1111/j.1467-8667.2009.00601.x25:1(3-19)Online publication date: Jan-2010
https://doi.org/10.1111/j.1467-8667.2009.00601.x
Portalés CLerma JNavarro S(2010)Augmented reality and photogrammetry: A synergy to visualize physical and virtual city environmentsISPRS Journal of Photogrammetry and Remote Sensing10.1016/j.isprsjprs.2009.10.00165:1(134-142)Online publication date: Jan-2010
https://doi.org/10.1016/j.isprsjprs.2009.10.001
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents