research-article

Content first: a concept for industrial augmented reality maintenance applications using mobile devices

Authors:

Pavel Rojtberg,

Folker Wientapper,

Michael Schmitt,

Ulrich BockholtAuthors Info & Claims

MMSys '15: Proceedings of the 6th ACM Multimedia Systems Conference

Pages 105 - 111

https://doi.org/10.1145/2713168.2713169

Published: 18 March 2015 Publication History

Abstract

Although AR has a long history in the area of maintenance and service-support in industry, there still is a lack of lightweight, yet practical solutions for handheld AR systems in everyday workflows. Attempts to support complex maintenance tasks with AR still miss reliable tracking techniques, simple ways to be integrated into existing maintenance environments, and practical authoring solutions, which minimize costs for specialized content generation.

We present a general, customisable application framework, allowing to employ AR and VR techniques in order to support technicians in their daily tasks. In contrast to other systems, we do not aim to replace existing support systems such as traditional manuals. Instead we integrate well-known AR- and novel presentation techniques with existing instruction media. To this end practical authoring solutions are crucial and hence we present an application development system based on web-standards such as HTML, CSS and X3D.

References

[1]

M. Becker, H. Wuest, F. Wientapper, and T. Engelke. A prototyping architecture for augmented reality. In 2nd Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS@VR 2009), pages 51--54, 2009.

[2]

J. Behr, P. Eschler, Y. Jung, and M. Zöllner. X3dom: a dom-based html5/x3d integration model. In Proceedings of the 14th International Conference on 3D Web Technology, pages 127--135. ACM, 2009.

Digital Library

[3]

B. Bell, S. Feiner, and T. Höllerer. View management for virtual and augmented reality. In Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 101--110. ACM, 2001.

Digital Library

[4]

G. Bleser, H. Wuest, and D. Stricker. Online camera pose estimation in partially known and dynamic scenes. In IEEE/ACM Proc. Int'l Symp. on Mixed and Augmented Reality (ISMAR), pages 56--65, 2006.

Digital Library

[5]

T. P. Caudell and D. W. Mizell. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In System Sciences, 1992. Proceedings of the Twenty-Fifth Hawaii International Conference on system sciences, volume 2, pages 659--669. IEEE, 1992.

[6]

DINEN 62079. Erstellung aller Arten von Anleitungen. DIN - Deutsche Industrie Norm.

[7]

ECMA-262. Standard ECMA-262 3rd Edition - December 1999. Ecma International.

[8]

T. Engelke, M. Becker, H. Wuest, J. Keil, and A. Kuijper. Mobilear browser - a generic architecture for rapid ar-multi-level development. Expert Systems with Applications, 40(7): 2704--2714, 2013.

Digital Library

[9]

T. Engelke, S. Webel, U. Bockholt, H. Wuest, N. Gavish, F. Tecchia, and C. Preusche. Towards automatic generation of multimodal ar-training applications and workflow descriptions. In 19th International Symposium in Robot and Human Interactive Communication, IEEE RO-MAN 2010, pages 434--439, 2010.

[10]

T. Engelke, S. Webel, and N. Gavish. Generating vision based lego augmented reality training and evaluation systems. In 9th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2010, pages 223--224, 2010.

[11]

S. Feiner, B. Macintyre, and D. Seligmann. Knowledge-based augmented reality. Communications of the ACM, 36(7):53--62, 1993.

Digital Library

[12]

S. J. Henderson and S. K. Feiner. Augmented reality in the psychomotor phase of a procedural task. In Mixed and Augmented Reality (ISMAR), 2011 10th IEEE International Symposium on, pages 191--200. IEEE, 2011.

Digital Library

[13]

S. Hinterstoisser, V. Lepetit, S. Ilic, P. Fua, and N. Navab. Dominant orientation templates for real-time detection of texture-less objects. 2010.

[14]

IEC 62079-1:11/2001. Preparation of instructions. IEC - International Electrotechnical Commission.

[15]

IEC 82079-1:11/2012. Preparation of instructions for use - Structuring, content and presentation - Part 1: General principles and detailed requirements. IEC - International Electrotechnical Commission.

[16]

instantReality. http://instantreality.org. Accessed: 2013-04-10.

[17]

jQuery. http://jquery.com. Accessed: 2013-04-10.

[18]

Kharma. https://research.cc.gatech.edu/kharma/content/kharma-framework.

[19]

Layar. http://layar.com/documentation/browser/.Accessed: 2013-04-10.

[20]

Metaio. http://dev.metaio.com/arel/overview/. Accessed: 2013-04-10.

[21]

U. Neumann and A. Majoros. Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In Virtual Reality Annual International Symposium, 1998. Proceedings., IEEE 1998, pages 4--11, 1998.

Digital Library

[22]

S. Pick, B. Hentschel, I. Tedjo-Palczynski, M. Wolter, and T. Kuhlen. Automated positioning of annotations in immersive virtual environments. In Proceedings of the 16th Eurographics conference on Virtual Environments #38; Second Joint Virtual Reality, EGVE - JVRC'10, pages 1--8, Aire-la-Ville, Switzerland, Switzerland, 2010. Eurographics Association.

Digital Library

[23]

J. Platonov, H. Heibel, P. Meier, and B. Grollmann. A mobile markerless ar system for maintenance and repair. In Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 105--108. IEEE Computer Society, 2006.

Digital Library

[24]

PointCloud. http://pointcloud.io. Accessed: 2013-04-10.

[25]

S1000D:2012. International specification for technical publications using a common source database - Issue No 4.1 - AeroSpace and Defence Industries Association of Europe. AeroSpace and Defence Industries Association.

[26]

T. Salonen and J. Sääski. Dynamic and visual assembly instruction for configurable products using augmented reality techniques. In Advanced Design and Manufacture to Gain a Competitive Edge, pages 23--32. Springer, 2008.

[27]

B. Schwald and B. De Laval. An augmented reality system for training and assistance to maintenance in the industrial context. Journal of WSCG, 11(1), 2003.

[28]

B. Tversky, J. B. Morrison, and M. Betrancourt. Animation: can it facilitate? International journal of human-computer studies, 57(4):247--262, 2002.

Digital Library

[29]

S. Umeyama. Least-squares estimation of transformation parameters between two point patterns. IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 13(4): 376--380, 1991.

Digital Library

[30]

S. Webel. Multimodal training of maintenance and assembly skills based on augmented reality. PhD thesis, TU-Darmstadt, 2011.

[31]

S. Webel, U. Bockholt, T. Engelke, N. Gavish, M. Olbrich, and C. Preusche. An augmented reality training platform for assembly and maintenance skills. Robotics and autonomous systems, 61(4):398--403, 2013.

Digital Library

[32]

S. Webel, U. Bockholt, T. Engelke, N. Gavish, and F. Tecchia. Design recommendations for augmented reality based training of maintenance skills. In Recent Trends of Mobile Collaborative Augmented Reality Systems, pages 69--82, 2011.

[33]

F. Wientapper, H. Wuest, and A. Kuijper. Composing the feature map retrieval process for robust and ready-to-use monocular tracking. Computers & Graphics, 35(4): 778--788, 2011. Semantic 3D Media and Content.

Digital Library

[34]

F. Wientapper, H. Wuest, and A. Kuijper. Reconstruction and accurate alignment of feature maps for augmented reality. In IEEE Proc. of Int'l Conf. on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pages 140--147, 2011.

Digital Library

[35]

Wikitude. http://www.wikitude.com/developer/. Accessed: 2013-04-10.

[36]

H. Wuest, A. Pagani, and D. Stricker. Feature management for efficient camera tracking. In Proc. Asian Conf. on Computer Vision (ACCV), volume 4843 of Lecture Notes in Computer Science, pages 769--778, 2007.

Digital Library

[37]

J. Zauner, M. Haller, A. Brandl, and W. Hartman. Authoring of a mixed reality assembly instructor for hierarchical structures. In Mixed and Augmented Reality, 2003. Proceedings. The Second IEEE and ACM International Symposium on, pages 237--246. IEEE, 2003.

Digital Library

Cited By

Bock LBohné TTadeja S(2024)Decision support for augmented reality-based assistance systems deployment in industrial settingsMultimedia Tools and Applications10.1007/s11042-024-19861-xOnline publication date: 13-Aug-2024
https://doi.org/10.1007/s11042-024-19861-x
Ho PAlbajez JSantolaria JYagüe-Fabra J(2022)Study of Augmented Reality Based Manufacturing for Further Integration of Quality Control 4.0: A Systematic Literature ReviewApplied Sciences10.3390/app1204196112:4(1961)Online publication date: 13-Feb-2022
https://doi.org/10.3390/app12041961
Saidi HCarreteros LRey STruscello LMiloudi YMakedon F(2022)BL.MIXEDR: Augmenting Traditional Maintenance Procedures to Better Exploit the Capabilities of Head-Worn ARProceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3529190.3529210(176-184)Online publication date: 29-Jun-2022
https://dl.acm.org/doi/10.1145/3529190.3529210
Show More Cited By

Index Terms

Content first: a concept for industrial augmented reality maintenance applications using mobile devices
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

First-person-view drone flying in mixed reality
SA '18: SIGGRAPH Asia 2018 Posters

This paper presents a study aimed at creating an aerial mixed reality environment by using a first-person-view drone. We develop a drone with a stereoscopic camera based on human binocular vision. Then, we present a novel mixed reality environment with ...
A first person avatar system with haptic feedback
VRST '10: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology

We describe a system that shows how to substitute a person's body in virtual reality by a virtual body (or avatar). The avatar is seen from a first person perspective, moves as the person moves and the system generates touch on the real person's body ...
Unified Representation for XR Content and its Rendering Method
Web3D '20: Proceedings of the 25th International Conference on 3D Web Technology

Virtual Reality (VR) and Augmented Reality (AR) have become familiar technologies with related markets growing rapidly every year. Moreover, the idea of considering VR and AR as one eXtended reality (XR) has broken the border between virtual space and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MMSys '15: Proceedings of the 6th ACM Multimedia Systems Conference

March 2015

277 pages

ISBN:9781450333511

DOI:10.1145/2713168

General Chair:
Wei Tsang Ooi
National University of Singapore, Singapore
,
Program Chairs:
Wu-chi Feng
Portland State University
,
Feng Liu
Portland State University

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

MMSys '15

Sponsor:

MMSys '15: Multimedia Systems Conference 2015

March 18 - 20, 2015

Oregon, Portland

Acceptance Rates

MMSys '15 Paper Acceptance Rate 12 of 41 submissions, 29%;

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
750
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bock LBohné TTadeja S(2024)Decision support for augmented reality-based assistance systems deployment in industrial settingsMultimedia Tools and Applications10.1007/s11042-024-19861-xOnline publication date: 13-Aug-2024
https://doi.org/10.1007/s11042-024-19861-x
Ho PAlbajez JSantolaria JYagüe-Fabra J(2022)Study of Augmented Reality Based Manufacturing for Further Integration of Quality Control 4.0: A Systematic Literature ReviewApplied Sciences10.3390/app1204196112:4(1961)Online publication date: 13-Feb-2022
https://doi.org/10.3390/app12041961
Saidi HCarreteros LRey STruscello LMiloudi YMakedon F(2022)BL.MIXEDR: Augmenting Traditional Maintenance Procedures to Better Exploit the Capabilities of Head-Worn ARProceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3529190.3529210(176-184)Online publication date: 29-Jun-2022
https://dl.acm.org/doi/10.1145/3529190.3529210
Chan WHanks GSakr MZhang HZuo Tvan der Loos HCroft E(2022)Design and Evaluation of an Augmented Reality Head-mounted Display Interface for Human Robot Teams Collaborating in Physically Shared Manufacturing TasksACM Transactions on Human-Robot Interaction10.1145/352408211:3(1-19)Online publication date: 13-Jul-2022
https://dl.acm.org/doi/10.1145/3524082
Thiel KNaumann FJundt EGunnemann SKlinker G(2022)C.DOT - Convolutional Deep Object Tracker for Augmented Reality Based Purely on Synthetic DataIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.308909628:12(4434-4451)Online publication date: 1-Dec-2022
https://doi.org/10.1109/TVCG.2021.3089096
Gattullo MEvangelista AUva AFiorentino MGabbard J(2022)What, How, and Why are Visual Assets Used in Industrial Augmented Reality? A Systematic Review and Classification in Maintenance, Assembly, and Training (From 1997 to 2019)IEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.301461428:2(1443-1456)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1109/TVCG.2020.3014614
Reljić VMilenković IDudić SŠulc JBajči B(2021)Augmented Reality Applications in Industry 4.0 EnvironmentApplied Sciences10.3390/app1112559211:12(5592)Online publication date: 17-Jun-2021
https://doi.org/10.3390/app11125592
Brown CHicks JRinaudo CBurch R(2021)The Use of Augmented Reality and Virtual Reality in Ergonomic Applications for Education, Aviation, and MaintenanceErgonomics in Design: The Quarterly of Human Factors Applications10.1177/1064804621100346931:4(23-31)Online publication date: 30-Mar-2021
https://doi.org/10.1177/10648046211003469
Fernandez FOnate WSaeteros MCaiza G(2021)Control and Maintenance System with Augmented Reality for a Stone Counter2021 8th International Conference on Internet of Things: Systems, Management and Security (IOTSMS)10.1109/IOTSMS53705.2021.9704955(1-5)Online publication date: 6-Dec-2021
https://doi.org/10.1109/IOTSMS53705.2021.9704955
Abdinejad MFerrag CQorbani HDalili S(2021)Developing a Simple and Cost-Effective Markerless Augmented Reality Tool for Chemistry EducationJournal of Chemical Education10.1021/acs.jchemed.1c0017398:5(1783-1788)Online publication date: 20-Apr-2021
https://doi.org/10.1021/acs.jchemed.1c00173
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents