research-article

Spatial augmented reality: a tool for operator guidance and training evaluated in five industrial case studies

Authors:

Reinier Könemann,

Ellen S. Wilschut,

Michiel de LoozeAuthors Info & Claims

PETRA '20: Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Article No.: 40, Pages 1 - 7

https://doi.org/10.1145/3389189.3397975

Published: 30 June 2020 Publication History

Abstract

Spatial Augmented Reality (sAR) as an assistive technology is a promising tool for experienced and novice industrial workers. Five industrial case studies in Dutch manufacturing companies are described to study the effects of sAR assistance on task completion time, learning speed, product quality, work load, technology acceptance and employability in manual assembly guidance and training. Although case study outcomes were rather positive and user acceptance was high, 2 out of 5 use case companies decided not to invest in this technology after the initial pilot project. The main barriers for implementation were concerns about the relatively high system costs, the initial instruction programming time and the required expertise to do so. Future system developments should improve the system's usability from a business process engineering perspective and thereby support zero programming of sAR systems and adaptive work instructions.

Supplementary Material

MP4 File (a40-bosch.mp4)

Download
23.80 MB

References

[1]

Geissbauer, R., Schrauf, S., Berttram, P., & Cheraghi, F. (2017). Digital Factories 2020: Shaping the future of manufacturing. Frankfurt am Main: PricewaterhouseCoopers.

[2]

Romero, D., Stahre, J., Wuest, T., Noran, O., Bernus, P., Fast-Berglund, Å., & Gorecky, D. (2016). Towards an operator 4.0 typology: a human-centric perspective on the fourth industrial revolution technologies. In Proceedings of the International Conference on Computers and Industrial Engineering (CIE46), Tianjin, China (pp. 29--31).

[3]

Mattsson, S., Fast-Berglund, Å., Li, D., & Thorvald, P. (2018). Forming a cognitive automation strategy for Operator 4.0 in complex assembly. Computers & Industrial Engineering, 105360.

[4]

De Looze, M. P., Bosch, T., Krause, F., Stadler, K. S., & O'Sullivan, L. W. (2016). Exoskeletons for industrial application and their potential effects on physical work load. Ergonomics, 59(5), 671--681.

[5]

Matheson, E., Minto, R., Zampieri, E. G., Faccio, M., & Rosati, G. (2019). Human-Robot Collaboration in Manufacturing Applications: A Review. Robotics, 8(4), 100.

[6]

Werrlich, S., Eichstetter, E., Nitsche, K., & Notni, G. (2017). An overview of evaluations using augmented reality for assembly training tasks. International Journal of Computer and Information Engineering, 11(10), 1068--1074.

[7]

Büttner, S., Funk, M., Sand, O., & Röcker, C. (2016). Using head-mounted displays and in-situ projection for assistive systems: A comparison. In Proceedings of the 9th ACM international conference on pervasive technologies related to assistive environments (pp. 1--8).

Digital Library

[8]

Pattke, M., Martin, M., & Voit, M. (2019). Towards a Mixed Reality Assistance System for the Inspection After Final Car Assembly. In International Conference on Human-Computer Interaction (pp. 536--546). Springer, Cham.

[9]

Wilschut, E. S., Könemann, R., Murphy, M. S., Van Rhijn, G. J., & Bosch, T. (2019). Evaluating learning approaches for product assembly: using chunking of instructions, spatial augmented reality and display based work instructions. In Proceedings of the 12th ACM International Conference on Pervasive Technologies Related to Assistive Environments (pp. 376--381).

Digital Library

[10]

Fiorentino, M., Uva, A. E., Gattullo, M., Debernardis, S., & Monno, G. (2014). Augmented reality on large screen for interactive maintenance instructions. Computers in Industry, 65(2), 270--278.

Digital Library

[11]

Bosch, T., Könemann, R., de Cock, H., & Van Rhijn, G. (2017, June). The effects of projected versus display instructions on productivity, quality and workload in a simulated assembly task. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (pp. 412--415).

Digital Library

[12]

Funk, M., Kosch, T., & Schmidt, A. (2016, September). Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 934--939).

Digital Library

[13]

Royce, W.W. (1970). Managing the development of large software systems, IEEE WESCON, 26 (8), 328--338.

[14]

Hart, S., & Staveland, LE. (1988). Development of NASATLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology, 52, 139--183.

[15]

Zijlstra, F. R. H. (1993). Efficiency in Work Behavior. A Design Approach for Modern Tools (Published doctoral thesis). Delft University of Technology, Deft University Press, Delft, NL.

[16]

Brook, J, (1996). SUS: a "quick and dirty" usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A. and McClelland, I.L., eds. 1996. Usability Evaluation In Industry. London: Taylor and Francis, 189--194.

[17]

Funk, M., Mayer, S., & Schmidt, A. (2015). Using in-situ projection to support cognitively impaired workers at the workplace. In Proceedings of the 17th international ACM SIGACCESS conference on Computers & accessibility (pp. 185--192).

Digital Library

[18]

Funk, M., Bächler, A., Bächler, L., Kosch, T., Heidenreich, T., & Schmidt, A. (2017, June). Working with augmented reality? A long-term analysis of in-situ instructions at the assembly workplace. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (pp. 222--229).

Digital Library

[19]

Moeuf, A., Pellerin, R., Lamouri, S., Tamayo-Giraldo, S., & Barbaray, R. (2018). The industrial management of SMEs in the era of Industry 4.0. International Journal of Production Research, 56(3), 1118--1136.

[20]

Galaske, N., & Anderl, R. (2016). Approach for the development of an adaptive worker assistance system based on an individualized profile data model. In Advances in Ergonomics of Manufacturing: Managing the Enterprise of the Future (pp. 543--556). Springer, Cham.

[21]

Mayrhofer, W., Rupprecht, P., & Schlund, S. (2019). One-Fits-All vs. Tailor-Made: User-Centered Workstations for Field Assembly with an Application in Aircraft Parts Manufacturing. Procedia Manufacturing, 39, 149--157.

Cited By

Solmaz SHenderickx Rden Bergh JBirem M(2024)Capturing the system requirements for adopting Industry 5.0 in quality inspection: an evidence-based approachProcedia CIRP10.1016/j.procir.2024.03.016128(369-374)Online publication date: 2024
https://doi.org/10.1016/j.procir.2024.03.016
Barbieri LMarino EBruno FMuzzupappa MColacino B(2024)User-centered design of an augmented reality inspection tool for industry 4.0 operatorsInternational Journal on Interactive Design and Manufacturing (IJIDeM)10.1007/s12008-024-01931-xOnline publication date: 12-Jun-2024
https://doi.org/10.1007/s12008-024-01931-x
Sakr AAbdullah T(2024)Virtual, augmented reality and learning analytics impact on learners, and educators: A systematic reviewEducation and Information Technologies10.1007/s10639-024-12602-529:15(19913-19962)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1007/s10639-024-12602-5
Show More Cited By

Index Terms

Spatial augmented reality: a tool for operator guidance and training evaluated in five industrial case studies
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. HCI design and evaluation methods
      1. Field studies

Recommendations

Spatial augmented reality for physical drawing
UIST Adjunct Proceedings '12: Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology

Spatial augmented reality (SAR) makes possible the projection of virtual environments into the real world. In this demo, we propose to demonstrate our SAR tools dedicated to the creation of physical drawings. From the most simple tools: the projection ...
Augmented reality based virtual keyboards for assistive technology
i-CREATe '12: Proceedings of the 6th International Conference on Rehabilitation Engineering & Assistive Technology

This paper presents a novel virtual interface system based on augmented reality (AR) techniques. The ARVKs (augmented reality based virtual keyboards) that have been developed based on this virtual interface system can accomplish user inputs with slight ...
reFrame: An Alternate Paradigm for Augmented Reality
SIGGRAPH '20: ACM SIGGRAPH 2020 Posters

“reFrame” is an optically see-through Augmented Reality (AR) platform capable of displaying parallax-free images superimposed over physical objects and the scenery behind it. It uses head-tracking technology and off-axis perspective projection to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '20: Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments

June 2020

574 pages

ISBN:9781450377737

DOI:10.1145/3389189

Conference Chair:
Fillia Makedon
University of Texas at Arlington

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

NSF: National Science Foundation
CSE@UTA: Department of Computer Science and Engineering, The University of Texas at Arlington
NCRS: Demokritos National Center for Scientific Research

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

PETRA '20

Sponsor:

NSF
CSE@UTA
NCRS

PETRA '20: The 13th PErvasive Technologies Related to Assistive Environments Conference

June 30 - July 3, 2020

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
570
Total Downloads

Downloads (Last 12 months)83
Downloads (Last 6 weeks)5

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Solmaz SHenderickx Rden Bergh JBirem M(2024)Capturing the system requirements for adopting Industry 5.0 in quality inspection: an evidence-based approachProcedia CIRP10.1016/j.procir.2024.03.016128(369-374)Online publication date: 2024
https://doi.org/10.1016/j.procir.2024.03.016
Barbieri LMarino EBruno FMuzzupappa MColacino B(2024)User-centered design of an augmented reality inspection tool for industry 4.0 operatorsInternational Journal on Interactive Design and Manufacturing (IJIDeM)10.1007/s12008-024-01931-xOnline publication date: 12-Jun-2024
https://doi.org/10.1007/s12008-024-01931-x
Sakr AAbdullah T(2024)Virtual, augmented reality and learning analytics impact on learners, and educators: A systematic reviewEducation and Information Technologies10.1007/s10639-024-12602-529:15(19913-19962)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1007/s10639-024-12602-5
Cim VHounsell M(2023)Augmented Reality for Assembly Training in Industry: A Systematic Literature MappingProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625020(77-87)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3625008.3625020
Peixe LAgati SHounsell M(2023)Manual Assembly Augmented Reality Systems Implementation: A Systematic Literature MappingProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625011(17-25)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3625008.3625011
Schein KRauschnabel P(2023)Augmented Reality in Manufacturing: Exploring Workers’ Perceptions of BarriersIEEE Transactions on Engineering Management10.1109/TEM.2021.309383370:10(3344-3357)Online publication date: Oct-2023
https://doi.org/10.1109/TEM.2021.3093833
Peltokorpi JHoedt SColman TRutten KAghezzaf ECottyn J(2023)Manual assembly learning, disability, and instructions: an industrial experimentInternational Journal of Production Research10.1080/00207543.2023.219595761:22(7903-7921)Online publication date: 11-Apr-2023
https://doi.org/10.1080/00207543.2023.2195957
Jalilzadehazhari EKurkinen E(2022)Drivers and barrios in using augmented reality in renovation projects - literature reviewE3S Web of Conferences10.1051/e3sconf/202236207002362(07002)Online publication date: 1-Dec-2022
https://doi.org/10.1051/e3sconf/202236207002
Monetti FGiorgio AMaffei A(2022)Industrial transformation and assembly technology: context and research trendsProcedia CIRP10.1016/j.procir.2022.05.169107(1427-1432)Online publication date: 2022
https://doi.org/10.1016/j.procir.2022.05.169
Maier MVernim S(2021)Requirements for an Assistance System to Support Human Resource Development in Manual Assembly2021 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM)10.1109/IEEM50564.2021.9673033(1372-1376)Online publication date: 13-Dec-2021
https://doi.org/10.1109/IEEM50564.2021.9673033
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents