research-article

Assessing user performance in augmented reality assembly guidance for industry 4.0 operators

Authors:

Emanuele Marino,

Loris Barbieri,

Maurizio MuzzupappaAuthors Info & Claims

Volume 157, Issue C

https://doi.org/10.1016/j.compind.2024.104085

Published: 01 May 2024 Publication History

Abstract

In the realm of smart manufacturing, Augmented Reality (AR) technology has gained increasing attention among researchers and manufacturers due to its practicality and adaptability. For this reason, it has been widely embraced in various industrial fields, especially for helping operators assemble products. Despite its widespread adoption, there is a debate in the research community about how effective AR is for improving user performance in assembly tasks, particularly when using handheld devices. These disparities can be attributed to differences in experimental approaches, such as the frequent use of qualitative methods, the inclusion of non-representative users, and the limited number of comprehensive case studies.

In response to this, the paper delved into the benefits of AR applications, with a specific focus on measuring user performance and the cognitive workload perceived by users during assembly activities. To this end, an AR assembly guidance tool has been developed to assist users during assembly tasks, running on a mobile device, specifically a tablet, for freedom of movement and high portability. Experimentation involved the assembly of a comprehensive case study and a diverse user group, allowing the comparison representative users and experienced industrial operators. The results were promising, indicating that AR technology effectively enhances user performance during assembly-guided activities compared to conventional methods, particularly when users are unfamiliar with the task at hand. This study brings valuable insights by addressing previous research limitations and providing strong evidence of AR's positive impact on user performance in real-world assembly scenarios.

Highlights

•

Augmented Reality enhances industrial assembly activities.

•

“AR instructions” outperform “2D documents” regardless of the user's skill level.

•

Cognitive load does not depend on the user's skill level when using AR instructions.

References

[1]

S.S. Agati, R.D. Bauer, M.D.S. Hounsell, A.S. Paterno, Augmented reality for manual assembly in industry 4.0: Gathering guidelines, 22nd Symposium on Virtual and Augmented Reality (SVR), IEEE, 2020, pp. 179–188,.

[2]

J. Alves, B. Marques, M. Oliveira, T. Araújo, P. Dias, B.S. Santos, Comparing spatial and mobile augmented reality for guiding assembling procedures with task validation, IEEE Int. Conf. Auton. Robot Syst. Compét. (ICARSC) (2019) 1–6,.

[3]

J.B. Alves, B. Marques, C. Ferreira, P. Dias, B.S. Santos, Comparing augmented reality visualization methods for assembly procedures, Virtual Real. 26 (2022) 1–14,.

Digital Library

[4]

I.F. del Amo, J.A. Erkoyuncu, R. Roy, R. Palmarini, D. Onoufriou, A systematic review of Augmented Reality content-related techniques for knowledge transfer in maintenance applications, Comput. Ind. 103 (2018) 47–71,.

[5]

J. de Assis Dornelles, N.F. Ayala, A.G. Frank, Smart Working in Industry 4.0: How digital technologies enhance manufacturing workers' activities, Comput. Ind. Eng. 163 (2022),.

Digital Library

[6]

A.M. Bagamaspad, J.I. Caingles, K.A. Koa, J.L. Simeon, C. Ruiz, A mobile augmented reality-based assembly guidance application for LEGO, 12th International Conference on Interfaces and Human Computer Interaction 2018, 11th International Conference on Game and Entertainment Technologies 2018 and 12th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2018, part of the Multi Conference on Computer Science and Information Systems 2018, 2018, IADIS, MCCSIS, 2018, pp. 237–244.

[7]

K.M. Baird, W. Barfield, Evaluating the effectiveness of augmented reality displays for a manual assembly task, Virtual Real. 4 (1999) 250–259,.

Digital Library

[8]

H.Ç. Bal, Ç. Erkan, Industry 4.0 and competitiveness, Procedia Comput. Sci. 158 (2019) 625–631,.

Digital Library

[9]

L. Barbieri, E. Marino, An augmented reality tool to detect design discrepancies: a comparison test with traditional methods, Augmented Reality, Virtual Reality, and Computer Graphics: 6th International Conference, AVR 2019, Santa Maria al Bagno, Italy, Springer International Publishing, 2019, pp. 99–110,.

Digital Library

[10]

J. Baumeister, S.Y. Ssin, N.A. ElSayed, J. Dorrian, D.P. Webb, J.A. Walsh, B.H. Thomas, Cognitive cost of using augmented reality displays, IEEE Trans. Vis. Comput. Graph. 23 (11) (2017) 2378–2388,.

Digital Library

[11]

C. Berger, M. Gerke, Comparison of selected augmented reality frameworks for integration in geographic citizen science projects, Int. Arch. Photogramm., Remote Sens. Spat. Inf. Sci. 43 (2022) 223–230,.

[12]

C. Berlin, M.W. Bergman, M.B. Chafi, A.C. Falck, R. Örtengren, A systemic overview of factors affecting the cognitive performance of industrial manual assembly workers, In: Congress of the International Ergonomics Association, Springer, Cham, 2021, pp. 371–381,.

[13]

B. Bhattacharya, E.H. Winer, Augmented reality via expert demonstration authoring (AREDA), Comput. Ind. 105 (2019) 61–79,.

Digital Library

[14]

J. Blattgerste, B. Strenge, P. Renner, T. Pfeiffer, K. Essig, Comparing conventional and augmented reality instructions for manual assembly tasks, : Proc. 10th Int. Conf. pervasive Technol. Relat. Assist. Environ. (2017) 75–82,.

Digital Library

[15]

E. Bottani, G. Vignali, Augmented reality technology in the manufacturing industry: A review of the last decade, IISE Trans. 51 (3) (2019) 284–310,.

[16]

C. Botto, A. Cannavò, D. Cappuccio, G. Morat, A.N. Sarvestani, P. Ricci, A. Saturnino, Augmented reality for the manufacturing industry: the case of an assembly assistant. In: 2020, IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE, 2020, pp. 299–304,.

[17]

J. Buchner, K. Buntins, M. Kerres, The impact of augmented reality on cognitive load and performance: A systematic review, J. Comput. Assist. Learn. 38 (1) (2022) 285–303,.

[18]

P. Butala, K. Mpofu, Assembly Systems, CIRP Encyclopedia of Production Engineering, Springer-Verlag GmbH, Heidelberg, Berlin, 2019, pp. 89–92,.

[19]

S. Büttner, O. Sand, C. Röcker, Extending the design space in industrial manufacturing through mobile projection, : Proc. 17th Int. Conf. Hum. -Comput. Interact. Mob. Devices Serv. Adjun. (2015) 1130–1133,.

Digital Library

[20]

S. Büttner, M. Funk, O. Sand, C. Röcker, Using head-mounted displays and in-situ projection for assistive systems: A comparison, : Proc. 9th ACM Int. Conf. pervasive Technol. Relat. Assist. Environ. (2016) 1–8,.

Digital Library

[21]

L.A. Cardenas-Robledo, Ó. Hernández-Uribe, C. Reta, J.A. Cantoral-Ceballos, Extended reality applications in industry 4.0. - A systematic literature review, Telemat. Inform. 73 (2022),.

Digital Library

[22]

L.F. Cardoso, F.C.M.Q. Mariano, E.R. Zorzal, A survey of industrial augmented reality, Comput. Ind. Eng. 139 (2019) 2–12,.

Digital Library

[23]

J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, M. Ivkovic, Augmented reality technologies, systems and applications, Multimed. tools Appl. 51 (2011) 341–377,.

Digital Library

[24]

T.P. Caudell, D.W. Mizell, Augmented reality: An application of heads-up display technology to manual manufacturing processes, : Hawaii Int. Conf. Syst. Sci. 2. ACM SIGCHI Bull. (1992),.

[25]

V.C. Cavalcanti, M.I. de Santana Ferreira, V. Teichrieb, R.R. Barioni, W.F.M. Correia, A.E.F. Da Gama, Usability and effects of text, image and audio feedback on exercise correction during augmented reality based motor rehabilitation, Comput. Graph. 85 (2019) 100–110,.

Digital Library

[26]

M.C. Chiu, J.H. Huang, S. Gupta, G. Akman, Developing a personalized recommendation system in a smart product service system based on unsupervised learning model, Comput. Ind. 128 (2021),.

[27]

J. Cohen, Eta-squared and partial eta-squared in fixed factor ANOVA designs, Educ. Psychol. Meas. 33 (1) (1973) 107–112,.

[28]

Y. Cohen, H. Naseraldin, A. Chaudhuri, F. Pilati, Assembly systems in industry 4.0 era: a road map to understand assembly 4.0, 2019 Int. J. Adv. Manuf. Technol. 105 (2019) 4037–4054,.

[29]

Y. Cohen, M. Faccio, F. Pilati, X. Yao, Design and management of digital manufacturing and assembly systems in the Industry 4.0 era, Int. J. Adv. Manuf. Technol. 105 (2019) 3565–3577,.

[30]

D. Curtis, D. Mizell, P. Gruenbaum, Several devils in the details: making an AR application work in the airplane factory, : Proc. Int. Workshop Augment. Real. San. Fr., Calif. (1998) 47–60.

[31]

L.M. Daling, S.J. Schlittmeier, Effects of augmented reality-, virtual reality-, and mixed reality–based training on objective performance measures and subjective evaluations in manual assembly tasks: a scoping review, Hum. Factors (2022),.

[32]

L. Dammacco, R. Carli, V. Lazazzera, M. Fiorentino, M. Dotoli, Designing complex manufacturing systems by virtual reality: A novel approach and its application to the virtual commissioning of a production line, Comput. Ind. 143 (2022),.

Digital Library

[33]

O. Danielsson, M. Holm, A. Syberfeldt, Augmented reality smart glasses in industrial assembly: Current status and future challenges, J. Ind. Inf. Integr. 20 (2020),.

[34]

F. De Pace, F. Manuri, A. Sanna, Augmented reality in industry 4.0, Am. J. Comput. Sci. Inf. Technol. 6 (1) (2018),.

[35]

J.S. Devagiri, S. Paheding, Q. Niyaz, X. Yang, S. Smith, Augmented Reality and Artificial Intelligence in industry: Trends, tools, and future challenges, Expert Syst. Appl. (2022),.

Digital Library

[36]

A. Dey, M. Billinghurst, R.W. Lindeman, J.E. Swan, A systematic review of 10 years of augmented reality usability studies: 2005 to 2014, Front. Robot. AI 5 (2018),.

[37]

J. Dong, Z. Xia, Q. Zhao, Augmented reality assisted assembly training oriented dynamic gesture recognition and prediction, Appl. Sci. 11 (21) (2021),.

[38]

H. Dorloh, K.W. Li, S. Khaday, Presenting Job Instructions Using an Augmented Reality Device, a Printed Manual, and a Video Display for Assembly and Disassembly Tasks: What Are the Differences?, Appl. Sci. 13 (4) (2023),.

[39]

J. Egger, T. Masood, Augmented reality in support of intelligent manufacturing–a systematic literature review, Comput. Ind. Eng. 140 (2020),.

Digital Library

[40]

M. Eswaran, M.R. Bahubalendruni, Challenges and opportunities on AR/VR technologies for manufacturing systems in the context of industry 4.0: A state of the art review, J. Manuf. Syst. 65 (2022) 260–278,.

[41]

A. Evangelista, L. Ardito, A. Boccaccio, M. Fiorentino, A.M. Petruzzelli, A.E. Uva, Unveiling the technological trends of augmented reality: a patent analysis, Comput. Ind. 118 (2020),.

[42]

W. Fang, L. Chen, T. Zhang, C. Chen, Z. Teng, L. Wang, Head-mounted display augmented reality in manufacturing: a systematic review, Robot. Comput. -Integr. Manuf. 83 (2023),.

Digital Library

[43]

M. Fiorentino, A.E. Uva, M. Gattullo, S. Debernardis, G. Monno, Augmented reality on large screen for interactive maintenance instructions, Comput. Ind. 65 (2) (2014) 270–278,.

Digital Library

[44]

J. Funk, L. Schmidt, Evaluation of an Augmented Reality Instruction for a Complex Assembly Task: Comparison of a Smartphone-Based Augmented Reality Instruction with a Conventional Paper Instruction for the Teach-in Phase in Manual Assembly, i-Com. 20 (1) (2021) 63–72,.

[45]

M. Funk, A. Bächler, L. Bächler, O. Korn, C. Krieger, T. Heidenreich, A. Schmidt, Comparing projected in-situ feedback at the manual assembly workplace with impaired workers, : Proc. 8th ACM Int. Conf. PErvasive Technol. Relat. Assist. Environ. (2015) 1–8,.

Digital Library

[46]

M. Funk, S. Mayer, A. Schmidt, Using in-situ projection to support cognitively impaired workers at the workplace, : Proc. 17th Int. ACM SIGACCESS Conf. Comput. Access. (2015) 185–192,.

Digital Library

[47]

M. Funk, T. Kosch, R. Kettner, O. Korn, A. chmidt, motioneap: An overview of 4 years of combining industrial assembly with augmented reality for industry 4.0, In: Proceedings of the 16th international conference on knowledge technologies and datadriven business, ACM, 2016.

[48]

M. Funk, T. Kosch, A. Schmidt, Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions, : Proc. 2016 ACM Int. Jt. Conf. pervasive ubiquitous Comput. (2016) 934–939,.

Digital Library

[49]

M. Funk, A. Bächler, L. Bächler, T. Kosch, T. Heidenreich, A. Schmidt, Working with augmented reality? A long-term analysis of in-situ instructions at the assembly workplace, I: Proc. 10th Int. Conf. pervasive Technol. Relat. Assist. Environ. (2017) 222–229,.

Digital Library

[50]

N. Gavish, T. Gutiérrez, S. Webel, J. Rodríguez, M. Peveri, U. Bockholt, F. Tecchia, Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks, Interact. Learn. Environ. 23 (6) (2015) 778–798,.

[51]

J. Geng, X. Song, Y. Pan, J. Tang, Y. Liu, D. Zhao, Y. Ma, A systematic design method of adaptive augmented reality work instruction for complex industrial operations, Comput. Ind. 119 (2020),.

[52]

M. Ghobakhloo, M. Fathi, M. Iranmanesh, P. Maroufkhani, M.E. Morales, Industry 4.0 ten years on: A bibliometric and systematic review of concepts, sustainability value drivers, and success determinants, J. Clean. Prod. 302 (2021),.

[53]

S. Grabowska, Smart factories in the age of Industry 4.0, Manag. Syst. Prod. Eng. 2 (28) (2020) 90–96,.

[54]

R.A. Grier, How High is High? A Meta-Analysis of NASA-TLX Global Workload Scores, : Proc. Hum. Factors Ergon. Soc. Annu. Meet. 59 (1) (2016) 1727–1731,.

[55]

J. Hahn, B. Ludwig, C. Wolff, Augmented reality-based training of the PCB assembly process, : Proc. 14th Int. Conf. Mob. Ubiquitous Multimed. (2015) 395–399,.

Digital Library

[56]

M. Hakkarainen, C. Woodward, M. Billinghurst, Augmented assembly using a mobile phone, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE, 2008, pp. 167–168,.

Digital Library

[57]

V. Havard, D. Baudry, B. Jeanne, A. Louis, X. Savatier, A use case study comparing augmented reality (AR) and electronic document-based maintenance instructions considering tasks complexity and operator competency level, Virtual Real. (2021) 1–16,.

Digital Library

[58]

L. Hou, X. Wang, L. Bernold, P.E. Love, Using animated augmented reality to cognitively guide assembly, J. Comput. Civ. Eng. 27 (5) (2013) 439–451,.

[59]

L. Hou, X. Wang, M. Truijens, Using augmented reality to facilitate piping assembly: an experiment-based evaluation, J. Comput. Civ. Eng. 29 (1) (2015),.

[60]

Y.-P. Huang, Visual perception and fatigue in AR/VR head-mounted displays, Inf. Disp. 35 (2) (2019) 4–5,.

[61]

ISO 9241-11, 2018. Ergonomics of Human-system Interaction - Part 11: Usability:Definitions and Concepts, 2018.

[62]

F. Jasche, S. Hoffmann, T. Ludwig, V. Wulf, Comparison of different types of augmented reality visualizations for instructions, : Proc. 2021 CHI Conf. Hum. Factors Comput. Syst. (2021) 1–13,.

Digital Library

[63]

M. Javaid, A. Haleem, R.P. Singh, R. Suman, E.S. Gonzalez, Understanding the adoption of Industry 4.0 technologies in improving environmental sustainability, Sustain. Oper. Comput. 3 (2022) 203–217,.

[64]

N.F.S. Jeffri, D.R.A. Rambli, A review of augmented reality systems and their effects on mental workload and task performance, Heliyon 7 (3) (2021).

[65]

A. Jungherr, D.B. Schlarb, The extended reach of game engine companies: How companies like epic games and Unity technologies provide platforms for extended reality applications and the metaverse, Soc. Media+ Soc. 8 (2) (2022),.

[66]

N. Karnik, U. Bora, K. Bhadri, P. Kadambi, P. Dhatrak, A comprehensive study on current and future trends towards the characteristics and enablers of industry 4.0, J. Ind. Inf. Integr. 27 (2022),.

[67]

D. Kirsh, The intelligent use of space, Artif. Intell. 73 (1) (1995) 31–68,.

Digital Library

[68]

C.O. Klingenberg, M.A.V. Borges, J.A. do Vale Antunes Jr, Industry 4.0: What makes it a revolution? A historical framework to understand the phenomenon, Technol. Soc. 70 (2022),.

[69]

M. König, M. Stadlmaier, T. Rusch, R. Sochor, L. Merkel, S. Braunreuther, J. Schilp, MA2RA-manual assembly augmented reality assistant, 2019 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), IEEE, 2019, pp. 501–505,.

[70]

O. Korn, A. Schmidt, T. Hörz, Augmented manufacturing: a study with impaired persons on assistive systems using in-situ projection, : Proc. 6th Int. Conf. PErvasive Technol. Relat. Assist. Environ. (2013) 1–8,.

Digital Library

[71]

G. Kramida, Resolving the vergence-accommodation conflict in head-mounted displays, IEEE Trans. Vis. Comput. Graph. 22 (7) (2015) 1912–1931,.

Digital Library

[72]

Z.H. Lai, W. Tao, M.C. Leu, Z. Yin, Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing, J. Manuf. Syst. 55 (2020),.

[73]

K. Lavingia, S. Tanwar, Augmented reality and industry 4.0, A Roadmap Ind. 4. 0: Smart Prod., Sharp Bus. Sustain. Dev. (2020) 143–155.

[74]

E. Laviola, M. Gattullo, V.M. Manghisi, M. Fiorentino, A.E. Uva, Minimal AR: visual asset optimization for the authoring of augmented reality work instructions in manufacturing, Int. J. Adv. Manuf. Technol. 119 (2022) 1769–1784,.

[75]

P. Letmathe, M. Rößler, Tacit knowledge transfer and spillover learning in rampups, Int. J. Oper. Prod. Manag 39 (2019) 1099–1121,.

[76]

P. Letmathe, M. Rößler, Should firms use digital work instructions? Individual learning in an agile manufacturing setting, J. Oper. Manag. 68 (2022) 94–109,.

Digital Library

[77]

Y. Liu, S. Li, J. Wang, H. Zeng, J. Lu, A computer vision-based assistant system for the assembly of narrow cabin products, Int. J. Adv. Manuf. Technol. 76 (2015) 281–293,.

[78]

A. Liverani, G. Amati, G. Caligiana, A CAD-augmented reality integrated environment for assembly sequence check and interactive validation, Concurr. Eng. 12 (1) (2004) 67–77,.

[79]

K. van Lopik, M. Sinclair, R. Sharpe, P. Conway, A. West, Developing augmented reality capabilities for industry 4.0 small enterprises: Lessons learnt from a content authoring case study, Comput. Ind. 117 (2020),.

Digital Library

[80]

R. Maio, B. Marques, A. Santos, P. Ramalho, D. Almeida, P. Dias, B.S. Santos, Real-Time Data Monitoring of an Industry 4.0 Assembly Line using Pervasive Augmented Reality: First Impressions, IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE, 2023, pp. 414–417,.

[81]

S. Makris, G. Pintzos, L. Rentzos, G. Chryssolouris, Assembly support using AR technology based on automatic sequence generation, CIRP Ann. 62 (1) (2013) 9–12,.

[82]

F. Manuri, A. Sanna, A survey on applications of augmented reality, ACSIJ Adv. Comput. Sci.: Int. J. 5 (1) (2016) 18–27.

[83]

E. Marino, L. Barbieri, B. Colacino, A.K. Fleri, F. Bruno, An Augmented Reality inspection tool to support workers in Industry 4.0 environments, Comput. Ind. 127 (2021),.

[84]

E. Marino, F. Bruno, L. Barbieri, A. Lagudi, Benchmarking built-in tracking systems for indoor AR applications on popular mobile devices, Sensors 22 (14) (2022),.

[85]

T. Masood, J. Egger, Adopting augmented reality in the age of industrial digitalisation, Comput. Ind. 115 (2020),.

Digital Library

[86]

T. Masood, P. Sonntag, Industry 4.0: Adoption challenges and benefits for SMEs, Comput. Ind. 21 (2020),.

Digital Library

[87]

D. Mourtzis, V. Zogopoulos, F. Xanthi, Augmented reality application to support the assembly of highly customized products and to adapt to production re-scheduling, Int. J. Adv. Manuf. Technol. 105 (2019) 3899–3910,.

[88]

A. Munoz, X. Mahiques, J.E. Solanes, A. Marti, L. Gracia, J. Tornero, Mixed reality-based user interface for quality control inspection of car body surfaces, J. Manuf. Syst. 53 (2019) 75–92,.

[89]

A.Y. Nee, S.K. Ong, G. Chryssolouris, D. Mourtzis, Augmented reality applications in design and manufacturing, CIRP Ann. 61 (2) (2012) 657–679,.

[90]

L.X. Ng, Z.B. Wang, S.K. Ong, A.Y.C. Nee, Integrated product design and assembly planning in an augmented reality environment, Assem. Autom. 33 (4) (2013) 345–359,.

Digital Library

[91]

S. Ong, Y. Pang, A.Y.C. Nee, Augmented reality aided assembly design and planning, CIRP Ann. 56 (1) (2007) 49–52,.

[92]

S.K. Ong, Z.B. Wang, Augmented assembly technologies based on 3D bare-hand interaction, CIRP Ann. 60 (1) (2011) 1–4,.

[93]

V. Paelke, Augmented reality in the smart factory: Supporting workers in an industry 4.0. environment, Proceedings of the 2014 IEEE emerging technology and factory automation (ETFA), IEEE, 2014, pp. 1–4,.

[94]

Y. Pang, A.Y. Nee, S. Khim Ong, M. Yuan, K. Youcef-Toumi, Assembly feature design in an augmented reality environment, Assem. Autom. 26 (1) (2006) 34–43,.

[95]

T. Papadopoulos, S.P. Singh, K. Spanaki, A. Gunasekaran, R. Dubey, Towards the next generation of manufacturing: implications of big data and digitalization in the context of industry 4.0, Prod. Plan. Control 33 (2-3) (2022) 101–104,.

[96]

A. Peniche, C. Diaz, H. Trefftz, G. Paramo, Combining virtual and augmented reality to improve the mechanical assembly training process in manufacturing, Proc. 2012 Am. Conf. Appl. Math. (2012) 292–297.

[97]

P.B. Prasad, N. Padmaja, B.S. Kumar, A. Aravind, Industry 4.0: Augmented and virtual reality in education, In: Innovating with Augmented Reality, Auerbach Publications, 2021, pp. 29–52.

[98]

C. Qiu, S. Zhou, Z. Liu, Q. Gao, J. Tan, Digital assembly technology based on augmented reality and digital twins: a review, Virtual Real. Intell. Hardw. 1 (6) (2019) 597–610,.

[99]

R. Radkowski, J. Herrema, J. Oliver, Augmented reality-based manual assembly support with visual features for different degrees of difficulty, Int. J. Hum. -Comput. Interact. 31 (5) (2015) 337–349,.

[100]

L. Rentzos, S. Papanastasiou, N. Papakostas, G. Chryssolouris, Augmented reality for human-based assembly: using product and process semantics, IFAC Proc. Vol. 46 (15) (2013) 98–101,.

[101]

M. Rüßmann, M. Lorenz, P. Gerbert, M. Waldner, J. Justus, P. Engel, M. Harnisch, Industry 4.0: The future of productivity and growth in manufacturing industries, Boston Consult. Group 9 (1) (2015) 54–89.

[102]

J. Sääski, T. Salonen, M. Liinasuo, J. Pakkanen, M. Vanhatalo, A. Riitahuhta, Augmented reality efficiency in manufacturing industry: a case study, : Proc. Nord. Conf., Tallin., Est. (2008) 99–109.

[103]

T. Salonen, J. Sääski, M. Hakkarainen, T. Kannetis, M. Perakakis, S. Siltanen, C. Woodward, Demonstration of assembly work using augmented reality, : Proc. 6th ACM Int. Conf. Image Video Retr. (2007) 120–123,.

Digital Library

[104]

A. Sanna, F. Manuri, F. Lamberti, G. Paravati, P. Pezzolla, Using handheld devices to sup port augmented reality-based maintenance and assembly tasks, IEEE international conference on consumer electronics (ICCE), IEEE, 2015, pp. 178–179,.

[105]

G.W. Scurati, M. Gattullo, M. Fiorentino, F. Ferrise, M. Bordegoni, A.E. Uva, Converting maintenance actions into standard symbols for Augmented Reality applications in Industry 4.0, Comput. Ind. 98 (2018) 68–79,.

Digital Library

[106]

A. Seeliger, T. Netland, S. Feuerriegel, Augmented reality for machine setups: Task performance and usability evaluation in a field test, Procedia CIRP 107 (2022) 570–575,.

[107]

A. Seeliger, L. Cheng, T. Netland, Augmented reality for industrial quality inspection: An experiment assessing task performance and human factors, Comput. Ind. 151 (2023),.

Digital Library

[108]

M. Simonetto, M. Peron, G. Fragapane, F. Sgarbossa, Digital assembly assistance system in Industry 4.0 era: a case study with projected augmented reality, Advanced Manufacturing and Automation X, 10, Springer Singapore, 2021, pp. 644–651,.

[109]

M. Soori, B. Arezoo, R. Dastres, Internet of things for smart factories in industry 4.0, a review, Internet Things Cyber-Phys. Syst. (2023),.

[110]

L.F. de Souza Cardoso, F.C.M.Q. Mariano, E.R. Zorzal, A survey of industrial augmented reality, Comput. Ind. Eng. 139 (2020),.

Digital Library

[111]

A. Syberfeldt, O. Danielsson, M. Holm, L. Wang, Visual assembling guidance using augmented reality, Procedia Manuf. 1 (2015) 98–109,.

[112]

T.A. Syed, M.S. Siddiqui, H.B. Abdullah, S. Jan, A. Namoun, A. Alzahrani, A.B. Alkhodre, In-depth review of augmented reality: Tracking technologies, development tools, AR displays, collaborative AR, and security concerns, Sensors 23 (1) (2022) 126,.

[113]

A. Tang, C. Owen, F. Biocca, W. Mou, Comparative effectiveness of augmented reality in object assembly, Proc. SIGCHI Conf. Hum. Factors Comput. Syst. (2003) 73–80,.

Digital Library

[114]

Unity Technologies, 2023. AR Foundation. unity.com/unity/features/arfoundation (last accessed October 2023).

[115]

A.E. Uva, M. Fiorentino, M. Gattullo, M. Colaprico, M.F. de Ruvo, F. Marino, G. Monno, Design of a projective AR workbench for manual working stations, Augmented Reality, Virtual Reality, and Computer Graphics: Third International Conference, AVR 2016, Lecce, Italy, Springer International Publishing, 2016, pp. 358–367,.

[116]

P. Vanneste, Y. Huang, J.Y. Park, F. Cornillie, B. Decloedt, W. Van den Noortgate, Cognitive support for assembly operations by means of augmented reality: an exploratory study, Int. J. Hum. -Comput. Stud. 143 (2020),.

[117]

K. Värno, K. Mahmood, T. Otto, V. Kuts, Development of a smart workstation by using ar technology, Ann. DAAAM Proc. 30 (2019).

[118]

Q. Wang, X. Fan, M. Luo, X. Yin, W. Zhu, Construction of Human-Robot Cooperation Assembly Simulation System Based on Augmented Reality, Virtual, Augmented and Mixed Reality. Design and Interaction: 12th International Conference, VAMR 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, Springer International Publishing, 2020, pp. 629–642,.

Digital Library

[119]

Wang, X., 2016. An Integrated Augmented Reality Method to Assembly Simulation and Guidance.

[120]

X. Wang, S.K. Ong, A.Y.C. Nee, Augmented reality interfaces for industrial assembly design and planning, I: Proc. 8th Int. Conf. Interfaces Hum. Comput. Interact., Lisbon (2014) 83–90.

[121]

X. Wang, S.K. Ong, A.Y.C. Nee, Multi-modal augmented-reality assembly guidance based on bare-hand interface, Adv. Eng. Inform. 30 (3) (2016) 406–421,.

Digital Library

[122]

X. Wang, S.K. Ong, A.Y.C. Nee, Real-virtual components interaction for assembly simulation and planning, Robot. Comput. -Integr. Manuf. 41 (2016) 102–114,.

Digital Library

[123]

X. Wang, S.K. Ong, A.Y. Nee, A comprehensive survey of augmented reality assembly research, Adv. Manuf. 4 (2016) 1–22,.

[124]

Z. Wang, X. Bai, S. Zhang, M. Billinghurst, W. He, P. Wang, Y. Chen, A comprehensive review of augmented reality-based instruction in manual assembly, training and repair, Robot. Comput. -Integr. Manuf. 78 (2022),.

Digital Library

[125]

Z.B. Wang, L.X. Ng, S.K. Ong, A.Y.C. Nee, Assembly planning and evaluation in an augmented reality environment, Int. J. Prod. Res. 51 (23-24) (2013) 7388–7404,.

[126]

S. Webel, U. Bockholt, T. Engelke, N. Gavish, M. Olbrich, C. Preusche, An augmented reality training platform for assembly and maintenance skills, Robot. Auton. Syst. 61 (4) (2013) 398–403,.

Digital Library

[127]

S. Werrlich, E. Eichstetter, K. Nitsche, G. Notni, An overview of evaluations using augmented reality for assembly training tasks, Int. J. Comput. Inf. Eng. 11 (10) (2017) 1068–1074,.

[128]

S. Werrlich, K. Nitsche, G. Notni, Demand analysis for an augmented reality based assembly training, : Proc. 10th Int. Conf. pervasive Technol. Relat. Assist. Environ. (2017) 416–422,.

Digital Library

[129]

S. Wiedenmaier, O. Oehme, L. Schmidt, H. Luczak, Augmented reality (AR) for assembly processes design and experimental evaluation, Int. J. Hum. -Comput. Interact. 16 (3) (2003) 497–514,.

[130]

M. Wille, P.M. Scholl, S. Wischniewski, K. Van Laerhoven, Comparing google glass with tablet-pc as guidance system for assembling tasks, In: 11th International Conference on Wearable and Implantable Body Sensor Networks Workshops, IEEE, 2014, pp. 38–41,.

Digital Library

[131]

D. Wuttke, A. Upadhyay, E. Siemsen, A. Wuttke-Linnemann, Seeing the bigger picture? Ramping up production with the use of augmented reality, Manuf. Serv. Oper. Manag. 24 (2022) 2349–2366,.

Digital Library

[132]

M.L. Yuan, S.K. Ong, A.Y.C. Nee, Augmented reality for assembly guidance using a virtual interactive tool, Int. J. Prod. Res. 46 (7) (2008) 1745–1767,.

[133]

Zamora-Hernández, M.A., Ceciliano, J.A.C., Granados, A.V., Vargas, J.A.C., Garcia-Rodriguez, J., Azorín-López, J., 2021. Manufacturing description language for process control in industry 4.0. In:15th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2020) 15, pp. 790-799. 〈https://doi.org/10.1080/00207540600972935〉.

[134]

C. Zhang, Y. Chen, A review of research relevant to the emerging industry trends: Industry 4.0, IoT, blockchain, and business analytics, J. Ind. Integr. Manag. 5 (01) (2020) 165–180,.

[135]

F. Zhang, L. Zhao, X. Liang, Y. Qi, X. Shen, The augmented reality research progress in collaboration environment of CAR-CA, : Proc. 9th ACM SIGGRAPH Conf. Virtual-Real. Contin. its Appl. Ind. (2010) 229–236,.

Digital Library

[136]

J. Zhang, S.K. Ong, A.Y.C. Nee, RFID-assisted assembly guidance system in an augmented reality environment, Int. J. Prod. Res. 49 (13) (2011) 3919–3938,.

[137]

Z. Zhu, C. Liu, X. Xu, Visualisation of the digital twin data in manufacturing by using augmented reality, Procedia Cirp 81 (2019) 898–903,.

Cited By

Xu ZFeng ZBabaeian Jelodar MGuo B(2024)Augmented reality applications in construction productivityAdvanced Engineering Informatics10.1016/j.aei.2024.10279862:PCOnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.aei.2024.102798
Naranjo JÁlvarez MGarcia M(2024)Instructive HMI Approach Based on Augmented Reality for UFactory Lite 6 Robotic Arm Basic ControlExtended Reality10.1007/978-3-031-71710-9_7(84-100)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-71710-9_7

Recommendations

Non-overlayed Guidance in Augmented Reality: User Study in Radio-Pharmacy
Intelligent Human Computer Interaction
Abstract
In many traditional industries, production instructions are usually provided on paper. Past research has shown the effectiveness of Augmented Reality (AR) for virtual user guidance in various cases. Usually, the main focus lies on 3D overlays and ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Multi-modal augmented-reality assembly guidance based on bare-hand interface

One of the most beneficial applications of Augmented Reality (AR) technology is in the traditional manual assembly domain in manufacturing. However, in order to improve the usefulness and effectiveness of the state-of-the-art AR assembly guidance ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computers in Industry

Computers in Industry Volume 157, Issue C

May 2024

92 pages

Issue’s Table of Contents

The Authors.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 May 2024

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xu ZFeng ZBabaeian Jelodar MGuo B(2024)Augmented reality applications in construction productivityAdvanced Engineering Informatics10.1016/j.aei.2024.10279862:PCOnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.aei.2024.102798
Naranjo JÁlvarez MGarcia M(2024)Instructive HMI Approach Based on Augmented Reality for UFactory Lite 6 Robotic Arm Basic ControlExtended Reality10.1007/978-3-031-71710-9_7(84-100)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-71710-9_7

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents