research-article

Scalable and responsive information for industrial maintenance work: developing XR support on smart glasses for maintenance technicians

Authors:

Sanni Siltanen,

Hanna HeinonenAuthors Info & Claims

AcademicMindtrek '20: Proceedings of the 23rd International Conference on Academic Mindtrek

Pages 100 - 109

https://doi.org/10.1145/3377290.3377296

Published: 06 February 2020 Publication History

Abstract

This paper describes the process and results of bringing responsive and scalable technical documentation to smart glasses to support industrial maintenance. Development and testing was done in four development cycles to discover how maintenance information can be delivered to smart glasses to support maintenance technicians. Test case was elevator maintenance, and several user tests were performed in a real or realistic environment by real maintenance experts. The concept of using smart glasses to view technical information during a maintenance task was received very well by the test users. This study confirms that DITA XML is a good candidate for the creation of technical information content for smart glasses, but information design is needed to ensure the scalability and usability of the information.

References

[1]

ASD-STE100 official home page. Accessed 6 November 2019. Available at: http://www.asd-ste100.org/

[2]

Janelle L Aitken and Hayden A Ross. 2019. Mixed Reality Training Method: Performance Benefits for Routine Vehicle Maintenance Tasks. In Volume 436 of DTA report Defence Technology Agency. 26 pages.

[3]

Dawn M. Armfield, Ann Hill Duin and Isabel Pedersen. 2018. Experiencing Content: Heuristics for Human-Centered Design for Augmented Reality. In 2018 IEEE International Professional Communication Conference (ProComm), 241--247.

[4]

Laura Bellamy, Michelle Carey and Jenifer Schlotfeldt. 2012. DITA Best Practices: A Roadmap for Writing, Editing, and Architecting in DITA. IBM Press, Upper Saddle River, N.J.

[5]

Alisa Burova, John Mäkelä, Jaakko Hakulinen, Tuuli Keskinen, Hanna Heinonen, Sanni Siltanen and Markku Turunen. 2020. Utilizing VR and Gaze Tracking to Develop AR Solutions for Industrial Maintenance. In CHI '20, April 25--30, 2020, Honolulu, HI, USA.

Digital Library

[6]

Iñigo Fernández del Amo, John Ahmet Erkoyuncu, Rajkumar Roy, Stephen Wilding. 2018. Augmented Reality in Maintenance: An information-centred design framework. In Procedia Manufacturing, vol 19, 148--155.

[7]

Markus Funk, Thomas Kosch, Scott W. Greenwald, and Albrecht Schmidt. 2015. A benchmark for interactive augmented reality instructions for assembly tasks. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia (MUM '15). Association for Computing Machinery, New York, NY, USA, 253--257.

Digital Library

[8]

Ray Gallon and Andy McDonald. 2016. Context Sensing and Information 4.0. In TC World, November 1, 14--18, 2016.

[9]

Michele Gattullo, Antonio E. Uva, Michele Fiorentino, Giulia Wally Scurati and Francesco Ferrise. 2017. From Paper Manual to AR Manual: Do We Still Need Text? In Procedia Manufacturing, vol 11, 1303--1310.

[10]

Steven Henderson and Steven Feiner. 2011. Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair. In IEEE Transactions on Visualization and Computer Graphics, vol 17, issue 10, 1355--1368.

Digital Library

[11]

Robert R. Johnson. 1998. User-centered technology: a rhetorical theory for computers and other mundane artifacts. State University of New York Press, Albany.

[12]

Eija Kaasinen, Susanna Aromaa, Antti Väätänen, Ville Mäkelä, Jaakko Hakulinen, Juho Hella, Tuuli Keskinen, and Markku Turunen. 2018. Mobile Service Technician 4.0: Knowledge-Sharing Solutions for Industrial Field Maintenance. In Interaction Design and Architecture(s) Journal, N. 38, 6--27.

[13]

Christian Knopfle, Jens Weidenhausen, Laurent Chauvigne and Ingo Stock. 2005. Template based authoring for AR based service scenarios. In IEEE Proceedings. VR 2005. Virtual Reality, 2005., Bonn, 237--240.

[14]

Peter Mohr, Bernhard Kerbl, Michael Donoser, Dieter Schmalstieg and Denis Kalkofen. 2015. Retargeting Technical Documentation to Augmented Reality. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). Association for Computing Machinery, New York, NY, USA, 3337--3346.

Digital Library

[15]

Riccardo Palmarini, John Ahmet Erkoyuncu, Rajkumar Roy, Hosein Torabmostaedi. 2018. A systematic review of augmented reality applications in maintenance. In Robotics and Computer Integrated Manufacturing, vol 49, 215--228.

[16]

Michael Prilla, Marc Janssen and Timo Kunzendorff,. 2019. How to Interact with Augmented Reality Head Mounted Devices in Care Work? A Study Comparing Handheld Touch (Hands-on) and Gesture (Hands-free) Interaction. In AIS Transactions on Human-Computer Interaction, vol 11, issue 3, 157--178.

[17]

Eric Ries. 2011. The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses. Crown Publ. Group.

[18]

Michael J. Salvo. 2001. Ethics of engagement: User-centered design and rhetorical methodology. In Technical Communication Quarterly, vol 10, issue 3, 273--290.

[19]

Christopher A Sanchez and Jennifer Wiley. 2009. To Scroll or Not to Scroll: Scrolling, Working Memory Capacity, and Comprehending Complex Texts. In Human Factors: The Journal of the Human Factors and Ergonomics Society, (December 10, 2009), 730--738.

[20]

Giulia Wally Scurati, Michele Gattullo, Michele Fiorentino, Francesco Ferrise, Monica Bordegoni and Antonio Emmanuele Uva. 2018. Converting maintenance actions into standard symbols for Augmented Reality applications. In Industry 4.0. Comput. Ind., 98, 68--79.

[21]

Antonio E Uva, Michele Gattullo, Vito M. Manghisi, Daniele Spagnulo, Giuseppe L Cascella and Michele Fiorentino. 2018. Evaluating the effectiveness of spatial augmented reality in smart manufacturing: a solution for manual working stations. In The International Journal of Advanced Manufacturing Technology, 94 (Jan 2018).

[22]

Jenni Virtaluoto, Tytti Suojanen and Suvi Isohella. 2021. Minimalism heuristics revisited: Developing a Practical Review Tool. Preprint for Technical Communication Feb 2021.

[23]

Hui Xue, Puneet Sharma and Fridolin Wild. 2018. User Satisfaction in Augmented Reality-Based Training Using Microsoft HoloLens. Preprint.

Cited By

Guo JBenton ATian NMa WFeffer NZhou ZRen L(2023)EyeClick:A Robust Two-Step Eye-Hand Interaction for Text Entry in Augmented Reality GlassesAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3615814(1-4)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3615814
Memmesheimer VEbert A(2023)A Human-Centered Framework for Scalable Extended Reality SpacesProceedings of the 3rd Conference on Physical Modeling for Virtual Manufacturing Systems and Processes10.1007/978-3-031-35779-4_7(111-128)Online publication date: 11-Jul-2023
https://doi.org/10.1007/978-3-031-35779-4_7
Heinonen HVirtaluoto JSuomivuori TForsman KKangas TSiltanen S(2022)Minimalism for the Win: User-Centered Design for Guidance in Industrial MaintenanceIEEE Transactions on Professional Communication10.1109/TPC.2022.320546865:4(485-501)Online publication date: Dec-2022
https://doi.org/10.1109/TPC.2022.3205468
Show More Cited By

Index Terms

Scalable and responsive information for industrial maintenance work: developing XR support on smart glasses for maintenance technicians
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
2. Information systems
  1. Information retrieval
    1. Document representation
      1. Document topic models
  2. Information systems applications

Recommendations

Utilizing VR and Gaze Tracking to Develop AR Solutions for Industrial Maintenance
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Augmented reality (AR) presents a variety of possibilities for industrial maintenance. However, the development of real-world AR solutions has been limited due to the technological capabilities and uncertainty with respect to safety at deployment. We ...
Asynchronous industrial collaboration: How virtual reality and virtual tools aid the process of maintenance method development and documentation creation
Abstract
In the light of Industry 4.0, the field of Industrial Maintenance faces a large digital transformation, adopting Extended Reality (XR) technologies to aid industrial operations. For the manufacturing corporations that provide ...
Highlights
- This study provides qualitative insight on how VR is used to aid maintenance method and technical documentation creation.
Natural Language Processing Approaches in Industrial Maintenance: A Systematic Literature Review
Abstract
Industrial maintenance plays a crucial role in manufacturing by significantly reducing machine failure time and minimizing costs, especially in the revolution of Industry 4.0. Consequently, researchers and industrial engineers have continuously ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

AcademicMindtrek '20: Proceedings of the 23rd International Conference on Academic Mindtrek

January 2020

182 pages

ISBN:9781450377744

DOI:10.1145/3377290

Conference Chair:
Markku Turunen
Tampere University

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 February 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AcademicMindtrek '20

AcademicMindtrek '20: Academic Mindtrek 2020

January 29 - 30, 2020

Tampere, Finland

Acceptance Rates

AcademicMindtrek '20 Paper Acceptance Rate 24 of 45 submissions, 53%;

Overall Acceptance Rate 110 of 207 submissions, 53%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
363
Total Downloads

Downloads (Last 12 months)40
Downloads (Last 6 weeks)4

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Guo JBenton ATian NMa WFeffer NZhou ZRen L(2023)EyeClick:A Robust Two-Step Eye-Hand Interaction for Text Entry in Augmented Reality GlassesAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3615814(1-4)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3615814
Memmesheimer VEbert A(2023)A Human-Centered Framework for Scalable Extended Reality SpacesProceedings of the 3rd Conference on Physical Modeling for Virtual Manufacturing Systems and Processes10.1007/978-3-031-35779-4_7(111-128)Online publication date: 11-Jul-2023
https://doi.org/10.1007/978-3-031-35779-4_7
Heinonen HVirtaluoto JSuomivuori TForsman KKangas TSiltanen S(2022)Minimalism for the Win: User-Centered Design for Guidance in Industrial MaintenanceIEEE Transactions on Professional Communication10.1109/TPC.2022.320546865:4(485-501)Online publication date: Dec-2022
https://doi.org/10.1109/TPC.2022.3205468
Burova AMäkelä JHeinonen HPalma PHakulinen JOpas VSiltanen SRaisamo RTurunen M(2022)Asynchronous industrial collaboration: How virtual reality and virtual tools aid the process of maintenance method development and documentation creationComputers in Industry10.1016/j.compind.2022.103663140(103663)Online publication date: Sep-2022
https://doi.org/10.1016/j.compind.2022.103663
Davoli LParaskevopoulos ICampanella CBauro SVio TAbrardo AFerrari G(2021)Ultrasonic-Based Environmental Perception for Mobile 5G-Oriented XR ApplicationsSensors10.3390/s2104132921:4(1329)Online publication date: 13-Feb-2021
https://doi.org/10.3390/s21041329
Kim DChoi Y(2021)Applications of Smart Glasses in Applied Sciences: A Systematic ReviewApplied Sciences10.3390/app1111495611:11(4956)Online publication date: 27-May-2021
https://doi.org/10.3390/app11114956
Cloete RNorval CSingh J(2021)Auditable Augmented/Mixed/Virtual RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34950015:4(1-24)Online publication date: 30-Dec-2021
https://dl.acm.org/doi/10.1145/3495001
Heinonen HSiltanen SAhola P(2021)Information Design for Small Screens: Toward Smart Glass Use in Guidance for Industrial MaintenanceIEEE Transactions on Professional Communication10.1109/TPC.2021.311061664:4(407-426)Online publication date: Dec-2021
https://doi.org/10.1109/TPC.2021.3110616
Burova AMäkelä JHakulinen JKeskinen THeinonen HSiltanen STurunen MBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Utilizing VR and Gaze Tracking to Develop AR Solutions for Industrial MaintenanceProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376405(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376405

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents