Evaluation of AR Pattern Guidance Methods for a Surface Cleaning Task
Authors: 
Jeroen Ceyssens, Mathias Jans, Gustavo Rovelo Ruiz, 
Kris Luyten, Fabian Di FioreAuthors Info & Claims
Article No.: 43, Pages 1 - 11
Abstract
Cleanroom cleaning is a surface coverage task where the pattern should be followed correctly, and the entire surface should be covered. We investigate the efficacy of augmented reality (AR) by implementing various pattern guidance designs to enhance a cleanroom cleaning task. We developed an AR guidance system for cleaning procedures and evaluated four distinct pattern guidance methods: (1) breadcrumbs, (2) examples, (3) middle lines, and (4) outlines. We vary the instructions on the entire surface or as a single step. To measure performance, accuracy, and user satisfaction associated with each guidance method, we conducted a large-scale (n=864) between-subjects study. Our findings indicate that single step instructions proved to be more intuitive and efficient than full instructions, especially for the breadcrumbs. We also discussed the implications of our results for the development of AR applications for surface coverage and pattern optimization.
Supplemental Material
MP4 File
Video, teaser video, and appendices of significant results.
- Download
- 31.46 MB
MP4 File
Video, teaser video, and appendices of significant results.
- Download
- 16.29 MB
PDF File
Video, teaser video, and appendices of significant results.
- Download
- 539.92 KB
References
[1]
Salvador S. Agati, Rudieri D. Bauer, Marcelo Da S. Hounsell, and Aleksander S. Paterno. 2020. Augmented Reality for Manual Assembly in Industry 4.0: Gathering Guidelines. In 2020 22nd Symposium on Virtual and Augmented Reality (SVR). IEEE, 179–188. https://doi.org/10.1109/SVR51698.2020.00039 Place: Porto de Galinhas, Brazil.
[2]
Per Backlund, Henrik Engstrom, Cecilia Hammar, Mikael Johannesson, and Mikael Lebram. 2007. Sidh - a Game Based Firefighter Training Simulation. In 2007 11th International Conference Information Visualization (IV ’07). IEEE, 899–907. https://doi.org/10.1109/IV.2007.100 Place: Zurich, Switzerland.
[3]
Donald J. Berndt and James Clifford. 1994. Using dynamic time warping to find patterns in time series. In Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining(AAAIWS’94). AAAI Press, 359–370.
[4]
Jeroen Ceyssens, Bram Van Deurzen, Gustavo Rovelo Ruiz, Kris Luyten, and Fabian Di Fiore. 2023. AR Guidance Design for Line Tracing Speed Control. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 1055–1063. https://doi.org/10.1109/ISMAR59233.2023.00122 Place: Sydney, Australia.
[5]
Lea M. Daling and Sabine J. Schlittmeier. 2024. Effects of Augmented Reality-, Virtual Reality-, and Mixed Reality–Based Training on Objective Performance Measures and Subjective Evaluations in Manual Assembly Tasks: A Scoping Review. Human Factors: The Journal of the Human Factors and Ergonomics Society 66, 2 (Feb. 2024), 589–626. https://doi.org/10.1177/00187208221105135
[6]
Hans J. Eysenck and Warren Thompson. 1966. THE EFFECTS OF DISTRACTION ON PURSUIT ROTOR LEARNING, PERFORMANCE AND REMINISCENCE. British Journal of Psychology 57, 1 (May 1966), 99–106. https://doi.org/10.1111/j.2044-8295.1966.tb01009.x
[7]
Mana Fukasawa and Yu Nakayama. 2022. Spatial Augmented Reality Assistance System with Accelerometer and Projection Mapping at Cleaning Activities. In ACM SIGGRAPH 2022 Posters. ACM, 1–2. https://doi.org/10.1145/3532719.3543245 Place: Vancouver BC Canada.
[8]
S. Garrido-Jurado, R. Muñoz-Salinas, F.J. Madrid-Cuevas, and M.J. Marín-Jiménez. 2014. Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition 47, 6 (June 2014), 2280–2292. https://doi.org/10.1016/j.patcog.2014.01.005
[9]
Janet K. Gibbs, Marco Gillies, and Xueni Pan. 2022. A comparison of the effects of haptic and visual feedback on presence in virtual reality. International Journal of Human-Computer Studies 157 (Jan. 2022), 102717. https://doi.org/10.1016/j.ijhcs.2021.102717
[10]
Florian Jeanne, Indira Thouvenin, and Alban Lenglet. 2017. A study on improving performance in gesture training through visual guidance based on learners’ errors. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. ACM, 1–10. https://doi.org/10.1145/3139131.3139144 Place: Gothenburg Sweden.
[11]
Lasse Jensen and Flemming Konradsen. 2018. A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies 23, 4 (July 2018), 1515–1529. https://doi.org/10.1007/s10639-017-9676-0
[12]
Krithikashree Lakshminarayanan, Mayank Arvindbhai Patel, Zia Din, and Lingguang Song. 2023. Lessons Learned from Developing and Testing an Augmented Reality Application for Just-in-Time Information Delivery to Improve Construction Safety. In Proceedings of the Canadian Society of Civil Engineering Annual Conference 2022, Rishi Gupta, Min Sun, Svetlana Brzev, M. Shahria Alam, Kelvin Tsun Wai Ng, Jianbing Li, Ashraf El Damatty, and Clark Lim (Eds.). Vol. 363. Springer International Publishing, Cham, 229–245. https://doi.org/10.1007/978-3-031-34593-7_15
[13]
Benedikt Lauber and Martin Keller. 2014. Improving motor performance: Selected aspects of augmented feedback in exercise and health. European Journal of Sport Science 14, 1 (Feb. 2014), 36–43. https://doi.org/10.1080/17461391.2012.725104
[14]
Dieter Lerner, Stefan Mohr, Jonas Schild, Martin Göring, and Thomas Luiz. 2020. An Immersive Multi-User Virtual Reality for Emergency Simulation Training: Usability Study. JMIR Serious Games 8, 3 (July 2020), e18822. https://doi.org/10.2196/18822
[15]
Jen-Shuo Liu, Carmine Elvezio, Barbara Tversky, and Steven Feiner. 2021. Using Multi-Level Precueing to Improve Performance in Path-Following Tasks in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 27, 11 (Nov. 2021), 4311–4320. https://doi.org/10.1109/TVCG.2021.3106476
[16]
Jen-Shuo Liu, Barbara Tversky, and Steven Feiner. 2022. Precueing Sequential Rotation Tasks in Augmented Reality. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology. ACM, 1–11. https://doi.org/10.1145/3562939.3565641 Place: Tsukuba Japan.
[17]
Jen-Shuo Liu, Barbara Tversky, and Steven Feiner. 2023. Cueing Sequential 6DoF Rigid-Body Transformations in Augmented Reality. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 356–365. https://doi.org/10.1109/ISMAR59233.2023.00050 Place: Sydney, Australia.
[18]
Jen-Shuo Liu, Portia Wang, Barbara Tversky, and Steven Feiner. 2022. Adaptive Visual Cues for Guiding a Bimanual Unordered Task in Virtual Reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 431–440. https://doi.org/10.1109/ISMAR55827.2022.00059 Place: Singapore, Singapore.
[19]
Masashi Narita and Takafumi Matsumaru. 2015. Calligraphy-stroke learning support system using projection. In 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 640–645. https://doi.org/10.1109/ROMAN.2015.7333576 Place: Kobe, Japan.
[20]
Akira Nomoto, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2016. Supporting Precise Manual-handling Task using Visuo-haptic Interaction. In Proceedings of the 7th Augmented Human International Conference 2016. ACM, 1–8. https://doi.org/10.1145/2875194.2875216 Place: Geneva Switzerland.
[21]
Junghwan Park, Meelim Kim, Mohamed El Mistiri, Rachael Kha, Sarasij Banerjee, Lisa Gotzian, Guillaume Chevance, Daniel E Rivera, Predrag Klasnja, and Eric Hekler. 2023. Advancing Understanding of Just-in-Time States for Supporting Physical Activity (Project JustWalk JITAI): Protocol for a System ID Study of Just-in-Time Adaptive Interventions. JMIR Research Protocols 12 (Sept. 2023), e52161. https://doi.org/10.2196/52161
[22]
Jay Pratt and Richard A. Abrams. 1994. Action-centered inhibition: Effects of distractors on movement planning and execution. Human Movement Science 13, 2 (June 1994), 245–254. https://doi.org/10.1016/0167-9457(94)90039-6
[23]
Aylen Ricca, Amine Chellali, and Samir Otmane. 2020. Influence of hand visualization on tool-based motor skills training in an immersive VR simulator. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 260–268. https://doi.org/10.1109/ISMAR50242.2020.00049 Place: Porto de Galinhas, Brazil.
[24]
Tim Sandle. 2012. The CDC Handbook: A Guide to Cleaning and Disinfecting Cleanrooms.
[25]
Maurice Suckling. 2020. If It Works, Break It. In Professional Techniques for Video Game Writing (2 ed.), Wendy Despain (Ed.). CRC Press, 257–269. https://doi.org/10.1201/9780429196539-19
[26]
Spyros Vosinakis and Panayiotis Koutsabasis. 2018. Evaluation of visual feedback techniques for virtual grasping with bare hands using Leap Motion and Oculus Rift. Virtual Reality 22, 1 (March 2018), 47–62. https://doi.org/10.1007/s10055-017-0313-4
[27]
Zhuo Wang, Xiaoliang Bai, Shusheng Zhang, Mark Billinghurst, Weiping He, Peng Wang, Weiqi Lan, Haitao Min, and Yu Chen. 2022. A comprehensive review of augmented reality-based instruction in manual assembly, training and repair. Robotics and Computer-Integrated Manufacturing 78 (Dec. 2022), 102407. https://doi.org/10.1016/j.rcim.2022.102407
[28]
Nicholas C. Wilson, Mehmet Kosa, Casper Harteveld, Mohsen Moghaddam, and Kemi Jona. 2023. Exploring Extended Reality for Scaffolding Psychomotor-Intensive Tasks in Complex Real-World Settings. 2077–2078. https://doi.org/10.22318/icls2023.177665
[29]
Biao Xie, Huimin Liu, Rawan Alghofaili, Yongqi Zhang, Yeling Jiang, Flavio Destri Lobo, Changyang Li, Wanwan Li, Haikun Huang, Mesut Akdere, Christos Mousas, and Lap-Fai Yu. 2021. A Review on Virtual Reality Skill Training Applications. Frontiers in Virtual Reality 2 (April 2021), 645153. https://doi.org/10.3389/frvir.2021.645153
[30]
Ungyeon Yang and Gerard Jounghyun Kim. 2002. Implementation and Evaluation of “Just Follow Me”: An Immersive, VR-Based, Motion-Training System. Presence: Teleoperators and Virtual Environments 11, 3 (June 2002), 304–323. https://doi.org/10.1162/105474602317473240
[31]
Xin Yi, Xueyang Wang, Jiaqi Li, and Hewu Li. 2023. Examining the Fine Motor Control Ability of Linear Hand Movement in Virtual Reality. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, 427–437. https://doi.org/10.1109/VR55154.2023.00058 Place: Shanghai, China.
[32]
Kevin Yu, Daniel Ostler, Jonas Fuchtmann, Anna Zapaishchykova, Maximilian Berlet, Nassir Navab, Hubertus Feussner, and Dirk Wilhelm. 2021. Clean-AR: Using Augmented Reality for Reducing the Risk of Contamination from Airborne Disease Agents on Surfaces. Current Directions in Biomedical Engineering 7, 1 (Aug. 2021), 6–10. https://doi.org/10.1515/cdbme-2021-1002
[33]
Xingyao Yu. 2023. [DC]Limb Motion Guidance in Extended Reality. In 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 967–968. https://doi.org/10.1109/VRW58643.2023.00326 Place: Shanghai, China.
[34]
Xingyao Yu, Katrin Angerbauer, Peter Mohr, Denis Kalkofen, and Michael Sedlmair. 2020. Perspective Matters: Design Implications for Motion Guidance in Mixed Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 577–587. https://doi.org/10.1109/ISMAR50242.2020.00085 Place: Porto de Galinhas, Brazil.
[35]
Shang Zhao, Xiao Xiao, Qiyue Wang, Xiaoke Zhang, Wei Li, Lamia Soghier, and James Hahn. 2020. An Intelligent Augmented Reality Training Framework for Neonatal Endotracheal Intubation. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 672–681. https://doi.org/10.1109/ISMAR50242.2020.00097 Place: Porto de Galinhas, Brazil.
Index Terms
- Evaluation of AR Pattern Guidance Methods for a Surface Cleaning Task
Recommendations
Exhibition approach using an AR and VR pillar
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive ApplicationsThis demonstration presents a development of an Augmented Reality (AR) and Virtual Reality (AR) pillar, a novel approach for showing AR and VR content in a public setting. A pillar in a public exhibition venue was converted to a four-sided AR and VR ...
Impact of augmented reality guidance for car repairs on novice users of AR: a field experiment on familiar and unfamiliar tasks
MuC '20: Proceedings of Mensch und Computer 2020The use of augmented reality (AR) guidance is seen as an opportunity to address the growing complexity of industrial tasks. Previous research showed benefits of AR for different industrial tasks especially for novice users, while other research suggests ...
From VR to AR: Adding AR Functionality to an Existing VR Software Framework
SVR '12: Proceedings of the 2012 14th Symposium on Virtual and Augmented RealityWe present our approach to extend a Virtual Reality software framework towards the use for Augmented Reality applications. Although VR and AR applications have very similar requirements in terms of abstract components (like 6DOF input, stereoscopic ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
633 pages
ISBN:9798400705359
DOI:10.1145/3641825
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
VRST '24: 30th ACM Symposium on Virtual Reality Software and Technology
October 9 - 11, 2024
Trier, Germany
Acceptance Rates
Overall Acceptance Rate 66 of 254 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 42Total Downloads
- Downloads (Last 12 months)42
- Downloads (Last 6 weeks)42
Reflects downloads up to 16 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format