research-article

Comparing Order Picking Guidance with Microsoft Hololens, Magic Leap, Google Glass XE and Paper

Authors:

Georgianna Lin,

Tanmoy Panigrahi,

Devansh Jatin Ponda,

Pramod Kotipalli,

Thad StarnerAuthors Info & Claims

HotMobile '21: Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications

Pages 133 - 139

https://doi.org/10.1145/3446382.3448729

Published: 24 February 2021 Publication History

Abstract

Head-worn displays (HWDs) are an efficient and cost-effective means to guide users in order picking, a task that requires users to alternate their attention between the physical environment and the HWD's virtual image. After training 12 participants to expertise in picking, we compare three significantly different HWDs: Magic Leap One, Microsoft Hololens, and Google Glass Explorer Edition against paper pick lists (the industry standard). We find that previous findings on HWD benefits during such tasks are not reflected in all HWDs, suggesting that hardware design significantly influences efficacy. Based on experimental results and observations, we highlight challenges such as head weight, mounting, display clarity, field of view (FOV), and display position and discuss their possible effects on user comfort, user preference, task speed, and task accuracy.

References

[1]

Randall E Bailey, Jarvis J Arthur III, Lance Prinzel III, and Lynda J Kramer. 2007. Evaluation of head-worn display concepts for commercial aircraft taxi operations. In Head-and Helmet-Mounted Displays XII: Design and Applications, Vol. 6557. International Society for Optics and Photonics, 65570Y.

[2]

Randall E Bailey, Kevin J Shelton, and JJ Arthur III. 2011. Head-worn displays for NextGen. In Head-and Helmet-Mounted Displays XVI: Design and Applications, Vol. 8041. International Society for Optics and Photonics, 80410G.

[3]

Ozan Cakmakci and Jannick Rolland. 2006. Head-worn displays: a review. Journal of display technology 2, 3 (2006), 199--216.

[4]

Soon Hau Chua, Simon T. Perrault, Denys J. C. Matthies, and Shengdong Zhao. 2016. Positioning Glass: Investigating Display Positions of Monocular Optical See-Through Head-Mounted Display. In Chinese CHI (San Jose, USA) (ChineseCHI2016). ACM, New York, NY, USA, Article 1, 6 pages.

Digital Library

[5]

René De Koster, Tho Le Duc, and Kees Jan Roodbergen. 2006. Design and Control of Warehouse Order Picking: A Literature Review. European Journal of Operational Research 182, 2 (03 2006), 481--501.

[6]

Google. [n.d.]. Tech Specs - Glass. https://www.google.com/glass/tech-specs/

[7]

A. Guo, X. Wu, Z. Shen, T. Starner, H. Baumann, and S. Gilliland. 2015. Order Picking with Head-Up Displays. Computer 48, 6 (June 2015), 16--24.

Digital Library

[8]

Hongwei Guo, Facheng Zhao, Wuhong Wang, and Xiaobei Jiang. 2014. Analyzing Drivers' Attitude towards HUD System Using a Stated Preference Survey. Advances in Mechanical Engineering 6 (2014), 380647.

[9]

Baumann Hannes. 2013. Order picking supported by mobile computing. Ph.D. Dissertation. University of Bremen.

[10]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human mental workload 1, 3 (1988), 139--183.

[11]

Malcolm Haynes and Thad Starner. 2017. Effects of Head-worn Display Lateral Position on Visual Comfort While Reading. In International Symposium on Wearable Computers (Maui, Hawaii) (ISWC '17). ACM, New York, NY, USA, 176--177.

[12]

Malcolm Gibran Haynes. 2017. Lateral positioning of a monocular head-worn display. Ph.D. Dissertation. Georgia Institute of Technology.

[13]

Ian P Howard, Brian J Rogers, et al. 1995. Binocular vision and stereopsis. Oxford University Press, USA.

[14]

John J. Bartholdi III and Steven Todd Hackman. 2017. Warehouse & Distribution Science (release 0.98 ed.). The Supply Chain & Logistics Institute, Georgia Institute of Technology, Atlanta.

[15]

Arthur T. Jersild. 1927. Mental set and shift. Archives of psychology.

[16]

James F Knight and Chris Baber. 2007. Effect of head-mounted displays on posture. Human factors 49, 5 (2007), 797--807.

[17]

Eugene L. Lawler. 1997. The traveling salesman problem: a guided tour of combinatorial optimization. Wiley, New Jersey, NJ, USA.

[18]

Magic Leap. 2018. Magic Leap 1. https://www.magicleap.com/magicleap-1

[19]

Microsoft. 2018. Hologram stability - Mixed Reality. https://docs.microsoft.com/en-us/windows/mixed-reality/hologram-stability

[20]

Nela Murauer, Florian Müller, Sebastian Günther, Dominik Schön, Nerina Pflanz, and Markus Funk. 2018. An Analysis of Language Impact on Augmented Reality Order Picking Training. In PErvasive Technologies Related to Assistive Environments Conference. 351--357.

[21]

L. J. Najjar, J. C. Thompson, and J. Ockerman. 1997. A wearable computer for quality assurance inspectors in a food processing plant: Semantic Scholar. Digest of Papers. First International Symposium on Wearable Computers.

[22]

Maida Napolitano. 2012. 2012 Warehouse/DC Operations Survey: Mixed signals ... https://www.logisticsmgmt.com/article/2012_warehouse_dc_operations_survey_mixed_signals

[23]

Pritchett A. Ockerman, J. 2000. A review and reappraisal of task guidance: Aiding workers in procedure following. International Journal of Cognitive Ergonomics (2000), 191--212.

[24]

Robert P O'Shea, Amanda Parker, David La Rooy, and David Alais. 2009. Monocular rivalry exhibits three hallmarks of binocular rivalry: Evidence for common processes. Vision research 49, 7 (2009), 671--681.

[25]

H. Pashler. 2008. Task Switching and Multitask Performance. Control of cognitive processes (2008).

[26]

Robert Patterson, Marc Winterbottom, Byron Pierce, and Robert Fox. 2007. Binocular rivalry and head-worn displays. Human factors 49, 6 (2007), 1083--1096.

[27]

Roland Richards. 2018. Choosing the Most Suitable AR-enabled Wearable for Industrial Use. Portland State University PDXScholar.

[28]

MacIntyre B. Walker B. N. Robertson, C. M. 2008. An evaluation of graphical context when the graphics are outside of the task area. 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (2008), 73--76.

Digital Library

[29]

Charu Thomas, Theodore Panagiotopoulos, Pramod Kotipalli, Malcolm Haynes, and Thad Starner. 2018. RF-pick: Comparing Order Picking Using a HUD with Wearable RFID Verification to Traditional Pick Methods. In ISWC (Singapore, Singapore) (ISWC '18). ACM, New York, NY, USA, 168--175.

[30]

Kimberly A Weaver, Hannes Baumann, Thad Starner, Hendrick Iben, and Michael Lawo. 2010. An empirical task analysis of warehouse order picking using head-mounted displays. In SIGCHI Conference on Human Factors in Computing Systems. ACM, 1695--1704.

Digital Library

[31]

Rand Whillock and Christopher A. Miller. 1996. Development and testing of HMD display formats for M1A2 tank commanders. Search the world's largest collection of optics and photonics applied research.

[32]

Yan Yan, Ke Chen, Yu Xie, Yiming Song, and Yonghong Liu. 2018. The effects of weight on comfort of virtual reality devices. In Applied Human Factors and Ergonomics. Springer, 239--248.

[33]

Xianjun Sam Zheng, Cedric Foucault, Patrik Matos da Silva, Siddharth Dasari, Tao Yang, and Stuart Goose. 2015. Eye-wearable technology for machine maintenance: Effects of display position and hands-free operation. In Human Factors in Computing Systems. ACM, 2125--2134.

Cited By

Mosur PKimmel EArora PSingh RMadiwale AKang JStarner TKostakos VKay JHoang T(2024)Stepping into AR: Exploring Optimal Positioning for Monocular Head-Worn Displays for Reading on the GoCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678383(844-850)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678383
Wu GQian JCastelo Quispe SChen SRulff JSilva C(2024)ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642772(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642772
Nasirinejad MReilly D(2024)mF+CInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103170182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103170
Show More Cited By

Index Terms

Comparing Order Picking Guidance with Microsoft Hololens, Magic Leap, Google Glass XE and Paper
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Empirical studies in ubiquitous and mobile computing

Recommendations

Towards Finding the Optimum Position in the Visual Field for a Head Worn Display Used for Task Guidance with Non-registered Graphics

Where should a HWD be placed in a user's visual field? We present two studies that compare comfort, preference, task efficiency and accuracy for various HWD positions. The first study offsets a 9.2° horizontal field-of-view (FOV) display temporally (...
Comparing order picking assisted by head-up display versus pick-by-light with explicit pick confirmation
ISWC '15: Proceedings of the 2015 ACM International Symposium on Wearable Computers

Manual order picking is an important part of distribution. Many techniques have been proposed to improve pick efficiency and accuracy. Previous studies compared pick-by-HUD (Head-Up Display) with pick-by-light but without the explicit pick confirmation ...
A comparison of order picking assisted by head-up display (HUD), cart-mounted display (CMD), light, and paper pick list
ISWC '14: Proceedings of the 2014 ACM International Symposium on Wearable Computers

Wearable and contextually aware technologies have great applicability in task guidance systems. Order picking is the task of collecting items from inventory in a warehouse and sorting them for distribution; this process accounts for about 60% of the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HotMobile '21: Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications

February 2021

192 pages

ISBN:9781450383233

DOI:10.1145/3446382

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 February 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

HotMobile '21

Sponsor:

SIGMOBILE

HotMobile '21: The 22nd International Workshop on Mobile Computing Systems and Applications

February 24 - 26, 2021

Virtual, United Kingdom

Acceptance Rates

Overall Acceptance Rate 96 of 345 submissions, 28%

Upcoming Conference

HOTMOBILE '25

Sponsor:
sigmobile

The 26th International Workshop on Mobile Computing Systems and Applications

February 26 - 27, 2025

La Quinta , CA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
599
Total Downloads

Downloads (Last 12 months)100
Downloads (Last 6 weeks)12

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mosur PKimmel EArora PSingh RMadiwale AKang JStarner TKostakos VKay JHoang T(2024)Stepping into AR: Exploring Optimal Positioning for Monocular Head-Worn Displays for Reading on the GoCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678383(844-850)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678383
Wu GQian JCastelo Quispe SChen SRulff JSilva C(2024)ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642772(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642772
Nasirinejad MReilly D(2024)mF+CInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103170182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103170
Li KKhaday SPeng L(2023)Assessments of Order-Picking Tasks Using a Paper List and Augmented Reality Glasses with Different Order Information DisplaysApplied Sciences10.3390/app13221222213:22(12222)Online publication date: 10-Nov-2023
https://doi.org/10.3390/app132212222
Fu JRota ALi SZhao JLiu QIovene EFerrigno GDe Momi E(2023)Recent Advancements in Augmented Reality for Robotic Applications: A SurveyActuators10.3390/act1208032312:8(323)Online publication date: 13-Aug-2023
https://doi.org/10.3390/act12080323
Song YArora PSingh RVaradharajan SHaynes MStarner T(2023)Going Blank Comfortably: Positioning Monocular Head-Worn Displays When They are InactiveProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611375(114-118)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611375
Lin GLi JFazly APavlovic VTruong K(2023)Identifying Multimodal Context Awareness Requirements for Supporting User Interaction with Procedural VideosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581006(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581006
Martinez CColard MFowler DLee YMeunier-Della-Gatta SMillard KRainouard FToubi S(2023)Evaluation of a pixelated holographic display concept for a near-eye display: recent results and technological developmentsAdvances in Display Technologies XIII10.1117/12.2650111(19)Online publication date: 14-Mar-2023
https://doi.org/10.1117/12.2650111
Abate ACascone LDel Sorbo SGalati EPero C(2023)Integrating Gaze Tracking with Augmented Reality on Mobile Devices: A Framework for Enhanced User Interaction2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE58569.2023.10405713(670-675)Online publication date: 25-Oct-2023
https://doi.org/10.1109/MetroXRAINE58569.2023.10405713
Wu KXue Z(2023)Construction of Smart Glasses Assisted Road Sign Recognition System2023 IEEE International Conference on Electrical, Automation and Computer Engineering (ICEACE)10.1109/ICEACE60673.2023.10442840(1530-1535)Online publication date: 29-Dec-2023
https://doi.org/10.1109/ICEACE60673.2023.10442840
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents