research-article

Pick from here!: an interactive mobile cart using in-situ projection for order picking

Authors:

Alireza Sahami Shirazi,

Albrecht SchmidtAuthors Info & Claims

UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Pages 601 - 609

https://doi.org/10.1145/2750858.2804268

Published: 07 September 2015 Publication History

Abstract

Order Picking is not only one of the most important but also most mentally demanding and error-prone tasks in the industry. Both stationary and wearable systems have been introduced to facilitate this task. Existing stationary systems are not scalable because of the high cost and wearable systems have issues being accepted by the workers. In this paper, we introduce a mobile camera-projector cart called OrderPickAR, which combines the benefits of both stationary and mobile systems to support order picking through Augmented Reality. Our system dynamically projects in-situ picking information into the storage system and automatically detects when a picking task is done. In a lab study, we compare our system to existing approaches, i.e, Pick-by-Paper, Pick-by-Voice, and Pick-by-Vision. The results show that using the proposed system, order picking is almost twice as fast as other approaches, the error rate is decreased up to 9 times, and mental demands are reduced up to 50%.

Supplementary Material

MP4 File (p601-funk.mp4)

Download
12.71 MB

References

[1]

Bannat, A., Gast, J., Rigoll, G., and Wallhoff, F. Event analysis and interpretation of human activity for augmented reality-based assistant systems. In Intelligent Computer Communication and Processing, 2008. ICCP 2008. 4th International Conference on, IEEE (2008), 1--8.

[2]

Baudisch, P., and Rosenholtz, R. Halo: a technique for visualizing off-screen objects. In Proceedings of the SIGCHI conference on Human factors in computing systems, ACM (2003), 481--488.

Digital Library

[3]

Beardsley, P., Van Baar, J., Raskar, R., and Forlines, C. Interaction using a handheld projector. Computer Graphics and Applications 25, 1 (2005), 39--43.

Digital Library

[4]

Biocca, F., Tang, A., Owen, C., and Xiao, F. Attention funnel: omnidirectional 3d cursor for mobile augmented reality platforms. In Proceedings of the SIGCHI conference on Human Factors in computing systems, ACM (2006), 1115--1122.

Digital Library

[5]

Butz, A., Schneider, M., and Spassova, M. Searchlight--a lightweight search function for pervasive environments. In Pervasive Computing. Springer, 2004, 351--356.

[6]

Crasto, D., Kale, A., and Jaynes, C. The smart bookshelf: A study of camera projector scene augmentation of an everyday environment. In Application of Computer Vision, 2005. WACV/MOTIONS'05 Volume 1. Seventh IEEE Workshops on, vol. 1, IEEE (2005), 218--225.

Digital Library

[7]

De Koster, R., Le-Duc, T., and Roodbergen, K. J. Design and control of warehouse order picking: A literature review. European Journal of Operational Research 182, 2 (2007), 481--501.

[8]

Eisenstein, D. D. Analysis and optimal design of discrete order picking technologies along a line. Naval Research Logistics (NRL) 55, 4 (2008), 350--362.

[9]

Funk, M., Baechler, A., Baechler, L., Korn, O., Krieger, C., Heidenreich, T., and Schmidt, A. Comparing projected in-situ feedback at the manual assembly workplace with impaired workers. In Proceedings of the 8th International Conference on PErvasive Technologies Related to Assistive Environments, ACM (2015).

Digital Library

[10]

Guo, A., Raghu, S., Xie, X., Ismail, S., Luo, X., Simoneau, J., Gilliland, S., Baumann, H., Southern, C., and Starner, T. A comparison of order picking assisted by head-up display (hud), cart-mounted display (cmd), light, and paper pick list. In Proceedings of the 2014 ACM International Symposium on Wearable Computers, ACM (2014), 71--78.

Digital Library

[11]

Hardy, J., and Alexander, J. Toolkit support for interactive projected displays. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia, ACM (2012), 42.

Digital Library

[12]

Harrison, C., Benko, H., and Wilson, A. D. Omnitouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology, ACM (2011), 441--450.

Digital Library

[13]

Hart, S. G., and Staveland, L. E. Development of nasa-tlx (task load index): Results of empirical and theoretical research. Advances in psychology 52 (1988), 139--183.

[14]

Hua, H., and Gao, C. Design of a bright polarized head-mounted projection display. Applied optics 46, 14 (2007), 2600--2610.

[15]

Kim, J., and Jun, H. Vision-based location positioning using augmented reality for indoor navigation. Consumer Electronics, IEEE Transactions on 54, 3 (2008), 954--962.

Digital Library

[16]

Kirsh, D. The intelligent use of space. Artificial intelligence 73, 1 (1995), 31--68.

Digital Library

[17]

Li, X., Chen, I. Y.-H., Thomas, S., and MacDonald, B. A. Using kinect for monitoring warehouse order picking operations. In Proceedings of Australasian Conference on Robotics and Automation (2012), 15.

[18]

Linder, N., and Maes, P. Luminar: portable robotic augmented reality interface design and prototype. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology, ACM (2010), 395--396.

Digital Library

[19]

Löchtefeld, M., Gehring, S., Schöning, J., and Krüger, A. Shelftorchlight: Augmenting a shelf using a camera projector unit. In Adjunct Proceedings of the Eighth International Conference on Pervasive Computing, Citeseer (2010), 1--4.

[20]

Pinhanez, C. The everywhere displays projector: A device to create ubiquitous graphical interfaces. In Ubicomp 2001: Ubiquitous Computing, Springer (2001), 315--331.

Digital Library

[21]

Raskar, R., Van Baar, J., Beardsley, P., Willwacher, T., Rao, S., and Forlines, C. ilamps: geometrically aware and self-configuring projectors. In ACM SIGGRAPH 2006 Courses, ACM (2006), 7.

Digital Library

[22]

Reif, R., Günthner, W. A., Schwerdtfeger, B., and Klinker, G. Pick-by-vision comes on age: evaluation of an augmented reality supported picking system in a real storage environment. In Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, ACM (2009), 23--31.

Digital Library

[23]

Rukzio, E., Holleis, P., and Gellersen, H. Personal projectors for pervasive computing. IEEE Pervasive Computing 11, 2 (2012), 30--37.

Digital Library

[24]

Schwerdtfeger, B., Pustka, D., Hofhauser, A., and Klinker, G. Using laser projectors for augmented reality. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology, ACM (2008), 134--137.

Digital Library

[25]

Schwerdtfeger, B., Reif, R., Gunthner, W. A., Klinker, G., Hamacher, D., Schega, L., Bockelmann, I., Doil, F., and Tumler, J. Pick-by-vision: A first stress test. In Mixed and Augmented Reality, 2009. ISMAR 2009. 8th IEEE International Symposium on, IEEE (2009), 115--124.

Digital Library

[26]

Weaver, K. A., Baumann, H., Starner, T., Iben, H., and Lawo, M. An empirical task analysis of warehouse order picking using head-mounted displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2010), 1695--1704.

Digital Library

[27]

Willis, K. D., Poupyrev, I., Hudson, S. E., and Mahler, M. Sidebyside: ad-hoc multi-user interaction with handheld projectors. In Proceedings of the 24th annual ACM symposium on User interface software and technology, ACM (2011), 431--440.

Digital Library

[28]

Wilson, A. D. Using a depth camera as a touch sensor. In ACM international conference on interactive tabletops and surfaces, ACM (2010), 69--72.

Digital Library

[29]

Winkler, C., Seifert, J., Dobbelstein, D., and Rukzio, E. Pervasive information through constant personal projection: the ambient mobile pervasive display (amp-d). In Proceedings of the 32nd annual ACM conference on Human factors in computing systems, ACM (2014), 4117--4126.

Digital Library

Cited By

Łopuszyński MJanusz KKarwat D(2025)Comparative Study of Selected Order-Picking Methods: Efficiency, Ergonomics, and Adaptation Rate of New EmployeesSensors10.3390/s2503092325:3(923)Online publication date: 3-Feb-2025
https://doi.org/10.3390/s25030923
Lystbæk MPfeuffer KLanglotz TGrønbæk JGellersen H(2024)Spatial Gaze Markers: Supporting Effective Task Switching in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642811(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642811
Graf FBazlen FDegel SLindermayr J(2024)Intelligent Pointer Unit to Speed Up the Shelf Replenishment Process in Retail StoresDynamics in Logistics10.1007/978-3-031-56826-8_35(452-463)Online publication date: 3-Apr-2024
https://doi.org/10.1007/978-3-031-56826-8_35
Show More Cited By

Index Terms

Pick from here!: an interactive mobile cart using in-situ projection for order picking
1. Human-centered computing

Recommendations

Comparing order picking assisted by head-up display versus pick-by-light with explicit pick confirmation
ISWC '15: Proceedings of the 2015 ACM International Symposium on Wearable Computers

Manual order picking is an important part of distribution. Many techniques have been proposed to improve pick efficiency and accuracy. Previous studies compared pick-by-HUD (Head-Up Display) with pick-by-light but without the explicit pick confirmation ...
Mobile In-Situ Pick-by-Vision: Order Picking Support using a Projector Helmet
PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Order picking is one of the most complex and error-prone tasks that can be found in the industry. To support the workers, many order picking instruction systems have been proposed. A large number of systems focus on equipping the user with head-mounted ...
A study of storage assignment problem for an order picking line in a pick-and-pass warehousing system

Order picking is one of the most crucial factors for efficient warehouse management. Most of previous research in order picking in a warehouse considered only the picker-to-part or part-to-picker system; however, the pick-and-pass system plays an ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 2015

1302 pages

ISBN:9781450335744

DOI:10.1145/2750858

General Chairs:
Kenji Mase
Nagoya University, JP
,
Marc Langheinrich
Università della Svizzera italiana (USI), CH
,
Daniel Gatica-Perez
IDIAP-EPFL, CH
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Tanzeem Choudhury
Cornell University
,
Koji Yatani
Univerisity of Tokyo, JP

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Yahoo! Japan: Yahoo! Japan
SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
FX Palo Alto Laboratory, Inc.: FX Palo Alto Laboratory, Inc.
Google Inc.
ACM: Association for Computing Machinery
Rakuten Institute of Technology: Rakuten Institute of Technology
Microsoft: Microsoft
Bell Labs: Bell Laboratories
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
KDDI
Panasonic: Panasonic Corporation
NTT DoCoMo
Telefónica: Telefónica
ISTC-PC: Intel Science and Technology Center for Pervasive Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Bundesministerium fur Wirtschaft und Energie

Conference

UbiComp '15

Sponsor:

Yahoo! Japan
SIGMOBILE
FX Palo Alto Laboratory, Inc.
ACM
Rakuten Institute of Technology
Microsoft
Bell Labs
SIGCHI
Panasonic
Telefónica
ISTC-PC

UbiComp '15: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 7 - 11, 2015

Osaka, Japan

Acceptance Rates

UbiComp '15 Paper Acceptance Rate 101 of 394 submissions, 26%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
826
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Łopuszyński MJanusz KKarwat D(2025)Comparative Study of Selected Order-Picking Methods: Efficiency, Ergonomics, and Adaptation Rate of New EmployeesSensors10.3390/s2503092325:3(923)Online publication date: 3-Feb-2025
https://doi.org/10.3390/s25030923
Lystbæk MPfeuffer KLanglotz TGrønbæk JGellersen H(2024)Spatial Gaze Markers: Supporting Effective Task Switching in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642811(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642811
Graf FBazlen FDegel SLindermayr J(2024)Intelligent Pointer Unit to Speed Up the Shelf Replenishment Process in Retail StoresDynamics in Logistics10.1007/978-3-031-56826-8_35(452-463)Online publication date: 3-Apr-2024
https://doi.org/10.1007/978-3-031-56826-8_35
Chondromatidis NGialos AZeimpekis V(2022)Investigating the Performance of the Order-Picking Process by Using Smart Glasses: A Laboratory Experimental ApproachLogistics10.3390/logistics60400846:4(84)Online publication date: 8-Dec-2022
https://doi.org/10.3390/logistics6040084
DÜNDAR AÖLGER A(2022)MANUEL SİPARİŞ TOPLAMA OPERASYONLARINDA HATA TESPİT UYGULAMASI: AĞIRLIK KONTROL NOKTASIGaziantep University Journal of Social Sciences10.21547/jss.93460621:2(751-767)Online publication date: 30-Apr-2022
https://doi.org/10.21547/jss.934606
Rasmussen T(2022)authAR - Automatic Authoring of Picking and Layout Optimization InstructionsProceedings of the 34th Australian Conference on Human-Computer Interaction10.1145/3572921.3572949(199-205)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3572921.3572949
Jumahat SSidhu MShah S(2022)Pick-by-vision of Augmented Reality in Warehouse Picking Process Optimization – A Review2022 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET)10.1109/IICAIET55139.2022.9936785(1-6)Online publication date: 13-Sep-2022
https://doi.org/10.1109/IICAIET55139.2022.9936785
De Lombaert TBraekers KDe Koster RRamaekers K(2022)In pursuit of humanised order picking planning: methodological review, literature classification and input from practiceInternational Journal of Production Research10.1080/00207543.2022.207943761:10(3300-3330)Online publication date: 1-Jun-2022
https://doi.org/10.1080/00207543.2022.2079437
Zhang JWang SHe WLi JCao ZWei B(2022)Projected augmented reality assembly assistance system supporting multi-modal interactionThe International Journal of Advanced Manufacturing Technology10.1007/s00170-022-10113-6123:3-4(1353-1367)Online publication date: 3-Oct-2022
https://doi.org/10.1007/s00170-022-10113-6
Mohammed Musthafa Sheriff IJohn Aravindhar D(2022)NLP-Oriented Voice-Based Order Picking System in a Warehouse Management: A Systematic ReviewSmart Data Intelligence10.1007/978-981-19-3311-0_16(185-198)Online publication date: 18-Aug-2022
https://doi.org/10.1007/978-981-19-3311-0_16
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten