Towards Remote Expert Supported Autonomous Assistant Robots in Shopping Environments
Pages 613 - 617
Abstract
Autonomous robots that assist customers during their shopping trips may become ubiquitous in the near future. However, these systems are limited in their ability to appropriately reply to all of a customer's requests. Therefore, a dedicated human expert has to remotely "take over" and resolve the customer's issue to warrant a satisfying experience. As a result, a Transfer of Control from a machine to a human takes place. This creates the problem that the expert needs to quickly review what has happened prior to the take-over to provide optimal assistance. To address this, we designed and implemented an interactive summary concept allowing experts to quickly filter and review the most relevant information to solve the given issue. Finally, we provide an example use case illustrating how a remote expert may solve a request using our system.
Supplemental Material
MP4 File
Supplemental video
- Download
- 15.74 MB
References
[1]
Aldebaran United Robotics Group. 2023. Pepper. https://www.softbankrobotics.com/emea/en/pepper
[2]
Mehdi Allahyari, Seyedamin Pouriyeh, Mehdi Assefi, Saeid Safaei, Elizabeth D. Trippe, Juan B. Gutierrez, and Krys Kochut. 2017. Text summarization techniques: a brief survey. arXiv preprint arXiv:1707.02268 (2017).
[3]
Francesca Bertacchini, Eleonora Bilotta, and Pietro Pantano. 2017. Shopping with a robotic companion. Computers in Human Behavior, Vol. 77 (Dec. 2017), 382--395. https://doi.org/10.1016/j.chb.2017.02.064
[4]
Santosh Kumar Bharti and Korra Sathya Babu. 2017. Automatic keyword extraction for text summarization: A survey. arXiv preprint arXiv:1704.03242 (2017).
[5]
Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023. Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712 (2023).
[6]
Yingfeng Chen, Feng Wu, Wei Shuai, and Xiaoping Chen. 2017. Robots serve humans in public places-KeJia robot as a shopping assistant. International Journal of Advanced Robotic Systems, Vol. 14, 3 (2017). https://doi.org/10.1177/1729881417703569
[7]
Nicola Doering, Sandra Poeschl, Horst-Michael Gross, Andreas Bley, Christian Martin, and Hans-Joachim Boehme. 2015. User-centered design and evaluation of a mobile shopping robot. International Journal of Social Robotics, Vol. 7, 2 (2015), 203--225. https://doi.org/10.1007/s12369-014-0257--8
[8]
Wafaa S. El-Kassas, Cherif R. Salama, Ahmed A. Rafea, and Hoda K. Mohamed. 2021. Automatic text summarization: A comprehensive survey. Expert Systems with Applications, Vol. 165 (2021), 113679. https://doi.org/10.1016/j.eswa.2020.113679
[9]
Django Software Foundation. 2023. Get started with Django. https://www.djangoproject.com
[10]
Dylan F. Glas, Satoru Satake, Florent Ferreri, Takayuki Kanda, Norihiro Hagita, and Hiroshi Ishiguro. 2012. The network robot system: enabling social human-robot interaction in public spaces. Journal of Human-Robot Interaction, Vol. 1, 2 (2012), 5--32. https://doi.org/10.5555/3109688.3109690
[11]
Google. 2021. AngularJS. https://angularjs.org
[12]
Horst-Michael Gross, Hans-Joachim Boehme, Christof Schroeter, Steffen Müller, Alexander König, Erik Einhorn, Christian Martin, Matthias Merten, and Andreas Bley. 2009. TOOMAS: interactive shopping guide robots in everyday use-final implementation and experiences from long-term field trials. In 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 2005--2012. https://doi.org/10.1109/IROS.2009.5354497
[13]
Horst-Michael Gross, Hans-Joachim Boehme, Christof Schröter, Steffen Müller, Alexander König, Christian Martin, Matthias Merten, and Andreas Bley. 2008. Shopbot: Progress in developing an interactive mobile shopping assistant for everyday use. In 2008 IEEE International Conference on Systems, Man and Cybernetics. IEEE, 3471--3478. https://doi.org/10.1109/ICSMC.2008.4811835
[14]
Vishal Gupta and Gurpreet Singh Lehal. 2010. A survey of text summarization extractive techniques. Journal of emerging technologies in web intelligence, Vol. 2, 3 (2010), 258--268. https://doi.org/10.4304/jetwi.2.3.258--268
[15]
International Federation of Robotics. 2023. Executive Summary World Robotics. https://ifr.org/free-downloads/
[16]
Yamato Iwamura, Masahiro Shiomi, Takayuki Kanda, Hiroshi Ishiguro, and Norihiro Hagita. 2011. Do elderly people prefer a conversational humanoid as a shopping assistant partner in supermarkets?. In Proceedings of the 6th International Conference on Human-Robot Interaction. IEEE, 449--456. https://doi.org/10.1145/1957656.1957816
[17]
Takayuki Kanda, Masahiro Shiomi, Zenta Miyashita, Hiroshi Ishiguro, and Norihiro Hagita. 2009. An affective guide robot in a shopping mall. In Proceedings of the 4th ACM/IEEE International conference on Human Robot Interaction. Assocation for Computing Machinery, 173--180. https://doi.org/10.1145/1514095.1514127
[18]
Takayuki Kanda, Masahiro Shiomi, Zenta Miyashita, Hiroshi Ishiguro, and Norihiro Hagita. 2010. A communication robot in a shopping mall. IEEE Transactions on Robotics, Vol. 26, 5 (2010), 897--913. https://doi.org/10.1109/TRO.2010.2062550
[19]
Frederik Kerber and Antonio Krüger. 2023. IRL Innovative Retail Laboratory. https://www.innovative-retail.de
[20]
Takahiro Matsumoto, Satoru Satake, Takayuki Kanda, Michita Imai, and Norihiro Hagita. 2012. Do you remember that shop? computational model of spatial memory for shopping companion robots. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction. IEEE, 447--454.
[21]
Ani Nenkova and Kathleen McKeown. 2012. A survey of text summarization techniques. In Mining text data. Springer, 43--76. https://doi.org/10.1007/978--1--4614--3223--4_3
[22]
Marketta Niemelä, Anne Arvola, and Iina Aaltonen. 2017a. Monitoring the acceptance of a social service robot in a shopping mall: first results. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-robot Interaction. Assocation for Computing Machinery, 225--226. https://doi.org/10.1145/3029798.3038333
[23]
Marketta Niemelä, Päivi Heikkilä, and Hanna Lammi. 2017b. A social service robot in a shopping mall: expectations of the management, retailers and consumers. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. Assocation for Computing Machinery, 227--228. https://doi.org/10.1145/3029798.3038301
[24]
Marketta Niemelä, Päivi Heikkilä, Hanna Lammi, and Virpi Oksman. 2017c. Shopping mall robots--opportunities and constraints from the retailer and manager perspective. In International Conference on Social Robotics. Springer, 485--494. https://doi.org/10.1007/978--3--319--70022--9_48
[25]
Marketta Niemelä, Päivi Heikkilä, Hanna Lammi, and Virpi Oksman. 2019. A social robot in a shopping mall: studies on acceptance and stakeholder expectations. In Social Robots: Technological, Societal and Ethical Aspects of Human-Robot Interaction. Springer, 119--144. https://doi.org/10.1007/978--3-030--17107-0_7
[26]
Alessandra Maria Sabelli and Takayuki Kanda. 2016. Robovie as a mascot: a qualitative study for long-term presence of robots in a shopping mall. International Journal of Social Robotics, Vol. 8, 2 (2016), 211--221. https://doi.org/10.1007/s12369-015-0332--9
[27]
Oguzhan Tas and Farzad Kiyani. 2007. A survey automatic text summarization. PressAcademia Procedia, Vol. 5, 1 (2007), 205--213. https://doi.org/10.17261/Pressacademia.2017.591
Index Terms
- Towards Remote Expert Supported Autonomous Assistant Robots in Shopping Environments
Recommendations
Design and Simulation of Autonomous Mobile Robots Obstacle Avoidance System
LNCS on Transactions on Edutainment XIII - Volume 10092Autonomous mobile robot is a completely unknown or partially unknown, of its complex environment, which requires the ability to avoid obstacles in order to move safely and avoid the collisions while navigating. To solve this problem, it opted to propose ...
Towards cooperation of heterogeneous, autonomous robots: A case study of humanoid and wheeled robots
In this paper a case study of the cooperation of a strongly heterogeneous autonomous robot team, composed of a highly articulated humanoid robot and a wheeled robot with largely complementing and some redundant abilities is presented. By combining ...
Remote shopping advice: enhancing in-store shopping with social technologies
CSCW '14: Proceedings of the 17th ACM conference on Computer supported cooperative work & social computingConsumers shopping in "brick-and-mortar" (non-virtual) stores often use their mobile phones to consult with others about potential purchases. Via a survey (n = 200), we detail current practices in seeking remote shopping advice. We then consider how ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
March 2024
1408 pages
ISBN:9798400703232
DOI:10.1145/3610978
- General Chairs:
- Dan Grollman,
- Elizabeth Broadbent,
- Program Chairs:
- Wendy Ju,
- Harold Soh,
- Tom Williams
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 March 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
- German Federal Ministry of Education and Research
Conference
HRI '24: ACM/IEEE International Conference on Human-Robot Interaction
March 11 - 15, 2024
CO, Boulder, USA
Acceptance Rates
Overall Acceptance Rate 268 of 1,124 submissions, 24%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 38Total Downloads
- Downloads (Last 12 months)38
- Downloads (Last 6 weeks)2
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in