Body Gesture Recognition to Control a Social Mobile Robot
Pages 456 - 460
Abstract
In this work, we propose a gesture-based language to allow humans to interact with robots using their body in a natural way. We have created a new gesture detection model using neural networks and a new dataset of humans making a collection of body gestures to train this architecture. Furthermore, we compare body gesture communication with other communication channels to demonstrate the importance of adding this knowledge to robots. The presented approach is validated in diverse simulations and real-life experiments with non-trained volunteers. This attains promising results and establishes that it is a valuable framework for social robotic applications, such as human robot collaboration or human-robot interaction.
Supplementary Material
LBR presentation video
- Download
- 16.78 MB
References
[1]
Samer Alashhab, Antonio-Javier Gallego, and Miguel Ángel Lozano. 2019. Hand Gesture Detection with Convolutional Neural Networks. In Distributed Computing and Artificial Intelligence, 15th International Conference, Fernando De La Prieta, Sigeru Omatu, and Antonio Fernández-Caballero (Eds.). Springer International Publishing, Cham, 45--52.
[2]
Michael Argyle. 1972. Non-verbal communication in human social interaction. (1972).
[3]
Jen-Yen Chang, Antonio Tejero-de-Pablos, and Tatsuya Harada. 2019. Improved Optical Flow for Gesture-based Human-robot Interaction. CoRR abs/1905.08685 (2019). arXiv:1905.08685 http://arxiv.org/abs/1905.08685
[4]
Amanda Cardoso Duarte, Samuel Albanie, Xavier Giró-i-Nieto, and Gül Varol. 2022. Sign Language Video Retrieval with Free-Form Textual Queries. CoRR abs/2201.02495 (2022). arXiv:2201.02495 https://arxiv.org/abs/2201.02495
[5]
Robert A Hinde and Robert Aubrey Hinde. 1972. Non-verbal communication. Cambridge University Press.
[6]
Rachel Kirby. 2010. Social robot navigation. Carnegie Mellon University.
[7]
Jun Kwan, Chinkye Tan, and Akansel Cosgun. 2020. Gesture Recognition for Initiating Human-to-Robot Handovers. arXiv:2007.09945 [cs.CV]
[8]
Javier Laplaza, Nicolás Rodríguez, J. E. Domínguez-Vidal, Fernando Herrero, Sergi Hernández, Alejandro López, Alberto Sanfeliu, and Anaís Garrell. 2022. IVO Robot: A New Social Robot for Human-Robot Collaboration. In Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction (Sapporo, Hokkaido, Japan) (HRI '22). IEEE Press, 860--864.
[9]
Camillo Lugaresi, Jiuqiang Tang, Hadon Nash, Chris McClanahan, Esha Uboweja, Michael Hays, Fan Zhang, Chuo-Ling Chang, Ming Yong, Juhyun Lee, Wan-Teh Chang, Wei Hua, Manfred Georg, and Matthias Grundmann. 2019. MediaPipe: A Framework for Building Perception Pipelines.
[10]
Sepehr MohaimenianPour and Richard Vaughan. 2018. Hands and Faces, Fast: Mono-Camera User Detection Robust Enough to Directly Control a UAV in Flight. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 5224--5231. https://doi.org/10.1109/IROS.2018.8593709
[11]
Fatemeh Noroozi, Ciprian Adrian Corneanu, Dorota Kamińska, Tomasz Sapiński, Sergio Escalera, and Gholamreza Anbarjafari. 2021. Survey on Emotional Body Gesture Recognition. IEEE Transactions on Affective Computing 12, 2 (2021), 505--523. https://doi.org/10.1109/TAFFC.2018.2874986
[12]
Tim O'Sullivan, John Hartley, Danny Saunders, Martin Montgomery, and John Fiske. 1994. Key concepts in communication and cultural studies. Routledge.
[13]
Jagdish Lal Raheja, Mona Chandra, and Ankit Chaudhary. 2018. 3D gesture based real-time object selection and recognition. Pattern Recognition Letters 115 (2018), 14--19. https://doi.org/10.1016/j.patrec.2017.09.034 Multimodal Fusion for Pattern Recognition.
[14]
Ely Repiso, Anaís Garrell, and Alberto Sanfeliu. 2018. Robot approaching and engaging people in a human-robot companion framework. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 8200--8205.
[15]
Jia Chuan A. Tan, Wesley P. Chan, Nicole L. Robinson, Elizabeth A. Croft, and Dana Kulic. 2021. A Proposed Set of Communicative Gestures for Human Robot Interaction and an RGB Image-based Gesture Recognizer Implemented in ROS. CoRR abs/2109.09908 (2021). arXiv:2109.09908 https://arxiv.org/abs/2109.09908
[16]
Nurettin Çağrı Kılıboz and Uğur Güdükbay. 2015. A hand gesture recognition technique for human-computer interaction. Journal of Visual Communication and Image Representation 28 (2015), 97--104. https://doi.org/10.1016/j.jvcir.2015.01.015
Index Terms
- Body Gesture Recognition to Control a Social Mobile Robot
Recommendations
Human-Robot Interaction Using Pointing Gestures
ISCSIC '18: Proceedings of the 2nd International Symposium on Computer Science and Intelligent ControlOur research presented in this paper focuses on HRI (Human-Robot Interaction) via pointing gestures. We've designed a method where human operator points to a specific location and subsequently a mobile robot drives to the designated location. A depth ...
A Gesture Based Interface for Human-Robot Interaction
Service robotics is currently a highly active research area in robotics, with enormous societal potential. Since service robots directly interact with people, finding “natural” and easy-to-use user interfaces is of fundamental importance. While past ...
Neural network and fuzzy logic techniques based collision avoidance for a mobile robot
This paper is concerned with a mobile robot reactive navigation in an unknown cluttered environment based on neural network and fuzzy logic. Reactive navigation is a mapping between sensory data and commands without planning. This article's task is to ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
March 2023
612 pages
ISBN:9781450399708
DOI:10.1145/3568294
- General Chairs:
- Ginevra Castellano,
- Laurel Riek,
- Program Chairs:
- Maya Cakmak,
- Iolanda Leite
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 March 2023
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
Conference
HRI '23: ACM/IEEE International Conference on Human-Robot Interaction
March 13 - 16, 2023
Stockholm, Sweden
Acceptance Rates
Overall Acceptance Rate 268 of 1,124 submissions, 24%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 107Total Downloads
- Downloads (Last 12 months)56
- Downloads (Last 6 weeks)3
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in