Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3597512.3597520acmotherconferencesArticle/Chapter ViewAbstractPublication PagestasConference Proceedingsconference-collections
extended-abstract

Digital twins for human-assistive robot teams in ambient assisted living

Published: 11 July 2023 Publication History

Abstract

Digital twins are virtual replicas of physical systems that simulate real-world scenarios to optimize system performance, reduce physical losses, and ensure user safety. Although digital twins have been widely adopted in industrial settings, there is a lack of research on digital twins in everyday life scenarios. This report presents research aimed at developing a human-assistive robot interaction digital twin system. Our objective is to construct and utilize human biomechanical models of people using assistive devices and apply machine learning for recognition of impaired mobility, simulating edge scenarios to ensure the safety of human-assistive robot interaction prior to actual deployment. This research contributes to the advancement of digital twin technology to enhance the safety of assistive robots in the real-world.

References

[1]
Giulio Paolo Agnusdei, Valerio Elia, and Maria Grazia Gnoni. 2021. Is digital twin technology supporting safety management? A bibliometric and systematic review. Applied Sciences 11, 6 (2021), 2767.
[2]
Alireza Asvadi, Andrei Mitriakov, Christophe Lohr, and Panagiotis Papadakis. 2022. Digital Twin Driven Smart Home: A Feasibility Study. In International Conference on Smart Homes and Health Telematics. Springer, Cham, 18–29.
[3]
Lucia Cascone, Michele Nappi, Fabio Narducci, and Ignazio Passero. 2021. DTPAAL: Digital twinning pepper and ambient assisted living. IEEE Transactions on Industrial Informatics 18, 2 (2021), 1397–1404.
[4]
Georgia Chalvatzaki, Petros Koutras, Jack Hadfield, Xanthi S Papageorgiou, Costas S Tzafestas, and Petros Maragos. 2019. LSTM-based network for human gait stability prediction in an intelligent robotic rollator. In 2019 international conference on robotics and automation (ICRA). IEEE, 4225–4232.
[5]
Yuqing Chen and Yang Xue. 2015. A deep learning approach to human activity recognition based on single accelerometer. In 2015 IEEE international conference on systems, man, and cybernetics. IEEE, 1488–1492.
[6]
Scott L Delp, Frank C Anderson, Allison S Arnold, Peter Loan, Ayman Habib, Chand T John, Eran Guendelman, and Darryl G Thelen. 2007. OpenSim: open-source software to create and analyze dynamic simulations of movement. IEEE transactions on biomedical engineering 54, 11 (2007), 1940–1950.
[7]
Scott L Delp, Frank C Anderson, Allison S Arnold, Peter Loan, Ayman Habib, Chand T John, Eran Guendelman, and Darryl G Thelen. 2007. OpenSim: open-source software to create and analyze dynamic simulations of movement. IEEE transactions on biomedical engineering 54, 11 (2007), 1940–1950.
[8]
Klaus Dröder, Paul Bobka, Tomas Germann, Felix Gabriel, and Franz Dietrich. 2018. A machine learning-enhanced digital twin approach for human-robot-collaboration. Procedia Cirp 76 (2018), 187–192.
[9]
Zackory Erickson, Vamsee Gangaram, Ariel Kapusta, C Karen Liu, and Charles C Kemp. 2020. Assistive gym: A physics simulation framework for assistive robotics. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 10169–10176.
[10]
Luca Fortini, Mattia Leonori, Juan M Gandarias, Elena De Momi, and Arash Ajoudani. 2022. Open-VICO: An Open-Source Gazebo Toolkit for Vision-based Skeleton Tracking in Human-Robot Collaboration. In 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE, 511–517.
[11]
Ralph Gross and Jianbo Shi. 2001. The CMU Motion of Body (MoBo) Database. Technical Report CMU-RI-TR-01-18. Carnegie Mellon University, Pittsburgh, PA.
[12]
Martin Hofmann, Jürgen Geiger, Sebastian Bachmann, Björn Schuller, and Gerhard Rigoll. 2014. The TUM Gait from Audio, Image and Depth (GAID) database: Multimodal recognition of subjects and traits. Journal of Visual Communication and Image Representation 25, 1 (2014), 195–206.
[13]
Brian Horsak, Djordje Slijepcevic, Anna-Maria Raberger, Caterine Schwab, Marianne Worisch, and Matthias Zeppelzauer. 2020. GaitRec, a large-scale ground reaction force dataset of healthy and impaired gait. Scientific data 7, 1 (2020), 143.
[14]
Yuchen Jiang, Shen Yin, Kuan Li, Hao Luo, and Okyay Kaynak. 2021. Industrial applications of digital twins. Philosophical Transactions of the Royal Society A 379, 2207 (2021), 20200360.
[15]
Jaime Ibarra Jimenez, Hamid Jahankhani, and Stefan Kendzierskyj. 2020. Health care in the cyberspace: Medical cyber-physical system and digital twin challenges. In Digital twin technologies and smart cities. Springer, 79–92.
[16]
Preeti Khera and Neelesh Kumar. 2020. Role of machine learning in gait analysis: a review. Journal of Medical Engineering & Technology 44, 8 (2020), 441–467.
[17]
Nathan Koenig and Andrew Howard. 2004. Design and use paradigms for gazebo, an open-source multi-robot simulator. In 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566), Vol. 3. IEEE, 2149–2154.
[18]
Niki Kousi, Christos Gkournelos, Sotiris Aivaliotis, Konstantinos Lotsaris, Angelos Christos Bavelos, Panagiotis Baris, George Michalos, and Sotiris Makris. 2021. Digital twin for designing and reconfiguring human–robot collaborative assembly lines. Applied Sciences 11, 10 (2021), 4620.
[19]
Allison Langer, Ronit Feingold-Polak, Oliver Mueller, Philipp Kellmeyer, and Shelly Levy-Tzedek. 2019. Trust in socially assistive robots: Considerations for use in rehabilitation. Neuroscience & Biobehavioral Reviews 104 (2019), 231–239.
[20]
Mengnan Liu, Shuiliang Fang, Huiyue Dong, and Cunzhi Xu. 2021. Review of digital twin about concepts, technologies, and industrial applications. Journal of Manufacturing Systems 58 (2021), 346–361.
[21]
Uriel Martinez-Hernandez, Benjamin Metcalfe, Tareq Assaf, Leen Jabban, James Male, and Dingguo Zhang. 2021. Wearable assistive robotics: A perspective on current challenges and future trends. Sensors 21, 20 (2021), 6751.
[22]
Marion Mundt, Joao Pedro Batista, Bernd Markert, Cornelius Bollheimer, and Thea Laurentius. 2019. Walking with rollator: a systematic review of gait parameters in older persons. European review of aging and physical activity 16, 1 (2019), 1–9.
[23]
Luisa Ruiz-Ruiz, Antonio R Jimenez, Guillermo Garcia-Villamil, and Fernando Seco. 2021. Detecting fall risk and frailty in elders with inertial motion sensors: A survey of significant gait parameters. Sensors 21, 20 (2021), 6918.
[24]
Abhimanyu Sharotry, Jesus A Jimenez, David Wierschem, Francis A Mendez Mediavilla, Rachel M Koldenhoven, Damian Valles, George Koutitas, and Semih Aslan. 2020. A digital twin framework for real-time analysis and feedback of repetitive work in the manual material handling industry. In 2020 Winter Simulation Conference (WSC). IEEE, 2637–2648.
[25]
Abhimanyu Sharotry, Jesus A. Jimenez, David Wierschem, Francis A. Mendez Mediavilla, Rachel M. Koldenhoven, Damian Valles, George Koutitas, and Semih Aslan. 2020. A Digital Twin Framework for Real-Time Analysis and Feedback of Repetitive Work in the Manual Material Handling Industry. In 2020 Winter Simulation Conference (WSC). 2637–2648. https://doi.org/10.1109/WSC48552.2020.9384043
[26]
Ronnie Smith. 2020. Adaptivity as a Service (AaaS): Personalised Assistive Robotics for Ambient Assisted Living. In International Symposium on Ambient Intelligence. Springer, 239–242.
[27]
Olga Theou, Mario Ulises Pérez-Zepeda, Alexandra M van der Valk, Samuel D Searle, Susan E Howlett, and Kenneth Rockwood. 2021. A classification tree to assist with routine scoring of the Clinical Frailty Scale. Age and Ageing 50, 4 (02 2021), 1406–1411. https://doi.org/10.1093/ageing/afab006 arXiv:https://academic.oup.com/ageing/article-pdf/50/4/1406/38839526/afab006.pdf
[28]
Qiyue Wang, Wenhua Jiao, Peng Wang, and YuMing Zhang. 2020. Digital twin for human-robot interactive welding and welder behavior analysis. IEEE/CAA Journal of Automatica Sinica 8, 2 (2020), 334–343.

Cited By

View all
  • (2024)ETHICA: Designing Human Digital Twins—A Systematic Review and Proposed MethodologyIEEE Access10.1109/ACCESS.2024.341651712(86947-86973)Online publication date: 2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
TAS '23: Proceedings of the First International Symposium on Trustworthy Autonomous Systems
July 2023
426 pages
ISBN:9798400707346
DOI:10.1145/3597512
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2023

Check for updates

Author Tags

  1. Digital Twins
  2. Human Models
  3. Interaction
  4. Rollator

Qualifiers

  • Extended-abstract
  • Research
  • Refereed limited

Conference

TAS '23

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)129
  • Downloads (Last 6 weeks)12
Reflects downloads up to 24 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)ETHICA: Designing Human Digital Twins—A Systematic Review and Proposed MethodologyIEEE Access10.1109/ACCESS.2024.341651712(86947-86973)Online publication date: 2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media