research-article

Epidermal Robots: Wearable Sensors That Climb on the Skin

Authors:

Artem Dementyev,

Javier Hernandez,

Joseph ParadisoAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 2, Issue 3

Article No.: 102, Pages 1 - 22

https://doi.org/10.1145/3264912

Published: 18 September 2018 Publication History

Abstract

Epidermal sensing has enabled significant advancements towards the measurement and understanding of health. Most of the existing medical instruments require direct expert manipulation of a doctor, measure a single parameter, and/or have limited sensing coverage. In contrast, this work demonstrates the first epidermal robot with the ability to move over the surface of the skin and capture a large range of body parameters. In particular, we developed SkinBot, a 2x4x2 centimeter-size robot that moves over the skin surface with a two-legged suction-based locomotion. We demonstrate three of the potential medical sensing applications which include the measurement of body biopotentials (e.g., electrodermal activity, electrocardiography) through modified suction cups that serve as electrodes, skin imaging through a skin-facing camera that can capture skin anomalies, and inertial body motions through a 6-axis accelerometer and gyroscope that can capture changes of body posture and subtle cardiorespiratory vibrations.

Supplementary Material

dementyev (dementyev.zip)

Supplemental movie, appendix, image and software files for, Epidermal Robots: Wearable Sensors That Climb on the Skin

Download
24.19 MB

References

[1]

Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 837--846.

Digital Library

[2]

PG Agache, C Monneur, JL Leveque, and J De Rigal. 1980. Mechanical properties and Young's modulus of human skin in vivo. Archives of dermatological research 269, 3 (1980), 221--232.

[3]

Hu Bing-Shan, Wang Li-Wen, Fu Zhuang, and Zhao Yan-zheng. 2009. Bio-inspired miniature suction cups actuated by shape memory alloy. International Journal of Advanced Robotic Systems 6, 3 (2009), 29.

[4]

Johann Borenstein, HR Everett, and Liqiang Feng. 1996. Navigating mobile robots: Systems and techniques. AK Peters, Ltd.

Digital Library

[5]

W. Boucsein. 2012. Electrodermal Activity. Springer US. https://books.google.com/books?id=6N6rnOEZEEoC

[6]

Leoncio Briones, Paul Bustamante, and Miguel A Serna. 1994. Wall-climbing robot for inspection in nuclear power plants. In Robotics and Automation, 1994. Proceedings., 1994 IEEE International Conference on. IEEE, 1409--1414.

[7]

Charles E Clauser, John T McConville, and John W Young. 1969. Weight, volume, and center of mass of segments of the human body. Technical Report. ANTIOCH COLL YELLOW SPRINGS OH.

[8]

Kathryn A Daltorio, Andrew D Horchler, Stanislav Gorb, Roy E Ritzmann, and Roger D Quinn. 2005. A small wall-walking robot with compliant, adhesive feet. In Intelligent Robots and Systems, 2005.(IROS 2005). 2005 IEEE/RSJ International Conference on. IEEE, 3648--3653.

[9]

Artem Dementyev, Hsin-Liu Cindy Kao, Inrak Choi, Deborah Ajilo, Maggie Xu, Joseph A Paradiso, Chris Schmandt, and Sean Follmer. 2016. Rovables: Miniature on-body robots as mobile wearables. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 111--120.

Digital Library

[10]

S Diridollou, F Patat, F Gens, L Vaillant, D Black, JM Lagarde, Y Gall, and M Berson. 2000. In vivo model of the mechanical properties of the human skin under suction. Skin Research and technology 6, 4 (2000), 214--221.

[11]

Markus Eich and Thomas Vögele. 2011. Design and control of a lightweight magnetic climbing robot for vessel inspection. In Control 8 Automation (MED), 2011 19th Mediterranean Conference on. IEEE, 1200--1205.

[12]

Kevin Fok, Nathan A Wood, and Cameron N Riviere. 2012. Improved locomotion for the HeartLander robot for injection of an anti-remodeling hydrogel. In Bioengineering Conference (NEBEC), 2012 38th Annual Northeast. IEEE, 207--208.

[13]

Yasutaka Fuke and Eric Krotkov. 1996. Dead reckoning for a lunar rover on uneven terrain. In Robotics and Automation, 1996. Proceedings., 1996 IEEE International Conference on, Vol. 1. IEEE, 411--416.

[14]

Javier Hernandez, Daniel J McDuff, and Rosalind W Picard. 2015. Biophone: Physiology monitoring from peripheral smartphone motions. In Engineering in Medicine and Biology Society (EMBC), 2015 37th Annual International Conference of the IEEE. IEEE, 7180--7183.

[15]

Alexandra Ion, Edward Jay Wang, and Patrick Baudisch. 2015. Skin drag displays: Dragging a physical tactor across the user's skin produces a stronger tactile stimulus than vibrotactile. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2501--2504.

Digital Library

[16]

Hsin-Liu Cindy Kao, Deborah Ajilo, Oksana Anilionyte, Artem Dementyev, Inrak Choi, Sean Follmer, and Chris Schmandt. 2017. Exploring interactions and perceptions of kinetic wearables. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 391--396.

Digital Library

[17]

Arvid Kappas, Dennis Küster, Christina Basedow, and Pasquale Dente. 2013. A validation study of the Affectiva Q-Sensor in different social laboratory situations. In 53rd Annual Meeting of the Society for Psychophysiological Research, Florence, Italy.

[18]

Dae-Hyeong Kim, Nanshu Lu, Rui Ma, Yun-Soung Kim, Rak-Hwan Kim, Shuodao Wang, Jian Wu, Sang Min Won, Hu Tao, Ahmad Islam, et al. 2011. Epidermal electronics. science 333, 6044 (2011), 838--843.

[19]

Sangbae Kim, Matthew Spenko, Salomon Trujillo, Barrett Heyneman, Daniel Santos, and Mark R Cutkosky. 2008. Smooth vertical surface climbing with directional adhesion. IEEE Transactions on robotics 24, 1 (2008), 65--74.

Digital Library

[20]

Mathew Laibowitz and Joseph A Paradiso. 2005. Parasitic mobility for pervasive sensor networks. In Pervasive Computing. Springer, 255--278.

Digital Library

[21]

Y Lanir, S Dikstein, A Hartzshtark, and V Manny. 1990. In-vivo indentation of human skin. Journal of biomechanical engineering 112, 1 (1990), 63--69.

[22]

Yuanyuan Liu, Xinyu Wu, Huihuan Qian, Duan Zheng, Jianquan Sun, and Yangsheng Xu. 2012. System and design of clothbot: A robot for flexible clothes climbing. In Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 1200--1205.

[23]

Henrik Lorentzen, Kaare Weismann, Carsten Sand Petersen, Frederik Grønhøj Larsen, Lena Secher, and Vera Skødt. 1999. Clinical and dermatoscopic diagnosis of malignant melanoma: assessed by expert and non-expert groups. Acta dermato-venereologica 79, 4 (1999).

[24]

Ken Nakagaki, Artem Dementyev, Sean Follmer, Joseph A Paradiso, and Hiroshi Ishii. 2016. ChainFORM: A Linear Integrated Modular Hardware System for Shape Changing Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 87--96.

Digital Library

[25]

NA Patronik, MA Zenati, and CN Riviere. 2005. Preliminary evaluation of a mobile robotic device for navigation and intervention on the beating heart. Computer Aided Surgery 10, 4 (2005), 225--232.

[26]

Ming-Zher Poh, Daniel J McDuff, and Rosalind W Picard. 2010. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Optics express 18, 10 (2010), 10762--10774.

[27]

Panagiotis Polygerinos, Zheng Wang, Kevin C Galloway, Robert J Wood, and Conor J Walsh. 2015. Soft robotic glove for combined assistance and at-home rehabilitation. Robotics and Autonomous Systems 73 (2015), 135--143.

Digital Library

[28]

Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E Robinson. 2016. Project Jacquard: interactive digital textiles at scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4216--4227.

Digital Library

[29]

Daniel Roetenberg, Henk Luinge, and Per Slycke. 2009. Xsens MVN: full 6DOF human motion tracking using miniature inertial sensors. Xsens Motion Technologies BV, Tech. Rep 1 (2009).

[30]

Jacob Rosen, Mitchell Lum, Mika Sinanan, and Blake Hannaford. 2011. Raven: Developing a surgical robot from a concept to a transatlantic teleoperation experiment. In Surgical Robotics. Springer, 159--197.

[31]

Tamami Saga, Nagisa Munekata, and Tetsuo Ono. 2014. Daily support robots that move on the body. In Proceedings of the Second International Conference on Human-agent Interaction. ACM, 29--34.

Digital Library

[32]

Giuseppe Tortora, Paul Glass, Nathan Wood, Burak Aksak, Arianna Menciassi, Metin Sitti, and Cameron Riviere. 2012. Investigation of bioinspired gecko fibers to improve adhesion of HeartLander surgical robot. In Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE. IEEE, 908--911.

[33]

Francesca Tramacere, Lucia Beccai, Fabio Mattioli, Edoardo Sinibaldi, and Barbara Mazzolai. 2012. Artificial adhesion mechanisms inspired by octopus suckers. In Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 3846--3851.

[34]

Matthew P Wallen, Sjaan R Gomersall, Shelley E Keating, Ulrik Wisløff, and Jeff S Coombes. 2016. Accuracy of heart rate watches: implications for weight management. PLoS One 11, 5 (2016), e0154420.

[35]

Michael Wehner, Ryan L Truby, Daniel J Fitzgerald, Bobak Mosadegh, George M Whitesides, Jennifer A Lewis, and Robert J Wood. 2016. An integrated design and fabrication strategy for entirely soft, autonomous robots. Nature 536, 7617 (2016), 451.

[36]

Adam Whiton. 2013. Sartorial Robotics: Electronic-textiles and fiber-electronics for social soft-architecture robotics. Ph.D. Dissertation. Massachusetts Institute of Technology, Cambridge, MA.

[37]

Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: pneumatically actuated soft composite materials for shape changing interfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. ACM, 13--22.

Digital Library

Cited By

Panigrahy SLee CNagoria VJanghorban MPandey RNittala A(2024)ecSkin: Low-Cost Fabrication of Epidermal Electrochemical Sensors for Detecting Biomarkers in SweatProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642232(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642232
Bordeenithikasem PCarpenter KHofmann DWhite VYee KRizzardi QMaher JMaaß R(2024)Miniaturized bulk metallic glass gripping structures for robotic mobility platformsActa Astronautica10.1016/j.actaastro.2024.03.040219(399-407)Online publication date: Jun-2024
https://doi.org/10.1016/j.actaastro.2024.03.040
Kim JPatil SMatson SConroy MKao C(2022)KnitSkin: Machine-Knitted Scaled Skin for LocomotionProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502142(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502142
Show More Cited By

Index Terms

Epidermal Robots: Wearable Sensors That Climb on the Skin

Recommendations

Detecting Compensatory Trunk Movements in Stroke Survivors using a Wearable System
WearSys '17: Proceedings of the 2017 Workshop on Wearable Systems and Applications

Because of the redundancy in the human body, stroke survivors often use atypical compensatory movements, such as reaching with trunk motion to compensate for deficits in arm function. Prior studies have established that minimizing these compensatory ...
An EMG-Controlled Robotic Hand Exoskeleton for Bilateral Rehabilitation
This paper presents a novel electromyography (EMG)-driven hand exoskeleton for bilateral rehabilitation of grasping in stroke. The developed hand exoskeleton was designed with two distinctive features: (a) kinematics with intrinsic adaptability to patient'...
Rowing training system for on-the-water rehabilitation and sport
BodyNets '13: Proceedings of the 8th International Conference on Body Area Networks

Quantitative and continuous performance assessment enhances effective physical training in sports and rehabilitation. Rowing uses the large muscles of the body in an aerobic and strength building manner. Rowing has utilization as a competitive sport, an ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 2, Issue 3

September 2018

1536 pages

EISSN:2474-9567

DOI:10.1145/3279953

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2018

Accepted: 01 September 2018

Revised: 01 May 2018

Received: 01 February 2018

Published in IMWUT Volume 2, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
797
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)13

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Panigrahy SLee CNagoria VJanghorban MPandey RNittala A(2024)ecSkin: Low-Cost Fabrication of Epidermal Electrochemical Sensors for Detecting Biomarkers in SweatProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642232(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642232
Bordeenithikasem PCarpenter KHofmann DWhite VYee KRizzardi QMaher JMaaß R(2024)Miniaturized bulk metallic glass gripping structures for robotic mobility platformsActa Astronautica10.1016/j.actaastro.2024.03.040219(399-407)Online publication date: Jun-2024
https://doi.org/10.1016/j.actaastro.2024.03.040
Kim JPatil SMatson SConroy MKao C(2022)KnitSkin: Machine-Knitted Scaled Skin for LocomotionProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502142(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502142
Liu FPatil VErickson ZTemel Z(2022)Characterization of a Meso-Scale Wearable Robot for Bathing Assistance2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)10.1109/ROBIO55434.2022.10011741(2146-2152)Online publication date: 5-Dec-2022
https://doi.org/10.1109/ROBIO55434.2022.10011741
Ungurean OVatavu R(2022)“I Gave up Wearing Rings:” Insights on the Perceptions and Preferences of Wheelchair Users for Interactions With WearablesIEEE Pervasive Computing10.1109/MPRV.2022.315595221:3(92-101)Online publication date: 1-Jul-2022
https://doi.org/10.1109/MPRV.2022.3155952
Wang YSun GHe YZhou KZhu L(2022)Octopus-inspired sucker to absorb soft tissues: stiffness gradient and acetabular protuberance improve the adsorption effectBioinspiration & Biomimetics10.1088/1748-3190/ac59c617:3(036005)Online publication date: 30-Mar-2022
https://doi.org/10.1088/1748-3190/ac59c6
Nthubu B(2021)An Overview of Sensors, Design and Healthcare Challenges in Smart Homes: Future Design QuestionsHealthcare10.3390/healthcare91013299:10(1329)Online publication date: 5-Oct-2021
https://doi.org/10.3390/healthcare9101329
Xu TXia Y(2021)Guidance for Acupuncture Robot with Potentially Utilizing Medical Robotic TechnologiesEvidence-Based Complementary and Alternative Medicine10.1155/2021/88835982021(1-11)Online publication date: 31-Mar-2021
https://doi.org/10.1155/2021/8883598
Takahashi RYukita WSasatani TYokota TSomeya TKawahara Y(2021)Twin Meander CoilProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34949965:4(1-21)Online publication date: 30-Dec-2021
https://dl.acm.org/doi/10.1145/3494996
Dementyev AJitosho RParadiso J(2021)Mechanical Imaging of Soft Tissues With Miniature Climbing RobotsIEEE Transactions on Biomedical Engineering10.1109/TBME.2021.307058568:10(3142-3150)Online publication date: Oct-2021
https://doi.org/10.1109/TBME.2021.3070585
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents