Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3025453.3025704acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Open access

SkinMarks: Enabling Interactions on Body Landmarks Using Conformal Skin Electronics

Published: 02 May 2017 Publication History

Abstract

The body provides many recognizable landmarks due to the underlying skeletal structure and variations in skin texture, elasticity, and color. The visual and spatial cues of such body landmarks can help in localizing on-body interfaces, guide input on the body, and allow for easy recall of mappings. Our main contribution are SkinMarks, novel skin-worn I/O devices for precisely localized input and output on fine body landmarks. SkinMarks comprise skin electronics on temporary rub-on tattoos. They conform to fine wrinkles and are compatible with strongly curved and elastic body locations. We identify five types of body landmarks and demonstrate novel interaction techniques that leverage SkinMarks' unique touch, squeeze and bend sensing with integrated visual output. Finally, we detail on the conformality and evaluate sub-millimeter electrodes for touch sensing. Taken together, SkinMarks expands the on-body interaction space to more detailed, highly curved and challenging areas on the body.

Supplementary Material

suppl.mov (pn2283p.mp4)
Supplemental video

References

[1]
Daniel Ashbrook, Patrick Baudisch, and Sean White. 2011. Nenya: Subtle and Eyes-free Mobile Input with a Magnetically-tracked Finger Ring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2043--2046.
[2]
Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: Private and Subtle Interaction Using Fingertips. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 255--260.
[3]
Burke Davison. 2010. Techniques for robust touch sensing design. AN1334 Microchip Technology Inc (2010).
[4]
Margo DeMello. 2007. Encyclopedia of body adornment. Greenwood Press.
[5]
Niloofar Dezfuli, Mohammadreza Khalilbeigi, Jochen Huber, Florian Müller, and Max Mühlhäuser. 2012. PalmRC: Imaginary Palm-based Remote Control for Eyes-free Television Interaction. In Proceedings of the 10th European Conference on Interactive Tv and Video (EuroiTV '12). ACM, New York, NY, USA, 27--34.
[6]
R. Drake, R.L. Drake, W. Vogl, and A.W.M. Mitchell. 2012. Gray's Basic Anatomy. Elsevier - Health Sciences Division. https://books.google.de/books?id=Qchc5WZ7IPkC
[7]
Yang Guo, Michael T. Otley, Mengfang Li, Xiaozheng Zhang, Sneh K. Sinha, Gregory M. Treich, and Gregory A. Sotzing. 2016. PEDOT:PSS Wires Printed on Textile for Wearable Electronics. ACS Applied Materials & Interfaces 8, 40 (2016), 26998--27005. 27632390.
[8]
Sean Gustafson, Christian Holz, and Patrick Baudisch. 2011. Imaginary Phone: Learning Imaginary Interfaces by Transferring Spatial Memory from a Familiar Device. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 283--292.
[9]
Sean G. Gustafson, Bernhard Rabe, and Patrick M. Baudisch. 2013. Understanding Palm-based Imaginary Interfaces: The Role of Visual and Tactile Cues when Browsing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 889--898.
[10]
Mallory L. Hammock, Alex Chortos, Benjamin C.-K. Tee, Jeffrey B.-H. Tok, and Zhenan Bao. 2013. 25th Anniversary Article: The Evolution of Electronic Skin (E-Skin): A Brief History, Design Considerations, and Recent Progress. Advanced Materials 25, 42 (2013), 5997--6038.
[11]
Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 441--450.
[12]
Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: Appropriating the Body As an Input Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 453--462.
[13]
Hong Hocheng and Chao-Ming Chen. 2014. Design, Fabrication and Failure Analysis of Stretchable Electrical Routings. Sensors 14, 7 (2014), 11855.
[14]
Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1526--1537.
[15]
Jae-Woong Jeong, Woon-Hong Yeo, Aadeel Akhtar, James J. S. Norton, Young-Jin Kwack, Shuo Li, Sung-Young Jung, Yewang Su, Woosik Lee, Jing Xia, Huanyu Cheng, Yonggang Huang, Woon-Seop Choi, Timothy Bretl, and John A. Rogers. 2013. Materials and Optimized Designs for Human-Machine Interfaces Via Epidermal Electronics. Advanced Materials 25, 47 (2013), 6839--6846.
[16]
Hsin-Liu (Cindy) Kao, Artem Dementyev, Joseph A. Paradiso, and Chris Schmandt. 2015. NailO: Fingernails As an Input Surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3015--3018.
[17]
Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: Rapidly Prototyping On-skin User Interfaces Using Skin-friendly Materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16). ACM, New York, NY, USA, 16--23.
[18]
Dae-Hyeong Kim, Nanshu Lu, Rui Ma, Yun-Soung Kim, Rak-Hwan Kim, Shuodao Wang, Jian Wu, Sang Min Won, Hu Tao, Ahmad Islam, Ki Jun Yu, Tae-il Kim, Raeed Chowdhury, Ming Ying, Lizhi Xu, Ming Li, Hyun-Joong Chung, Hohyun Keum, Martin McCormick, Ping Liu, Yong-Wei Zhang, Fiorenzo G. Omenetto, Yonggang Huang, Todd Coleman, and John A. Rogers. 2011. Epidermal Electronics. Science 333, 6044 (2011), 838--843.
[19]
Jeonghyun Kim, Anthony Banks, Huanyu Cheng, Zhaoqian Xie, Sheng Xu, Kyung-In Jang, Jung Woo Lee, Zhuangjian Liu, Philipp Gutruf, Xian Huang, Pinghung Wei, Fei Liu, Kan Li, Mitul Dalal, Roozbeh Ghaffari, Xue Feng, Yonggang Huang, Sanjay Gupta, Ungyu Paik, and John A. Rogers. 2015. Epidermal Electronics with Advanced Capabilities in Near-Field Communication. Small 11, 8 (2015), 906--912.
[20]
Paul A. J. Kolarsick, Maria Ann Kolarsick, and Carolyn Goodwin. 2011. Anatomy and Physiology of the Skin. Journal of the Dermatology Nurses' Association 3, 4 (2011). http://journals.lww.com/jdnaonline/Fulltext/ 2011/07000/Anatomy_and_Physiology_of_the_Skin.3.aspx
[21]
Subhash Lele and Joan T. Richtsmeier. 1991. Euclidean distance matrix analysis: A coordinate-free approach for comparing biological shapes using landmark data. American Journal of Physical Anthropology 86, 3 (1991), 415--427.
[22]
Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, and Ivan Poupyrev. 2016. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. ACM Trans. Graph. 35, 4, Article 142 (July 2016), 19 pages.
[23]
Jhe-Wei Lin, Chiuan Wang, Yi Yao Huang, Kuan-Ting Chou, Hsuan-Yu Chen, Wei-Luan Tseng, and Mike Y. Chen. 2015. BackHand: Sensing Hand Gestures via Back of the Hand. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 557--564.
[24]
Shu-Yang Lin, Chao-Huai Su, Kai-Yin Cheng, Rong-Hao Liang, Tzu-Hao Kuo, and Bing-Yu Chen. 2011. Pub - Point Upon Body: Exploring Eyes-free Interaction and Methods on an Arm. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 481--488.
[25]
Darren J. Lipomi, Jennifer A. Lee, Michael Vosgueritchian, Benjamin C.-K. Tee, John A. Bolander, and Zhenan Bao. 2012. Electronic Properties of Transparent Conductive Films of PEDOT:PSS on Stretchable Substrates. Chemistry of Materials 24, 2 (2012), 373--382.
[26]
Roman Lissermann, Jochen Huber, Aristotelis Hadjakos, and Max Mühlhäuser. 2013. EarPut: Augmenting Behind-the-ear Devices for Ear-based Interaction. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 1323--1328.
[27]
Joanne Lo, Doris Jung Lin Lee, Nathan Wong, David Bui, and Eric Paulos. 2016. Skintillates: Designing and Creating Epidermal Interactions. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 853--864.
[28]
Pranav Mistry, Pattie Maes, and Liyan Chang. 2009. WUW - Wear Ur World: A Wearable Gestural Interface. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, New York, NY, USA, 4111--4116.
[29]
Masa Ogata, Yuta Sugiura, Yasutoshi Makino, Masahiko Inami, and Michita Imai. 2013. SenSkin: Adapting Skin As a Soft Interface. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 539--544.
[30]
Uran Oh and Leah Findlater. 2014. Design of and Subjective Response to On-body Input for People with Visual Impairments. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '14). ACM, New York, NY, USA, 115--122.
[31]
Simon Olberding, Michael Wessely, and Jürgen Steimle. 2014. PrintScreen: Fabricating Highly Customizable Thin-film Touch-displays. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 281--290.
[32]
Henning Pohl, Justyna Medrek, and Michael Rohs. 2016. ScatterWatch: Subtle Notifications via Indirect Illumination Scattered in the Skin. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM, New York, NY, USA, 7--16.
[33]
Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E. Robinson. 2016. Project Jacquard: Interactive Digital Textiles at Scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4216--4227.
[34]
Jun Rekimoto. 2002. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 113--120.
[35]
Tsuyoshi Sekitani, Martin Kaltenbrunner, Tomoyuki Yokota, and Takao Someya. 2014. Imperceptible Electronic Skin. SID Information Display 30, 1 (2014), 20--25. http://informationdisplay.org/IDArchive/2014/ JanuaryFebruary/ FrontlineTechnologyImperceptibleElectronic.aspx
[36]
Jürgen Steimle. 2016. Skin--The Next User Interface. Computer 49, 4 (Apr 2016), 83--87.
[37]
Emi Tamaki, Takashi Miyak, and Jun Rekimoto. 2010. BrainyHand: A Wearable Computing Device Without HMD and It's Interaction Techniques. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI '10). ACM, New York, NY, USA, 387--388.
[38]
Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y. Chen. 2015a. PalmType: Using Palms As Keyboards for Smart Glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 153--160.
[39]
Cheng-Yao Wang, Min-Chieh Hsiu, Po-Tsung Chiu, Chiao-Hui Chang, Liwei Chan, Bing-Yu Chen, and Mike Y. Chen. 2015b. PalmGesture: Using Palms As Gesture Interfaces for Eyes-free Input. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 217--226.
[40]
R. Chad Webb, Andrew P. Bonifas, Alex Behnaz, Yihui Zhang, Ki Jun Yu, Huanyu Cheng, Mingxing Shi, Zuguang Bian, Zhuangjian Liu, Yun-Soung Kim, Woon-Hong Yeo, Jae Suk Park, Jizhou Song, Yuhang Li, Yonggang Huang, Alexander M. Gorbach, and John A. Rogers. 2013. Ultrathin conformal devices for precise and continuous thermal characterization of human skin. Nature Materials 12, 10 (Oct 2013), 938--944. http://dx.doi.org/10.1038/nmat3755 Article.
[41]
Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2991--3000.
[42]
Martin Weigel, Vikram Mehta, and Jürgen Steimle. 2014. More Than Touch: Understanding How People Use Skin As an Input Surface for Mobile Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 179--188.
[43]
Michael Wessely, Theophanis Tsandilas, and Wendy E. Mackay. 2016. Stretchis: Fabricating Highly Stretchable User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 697--704.
[44]
Sang Ho Yoon, Ke Huo, Vinh P. Nguyen, and Karthik Ramani. 2015. TIMMi: Finger-worn Textile Input Device with Multimodal Sensing in Mobile Interaction. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 269--272.
[45]
Yang Zhang, Junhan Zhou, Gierad Laput, and Chris Harrison. 2016. SkinTrack: Using the Body As an Electrical Waveguide for Continuous Finger Tracking on the Skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1491--1503.

Cited By

View all
  • (2024)TipTopTyping: A Thumb-to-Finger Text Input Method and Character Layout Optimized for Mobile Spatial ComputingProceedings of Mensch und Computer 202410.1145/3670653.3670669(196-206)Online publication date: 1-Sep-2024
  • (2024)ECSkin: Tessellating Electrochromic Films for Reconfigurable On-skin DisplaysProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596138:2(1-26)Online publication date: 15-May-2024
  • (2024)Understanding Gesture and Microgesture Inputs for Augmented Reality MapsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661630(409-423)Online publication date: 1-Jul-2024
  • Show More Cited By

Index Terms

  1. SkinMarks: Enabling Interactions on Body Landmarks Using Conformal Skin Electronics

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. electronic tattoos
    2. epidermal electronics
    3. fabrication
    4. flexible display.
    5. on-body interaction
    6. on-skin display
    7. on-skin sensing

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)282
    • Downloads (Last 6 weeks)41
    Reflects downloads up to 02 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)TipTopTyping: A Thumb-to-Finger Text Input Method and Character Layout Optimized for Mobile Spatial ComputingProceedings of Mensch und Computer 202410.1145/3670653.3670669(196-206)Online publication date: 1-Sep-2024
    • (2024)ECSkin: Tessellating Electrochromic Films for Reconfigurable On-skin DisplaysProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596138:2(1-26)Online publication date: 15-May-2024
    • (2024)Understanding Gesture and Microgesture Inputs for Augmented Reality MapsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661630(409-423)Online publication date: 1-Jul-2024
    • (2024)SweatSkinProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314257:4(1-30)Online publication date: 12-Jan-2024
    • (2024)RadarHand: A Wrist-Worn Radar for On-Skin Touch-Based Proprioceptive GesturesACM Transactions on Computer-Human Interaction10.1145/361736531:2(1-36)Online publication date: 29-Jan-2024
    • (2024)HydroSkin: Rapid Prototyping On-Skin Interfaces via Low-Cost Hydrographic PrintingExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651052(1-6)Online publication date: 11-May-2024
    • (2024)On Stress: Combining Human Factors and Biosignals to Inform the Placement and Design of a Skin-like Stress SensorProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3643473(1-13)Online publication date: 11-May-2024
    • (2024)vARitouch: Back of the Finger Device for Adding Variable Compliance to Rigid ObjectsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642828(1-20)Online publication date: 11-May-2024
    • (2024)DisplayFab: The State of the Art and a Roadmap in the Personal Fabrication of Free-Form Displays Using Active Materials and Additive Manufacturing.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642708(1-24)Online publication date: 11-May-2024
    • (2024)STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR InputProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642702(1-15)Online publication date: 11-May-2024
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media