abstract

Proprioceptive Interaction: The User's Muscles as Input and Output Device

Author:

Pedro LopesAuthors Info & Claims

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 223 - 228

https://doi.org/10.1145/2851581.2859014

Published: 07 May 2016 Publication History

Abstract

In my research, I investigate how users might interact with devices smaller than mobile or wearable devices. I argue that to achieve the intended minimal form-factor such devices will leverage the user's body as an input and output device. Users will not interact with the device but instead will interact through one of their limbs, which they share with the computer as the interface. I present four research prototypes, all of which actuate the user's limbs by means of electrical muscle stimulation and are perceived through the user's proprioceptive senses.

Supplementary Material

suppl.mov (dc0118-file3.mp4)

Supplemental video

Download
5.74 MB

References

[1]

Ashbrook, D. Enabling Mobile Microinteractions. Ph.D. Dissertation. Georgia Tech, Atlanta, GA, USA.

Digital Library

[2]

Farzam Farbiz, Zhou Hao Yu, Corey Manders, and Waqas Ahmad. 2007. An electrical muscle stimulation haptic feedback for mixed reality tennis game. In ACM SIGGRAPH 2007 posters (SIGGRAPH '07). ACM, New York, NY, USA, Article 140. http://dx.doi.org/10.1145/1280720.1280873

Digital Library

[3]

Sean Gustafson, Daniel Bierwirth, and Patrick Baudisch. 2010. Imaginary interfaces: spatial interaction with empty hands and without visual feedback. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 312. http://dx.doi.org/10.1145/1866029.1866033

Digital Library

[4]

Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: appropriating the body as an input surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 453--462. http://dx.doi.org/10.1145/1753326.1753394

Digital Library

[5]

Idin Karuei, Karon E. MacLean, Zoltan Foley-Fisher, Russell MacKenzie, Sebastian Koch, and Mohamed El-Zohairy. 2011. Detecting vibrations across the body in mobile contexts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3267--3276. http://dx.doi.org/10.1145/1978942.1979426

Digital Library

[6]

Ernst Kruijff, Dieter Schmalstieg, and Steffi Beckhaus. 2006. Using neuromuscular electrical stimulation for pseudo-haptic feedback. In Proceedings of the ACM symposium on Virtual reality software and technology (VRST '06). ACM, New York, NY, USA, 316--319. http://dx.doi.org/10.1145/1180495.1180558

Digital Library

[7]

Li, K, A. Designing easily learnable eyes-free interaction, Ph.D. Thesis. UC San Diego, 2009.

[8]

Pedro Lopes and Patrick Baudisch. 2013. Musclepropelled force feedback: bringing force feedback to mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2577--2580. http://dx.doi.org/10.1145/2470654.2481355

Digital Library

[9]

Lopes, P., Ion, A., and Baudisch, P. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28nd annual ACM symposium on User interface software and technology (UIST '15). ACM, New York, NY, USA.

Digital Library

[10]

Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 939--948. http://dx.doi.org/10.1145/2702123.2702461

Digital Library

[11]

Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++: Allowing Objects to Communicate Dynamic Use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2515--2524. http://doi.acm.org/10.1145/2702123.2702128

Digital Library

[12]

Mann, S. (2001). Guest Editor's Introduction: Wearable Computing-Toward Humanistic Intelligence. IEEE Intelligent Systems, 16(3), 1015.

Digital Library

[13]

Murayama, J., Bougrila, L., Luo, Y., Akahane, K., Hasegawa, S., Hirsbrunner, B., Sato, M. SPIDAR G&G: a two-handed haptic interface for bimanual VR interaction. Proc. EuroHaptics '04, 138--146.

[14]

Tao Ni and Patrick Baudisch. 2009. Disappearing mobile devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 101--110. http://dx.doi.org/10.1145/1622176.1622197.

Digital Library

[15]

Jerome Pasquero, Scott J. Stobbe, and Noel Stonehouse. 2011. A haptic wristwatch for eyesfree interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3257--3266. http://dx.doi.org/10.1145/1978942.1979425

Digital Library

[16]

Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise Control for Pedestrians: Controlling Walking Direction using Electrical Muscle Stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2505--2514. http://doi.acm.org/10.1145/2702123.2702190

Digital Library

[17]

Anne Roudaut, Andreas Rau, Christoph Sterz, Max Plauth, Pedro Lopes, and Patrick Baudisch. 2013. Gesture output: eyes-free output using a force feedback touch surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2547--2556. http://dx.doi.org/10.1145/2470654.2481352

Digital Library

[18]

T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, and James A. Landay. 2009. Enabling always-available input with muscle-computer interfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 167--176. http://dx.doi.org/10.1145/1622176.1622208

Digital Library

[19]

Stelarc. 1999. From zombies to cyborg bodies: exoskeleton, extra ear and avatars. In Proceedings of the 3rd conference on Creativity & cognition (C&C '99). ACM, New York, NY, USA, 23-. http://dx.doi.org/10.1145/317561.317566

Digital Library

[20]

Strojnik, P., Kralj, A., and Ursic, I., Programmed six-channel electrical stimulator for complex stimulation of leg muscles during walking, IEEE Trans. Biomed. Eng. 26, 112, 1979.

[21]

Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 543--552. http://dx.doi.org/10.1145/1978942.1979018

Digital Library

[22]

Dzmitry Tsetserukou, Katsunari Sato, and Susumu Tachi. 2010. ExoInterfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation. In Proceedings of the 1st Augmented Human International Conference (AH '10). ACM, New York, NY, USA, Article 1, 6 pages. DOI=http://dx.doi.org/10.1145/1785455.1785456

Digital Library

Cited By

Zhou HAyesh TFan CSarsenbayeva ZWithana A(2024)CoplayingVR: Understanding User Experience in Shared Control in Virtual RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785088:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678508
Mo WDechant MMarquardt NAyobi ASingh AHolloway C(2024)Exploring the Design Space of Input Modalities for Working in Mixed Reality on Long-haul FlightsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661560(2267-2285)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661560
Faltaous SWilliamson JKoelle MPfeiffer MKeppel JSchneegass S(2024)Understanding User Acceptance of Electrical Muscle Stimulation in Human-Computer InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642585(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642585
Show More Cited By

Index Terms

Proprioceptive Interaction: The User's Muscles as Input and Output Device
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Proprioceptive Interaction
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

We propose a new way of eyes-free interaction for wearables. It is based on the user's proprioceptive sense, i.e., rather than seeing, hearing, or feeling an outside stimulus, users feel the pose of their own body. We have implemented a wearable device ...
Proprioceptive Interaction
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

We propose a new way of eyes-free interaction for wearables. It is based on the user's proprioceptive sense, i.e., rather than seeing, hearing, or feeling an outside stimulus, users feel the pose of their own body. We have implemented a wearable device ...
MuscleIO: Muscle-Based Input and Output for Casual Notifications

Receiving and reacting to notifications on mobile devices can be cumbersome. We propose MuscleIO, the use of electrical muscle stimulation (EMS) for notification output and electromyography (EMG) for reacting to notifications. Our approach provides a one-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2016

3954 pages

ISBN:9781450340823

DOI:10.1145/2851581

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
389
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou HAyesh TFan CSarsenbayeva ZWithana A(2024)CoplayingVR: Understanding User Experience in Shared Control in Virtual RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785088:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678508
Mo WDechant MMarquardt NAyobi ASingh AHolloway C(2024)Exploring the Design Space of Input Modalities for Working in Mixed Reality on Long-haul FlightsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661560(2267-2285)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661560
Faltaous SWilliamson JKoelle MPfeiffer MKeppel JSchneegass S(2024)Understanding User Acceptance of Electrical Muscle Stimulation in Human-Computer InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642585(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642585
Faltaous SKoelle MSchneegass S(2022)From Perception to Action: A Review and Taxonomy on Electrical Muscle Stimulation in HCIProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568460(159-171)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568460
Alotaibi YWilliamson JBrewster S(2022)First Steps Towards Designing Electrotactons: Investigating Intensity and Pulse Frequency as Parameters for Electrotactile CuesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501863(1-11)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501863
Vatavu RSchipor O(2022)Formalizing Digital Proprioception for Devices, Environments, and UsersAmbient Intelligence – Software and Applications – 12th International Symposium on Ambient Intelligence10.1007/978-3-031-06894-2_1(1-10)Online publication date: 1-Sep-2022
https://doi.org/10.1007/978-3-031-06894-2_1
Jain AHorowitz ASchoeller FLeigh SMaes PSra M(2020)Designing Interactions Beyond Conscious ControlProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34118294:3(1-23)Online publication date: 4-Sep-2020
https://dl.acm.org/doi/10.1145/3411829

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents