Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2702123.2702461acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Proprioceptive Interaction

Published: 18 April 2015 Publication History

Abstract

We propose a new way of eyes-free interaction for wearables. It is based on the user's proprioceptive sense, i.e., rather than seeing, hearing, or feeling an outside stimulus, users feel the pose of their own body. We have implemented a wearable device called Pose-IO that offers input and output based on proprioception. Users communicate with Pose-IO through the pose of their wrists. Users enter information by performing an input gesture by flexing their wrist, which the device senses using a 3-axis accelerometer. Users receive output from Pose-IO by find-ing their wrist posed in an output gesture, which Pose-IO actuates using electrical muscle stimulation. This mechanism allows users to interact with Pose-IO without visual or auditory senses, but through the proprioceptive sense alone. We developed three simple applications that demonstrate symmetric proprioceptive interaction, where input and output occur through the same limb, as well as asymmetric interaction, where input and output occur through different limbs. In a first user study, participants using a symmetric proprioceptive interface re-entered poses received from Pose-IO with an average accuracy of 5.8° despite the minimal bandwidth offered by the device. In a second, exploratory study, we investigated participants' emotional response to asymmetric proprioceptive interaction and the concept of the user's body serving as interface. Participants reported to enjoy the experience (4.6 out of 5).

Supplementary Material

suppl.mov (pn1766-file3.mp4)
Supplemental video

References

[1]
Ashbrook, D. Enabling Mobile Microinteractions. Ph.D. Dissertation. Georgia Tech, Atlanta, GA, USA.
[2]
Ban, Y., Narumi, T., Fujii, T., Sakurai, S., Imura, J., Tanikawa, T., and Hirose, M Augmented endurance: controlling fatigue while handling objects by affecting weight perception using augmented reality. Proc. CHI '13, 69--78.
[3]
Baudisch, P., Pohl, H., Reinicke, S., Wittmers, E., Lühne, P., Knaust, M., Köhler, S., Schmidt, P., and Holz, C. Imaginary reality gaming: ball games without a ball. Proc. UIST'13, 405--410.
[4]
Boven, K., Fejtl, M., Moeller, A., Nisch, W. and Stett, A. On Micro-Electrode Array Revival. In: Advances in Network Electrophysiology Using Multi-Electrode Arrays, 2006: 24--37.
[5]
Chao, E., An, K., Cooney, W., Linscheid, R. Biomechanics of the Hand. World Scientific Publishing, 1989.
[6]
Daniel, S., Gallagher, S., (Eds.), Handbook of Phenomenology and Cognitive Science, Springer; 2010 edition, ISBN-10: 9048126452
[7]
E. Gardner and J. Martin. Coding of Sensory Information, Principles of Neural Science. McGrawHill, fourth edition, 2000.
[8]
Farbiz, F., Yu, Z. H., Manders, C., and Ahmad, W. An electrical muscle stimulation haptic feedback for mixed reality tennis game. Proc. SIGGRAPH '07 (poster).
[9]
Felzer, T., and Nordmann, R. Using intentional muscle contractions as input signals for various hands-free control applications. Proc. iCREATe'08, 87--91.
[10]
Gandevia, S., Smith, J., Crawford, M., Proske, U., and Taylor, J. Motor commands contribute to human position sense. Journal of Physiology, 2006, 571(3) 703--710.
[11]
Gustafson, S., Bierwirth, D., and Baudisch, P. Imaginary interfaces: spatial interaction with empty hands and without visual feedback. Proc. UIST '10, 3--12.
[12]
Gustafson, S., Rabe, B., and Baudisch, P. Understanding palm-based imaginary interfaces: the role of visual and tactile cues when browsing. Proc CHI'13, 889--898.
[13]
Harrison, C., Tan, D., and Morris, D. Skinput: appropriating the body as an input surface. Proc. CHI'10, 453--462.
[14]
Hollerbach J. and Jacobsen S. Haptic Interfaces for Teleoperation and Virtual Environments. Proc. of First Workshop on Simulation and Interaction in Virtual Environments '95, 13--15.
[15]
Hook, J., Nappey, T., Making 3D Printed Objects Interactive Using Wireless Accelerometers. Proc. CHI '14 Extended Abstracts, 1435--1440.
[16]
K. Bark, J. W. Wheeler, S. Premakumar, and M. R. Cutkosky, Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information. Proc. HAPTICS '08, 71--78.
[17]
Karuei, I., MacLean, K., Foley-Fisher, Z., MacKenzie, R., Koch, S., and El-Zohairy, M. Detecting vibrations across the body in mobile contexts. Proc. CHI'11, 3267--3276.
[18]
Katoh, M, Nishimura, N., Yokoyama, M., Hachisu, T., Sato, M., FUnited Kingdomushima, S., and Kajimoto, H. Optimal selection of electrodes for muscle electrical stimulation using twitching motion measurement. Proc. AH '13, 237--238.
[19]
Ken Hinckley, Randy Pausch, and Dennis Proffitt. 1997. Attention and visual feedback: the bimanual frame of reference. Proc. I3D '97, 121--126.
[20]
Kruijff, E., Schmalstieg, D., and Beckhaus, S. Using neuromuscular electrical stimulation for pseudo-haptic feedback. Proc. VRST '06, 316--319.
[21]
Li, K, A. Designing easily learnable eyes-free interaction, Ph.D. Thesis. UC San Diego, 2009.
[22]
Lopes, P. and Baudisch, P., Muscle-Propelled Force Feedback: bringing force feedback to mobile devices, Proc. CHI'13, 2577--2580.
[23]
Maffiuletti, N., Minetto, M., Farina, D., and Bottinelli, R. Electrical stimulation for neuromuscular testing and training: State-of-the art and unresolved issues. In Journal of Applied Physiology 2011, 111:2391--2397.
[24]
Murayama, J., Bougrila, L., Luo, Y., Akahane, K., Hasegawa, S., Hirsbrunner, B., Sato, M. SPIDAR G&G: a two-handed haptic interface for bimanual VR interaction. Proc. EuroHaptics '04, 138--146.
[25]
Ni, T. and Baudisch, P. Disappearing mobile devices. Proc. UIST'09, 101--110.
[26]
Pasquero, J., Stobbe, S., and Stonehouse, N. A haptic wristwatch for eyes-free interactions. Proc. CHI'11, 3257--3266.
[27]
Pfeiffer, M., Schneegass, S., Alt, F., and Rohs, M., Let Me Grab This: A Comparison of EMS and Vibration for Haptic Feedback in Free-Hand Interaction, Proc. AH'14.
[28]
Proske, U., and Gandevia, S., The Proprioceptive Senses: Their Roles in Signaling Body Shape, Body Position and Movement, and Muscle Force, In Physiological Reviews 2012, Vol. 92 no. 4,1651--1697
[29]
Red Hands, http://en.wikipedia.org/wiki/Red_hands.
[30]
Roudaut, A., Rau, A., Sterz, C., Plauth, M., Lopes, P., and Baudisch, P. Gesture output: eyes-free output using a force feedback touch surface. Proc. CHI'13, 25472556.
[31]
Saponas, S., Tan, D., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. Enabling always-available input with muscle-computer interfaces. Proc. UIST'09, 167--176.
[32]
Stelarc. From zombies to cyborg bodies: exoskeleton, extra ear and avatars. Proc. C&C '99, 23.
[33]
Strojnik, P., Kralj, A., and Ursic, I., Programmed sixchannel electrical stimulator for complex stimulation of leg muscles during walking, IEEE Trans. Biomed. Eng. 26, 112, 1979.
[34]
Tamaki, E., Miyaki, T., and Rekimoto, J., Possessed Hand: techniques for controlling human hands using electrical muscles stimuli. Proc. CHI '11, 543--552.
[35]
Terrault, S., Lecolinet, E., Eagan, J., and Guiard, Y. Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets. Proc. CHI'13, 1451--1460.
[36]
TsetserUnited Kingdomou, D., Sato, K., and Tachi, S. ExoInterfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation. Proc. AH '10, 1--6.
[37]
Walsh, L., Smith, J., Gandevia, S, and Taylor, J. The combined effect of muscle contraction history and motor commands on human position sense. Journal of Experimental Brain Research, 2009; 195(4): 603--10.
[38]
Wigdor, D., and Wixon, D, Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Morgan Kaufmann Publishers Inc., 2011.

Cited By

View all
  • (2024)The effect of electrical muscle stimulation on intentional binding and explicit sense of agencyPeerJ10.7717/peerj.1797712(e17977)Online publication date: 19-Sep-2024
  • (2024)Electrical Muscle Stimulation for Kinesthetic Feedback in AR/VR: A Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti80200078:2(7)Online publication date: 25-Jan-2024
  • (2024)Exploring Shared Bodily Control: Designing Augmented Human Systems for Intra- and Inter-CorporealityProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653037(318-323)Online publication date: 4-Apr-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
April 2015
4290 pages
ISBN:9781450331456
DOI:10.1145/2702123
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. io
  2. muscle actuation
  3. proprioception

Qualifiers

  • Research-article

Conference

CHI '15
Sponsor:
CHI '15: CHI Conference on Human Factors in Computing Systems
April 18 - 23, 2015
Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)179
  • Downloads (Last 6 weeks)29
Reflects downloads up to 28 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)The effect of electrical muscle stimulation on intentional binding and explicit sense of agencyPeerJ10.7717/peerj.1797712(e17977)Online publication date: 19-Sep-2024
  • (2024)Electrical Muscle Stimulation for Kinesthetic Feedback in AR/VR: A Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti80200078:2(7)Online publication date: 25-Jan-2024
  • (2024)Exploring Shared Bodily Control: Designing Augmented Human Systems for Intra- and Inter-CorporealityProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653037(318-323)Online publication date: 4-Apr-2024
  • (2024)Sonic Entanglements with Electromyography: Between Bodies, Signals, and RepresentationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661572(2691-2707)Online publication date: 1-Jul-2024
  • (2024)Shared Bodily Fusion: Leveraging Inter-Body Electrical Muscle Stimulation for Social PlayProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660723(2088-2106)Online publication date: 1-Jul-2024
  • (2024)Exploring Superpower Design Through Wi-Fi TwingeProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633352(1-16)Online publication date: 11-Feb-2024
  • (2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633349(1-16)Online publication date: 11-Feb-2024
  • (2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3649125(1-4)Online publication date: 11-May-2024
  • (2024)Paired-EMS: Enhancing Electrical Muscle Stimulation (EMS)-based Force Feedback Experience by Stimulating Both Muscles in Antagonistic PairsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642841(1-7)Online publication date: 11-May-2024
  • (2024)Motionless Movement: Towards Vibrotactile Kinesthetic DisplaysProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642499(1-16)Online publication date: 11-May-2024
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media