research-article

Open access

Personalising vibrotactile displays through perceptual sensitivity adjustment

Authors:

Granit Luzhnica,

Sebastian Stein,

Viktoria Pammer,

John Williamson,

Roderick Murray SmithAuthors Info & Claims

ISWC '17: Proceedings of the 2017 ACM International Symposium on Wearable Computers

Pages 66 - 73

https://doi.org/10.1145/3123021.3123029

Published: 11 September 2017 Publication History

Abstract

Haptic displays are commonly limited to transmitting a discrete set of tactile motives. In this paper, we explore the transmission of real-valued information through vibrotactile displays. We simulate spatial continuity with three perceptual models commonly used to create phantom sensations: the linear, logarithmic and power model. We show that these generic models lead to limited decoding precision, and propose a method for model personalization adjusting to idiosyncratic and spatial variations in perceptual sensitivity. We evaluate this approach using two haptic display layouts: circular, worn around the wrist and the upper arm, and straight, worn along the forearm. Results of a user study measuring continuous value decoding precision show that users were able to decode continuous values with relatively high accuracy (4.4% mean error), circular layouts performed particularly well, and personalisation through sensitivity adjustment increased decoding precision.

References

[1]

Alles, D. S. Information transmission by phantom sensations. IEEE Transactions on Man-Machine Systems 11, 1 (March 1970), 85--91.

[2]

Badke, M. B., Sherman, J., Boyne, P., Page, S., and Dunning, K. Tongue-based biofeedback for balance in stroke: results of an 8-week pilot study. Archives of physical medicine and rehabilitation.

[3]

Barghout, A., Cha, J., Saddik, A. E., Kammerl, J., and Steinbach, E. Spatial resolution of vibrotactile perception on the human forearm when exploiting funneling illusion. In 2009 IEEE International Workshop on Haptic Audio visual Environments and Games (Nov 2009), 19--23.

[4]

Bliss, J. C., Katcher, M. H., Rogers, C. H., and Shepard, R. P. Optical-to-tactile image conversion for the blind. IEEE Transactions on Man-Machine Systems 11, 1 (March 1970), 58--65.

[5]

Brown, L. M., and Kaaresoja, T. Feel who's talking: Using tactons for mobile phone alerts. In CHI '06 Extended Abstracts on Human Factors in Computing Systems, CHI EA '06, ACM (2006), 604--609.

Digital Library

[6]

Byrd, R. H., Lu, P., Nocedal, J., and Zhu, C. A Limited Memory Algorithm for Bound Constrained Optimization. SIAM J. Sci. Comput. 16, 5 (Sept. 1995), 1190--1208.

Digital Library

[7]

Cha, J., Rahal, L., and Saddik, A. E. A pilot study on simulating continuous sensation with two vibrating motors. In 2008 IEEE International Workshop on Haptic Audio visual Environments and Games (Oct 2008), 143--147.

[8]

Chatterjee, A., Chaubey, P., Martin, J., and Thakor, N. V. Quantifying prosthesis control improvements using a vibrotactile representation of grip force. In 2008 IEEE Region 5 Conference (April 2008), 1--5.

[9]

Cholewiak, R. W., and Collins, A. A. Vibrotactile localization on the arm: Effects of place, space, and age. Perception & Psychophysics (2003).

[10]

Crossan, A., and Brewster, S. Two-handed navigation in a haptic virtual environment. In CHI '06 Extended Abstracts on Human Factors in Computing Systems, CHI EA '06, ACM (New York, NY, USA, 2006).

Digital Library

[11]

de Jesus Oliveira, and Maciel, A. Assessment of tactile languages as navigation aid in 3d environments. In EUROHAPTICS, 2014 (2014).

[12]

de Jesus Oliveira, and Maciel, A. Introducing the modifier tactile pattern for vibrotactile communication. In EUROHAPTICS, 2014 (2014).

[13]

Ding, Z. Q., Luo, Z. Q., Causo, A., Chen, I. M., Yue, K. X., and Yeo, S. H. Inertia sensor-based guidance system for upperlimb posture correction. Med Eng Phys 35 (2013).

[14]

Eid, M., Korres, G., and Jensen, C. B. F. Soa thresholds for the perception of discrete/continuous tactile stimulation. In 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX) (May 2015), 1--6.

[15]

Gault, R. H. Progress in experiments on tactual interpretation of oral speech. The Journal of Abnormal Psychology and Social Psychology 19, 2 (1924), 155.

[16]

Geldard, F. A. Adventures in tactile literacy. American Psychologist 12, 3 (1957), 115--124.

[17]

Gopalai, A. A., and Senanayake, S. M. N. A. A wearable real-time intelligent posture corrective system using vibrotactile feedback. IEEE Trans Mechatronics 16 (2011).

[18]

Gunther, E. Skinscape: A tool for composition in the tactile modality. PhD thesis, Massachusetts Institute of Technology, 2001.

[19]

Israr, A., Kim, S.-C., Stec, J., and Poupyrev, I. Surround haptics: Tactile feedback for immersive gaming experiences. In CHI '12 Extended Abstracts on Human Factors in Computing Systems, CHI EA '12 (2012).

Digital Library

[20]

Israr, A., and Poupyrev, I. Control space of apparent haptic motion. In 2011 IEEE World Haptics Conference (June 2011), 457--462.

[21]

Israr, A., and Poupyrev, I. Tactile brush: Drawing on skin with a tactile grid display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '11 (2011).

Digital Library

[22]

Kaul, O. B., and Rohs, M. Haptichead: A spherical vibrotactile grid around the head for 3d guidance in virtual and augmented reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI '17 (2017).

Digital Library

[23]

Kentala, E., Vivas, J., and Conrad Wall, I. Reduction of postural sway by use of a vibrotactile balance prosthesis prototype in subjects with vestibular deficits. Annals of Otology, Rhinology & Laryngology 112.

[24]

Kirman, J. H. Tactile perception of computer-derived formant patterns from voiced speech. The Journal of the Acoustical Society of America (1974).

[25]

Lee, J., Kim, Y., and Kim, G. J. Effects of visual feedback on out-of-body illusory tactile sensation when interacting with augmented virtual objects. IEEE Transactions on Human-Machine Systems 47, 1 (Feb 2017), 101--112.

[26]

Liao, Y.-C., Chen, Y.-L., Lo, J.-Y., Liang, R.-H., Chan, L., and Chen, B.-Y. Edgevib: Effective alphanumeric character output using a wrist-worn tactile display. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST '16 (2016).

Digital Library

[27]

Luzhnica, G., Veas, E., and Pammer, V. Skin reading: Encoding text in a 6-channel haptic display. In Proceedings of the 2016 ACM International 73 Symposium on Wearable Computers, ISWC '16 (2016).

Digital Library

[28]

Mackinlay, J. Automating the design of graphical presentations of relational information. ACM Transactions on Graphics 5, 2 (Apr. 1986).

Digital Library

[29]

Makous, J. C., Friedman, R. M., and Vierck, C. J. A critical band filter in touch. The Journal of neuroscience : the official journal of the Society for Neuroscience 15 4 (1995), 2808--18.

[30]

Nicolau, H., Guerreiro, J. a., Guerreiro, T., and Carriço, L. Ubibraille: Designing and evaluating a vibrotactile braille-reading device. In ACM SIGACCESS, ASSETS '13 (2013).

Digital Library

[31]

Novich, S. D., and Eagleman, D. M. Using space and time to encode vibrotactile information: toward an estimate of the skin's achievable throughput. Experimental Brain Research, 10 (2015).

[32]

Ooka, T., and Fujita, K. Virtual object manipulation system with substitutive display of tangential force and slip by control of vibrotactile phantom sensation. In 2010 IEEE Haptics Symposium (2010).

Digital Library

[33]

Park, J., Kim, J., Oh, Y., and Tan, H. Z. Rendering moving tactile stroke on the palm using a sparse 2d array. In Haptics: Perception, Devices, Control, and Applications:International Conference, EuroHaptics 2016, Springer International Publishing (Cham, 2016).

Digital Library

[34]

Pylatiuk, C., Kargov, A., and Schulz, S. Design and evaluation of a low-cost force feedback system for myoelectric prosthetic hands. JPO: Journal of Prosthetics and Orthotics 18, 2 (2006), 57--61.

[35]

Rahal, L., Cha, J., and Saddik, A. E. Continuous tactile perception for vibrotactile displays. In 2009 IEEE International Workshop on Robotic and Sensors Environments (Nov 2009), 86--91.

[36]

Rosenthal, J., Edwards, N., Villanueva, D., Krishna, S., McDaniel, T., and Panchanathan, S. Design, implementation, and case study of a pragmatic vibrotactile belt. IEEE Transactions on Instrumentation and Measurement 60, 1 (Jan 2011), 114--125.

[37]

Saunders, I., and Vijayakumar, S. The role of feed-forward and feedback processes for closed-loop prosthesis control. Journal of NeuroEngineering and Rehabilitation 8, 1 (2011), 60.

[38]

Schneider, O. S., Israr, A., and MacLean, K. E. Tactile animation by direct manipulation of grid displays. In Proceedings of the Annual ACM Symposium on User Interface Software & Technology, UIST '15 (2015).

Digital Library

[39]

Seo, J., and Choi, S. Initial study for creating linearly moving vibrotactile sensation on mobile device. In 2010 IEEE Haptics Symposium (March 2010), 67--70.

Digital Library

[40]

Shull, P. B., and Damian, D. D. Haptic wearables as sensory replacement, sensory augmentation and trainer - a review. Journal of NeuroEngineering and Rehabilitation 12, 1 (2015), 59.

[41]

Spence, C., and Ho, C. Tactile and multisensory spatial warning signals for drivers. Haptics, IEEE Transactions on 1, 2 (July 2008), 121--129.

Digital Library

[42]

Summers, I. R., Whybrow, J. J., Gratton, D. A., Milnes, P., Brown, B. H., and Stevens, J. C. Tactile information transfer: A comparison of two stimulation sites. The Journal of the Acoustical Society of America 118.

[43]

Tan, H. Z., Gray, R., Young, J., and Traylor, R. A haptic back display for attentional and directional cueing. Journal of Haptics Research 3 (2003).

[44]

Ternes, D., and MacLean, K. E. Designing large sets of haptic icons with rhythm. In EuroHaptics, M. Ferre, Ed. (2008).

Digital Library

[45]

Tsukada, K., and Yasumura, M. ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation. Springer, Berlin, Heidelberg, 2004.

[46]

Ueda, S., Uchida, M., Nozawa, A., and Ide, H. A tactile display used phantom sensation with apparent movement together. Electronics and Communications in Japan, Part II: Electronics (2008).

[47]

Wall, C., and Weinberg, M. S. Balance prostheses for postural control. IEEE Engineering in Medicine and Biology Magazine 22, 2 (2003).

[48]

White, B. W., Saunders, F. A., Scadden, L., Bach-Y-Rita, P., and Collins, C. C. Seeing with the skin. Perception & Psychophysics 7, 1, 23--27.

[49]

Xu, C., Israr, A., Poupyrev, I., Bau, O., and Harrison, C. Tactile display for the visually impaired using teslatouch. In CHI '11 Extended Abstracts on Human Factors in Computing Systems, CHI EA '11 (2011).

Digital Library

[50]

Yang, G. H., Ryu, D., Park, S., and Kang, S. Sensory saltation and phantom sensation for vibrotactile display of spatial and directional information. Presence 21, 2 (Feb 2012), 192--202.

Digital Library

[51]

Yannier, N., Israr, A., Lehman, J. F., and Klatzky, R. L. FeelSleeve: Haptic feedback to enhance early reading. In Proceedings of Annual ACM Conference on Human Factors in Computing Systems, CHI (2015).

Digital Library

Cited By

Tawa SNagano HTazaki YYokokohji Y(2024)Three-Dimensional Position Presentation via Head and Waist Vibrotactile ArraysIEEE Transactions on Haptics10.1109/TOH.2023.332992917:3(319-333)Online publication date: Jul-2024
https://doi.org/10.1109/TOH.2023.3329929
Cunha Monteiro WAugusto Soares de Sousa TGregório Marques Soares ADavi Oliveira de Araújo TGustavo Resque dos Santos CSerique Meiguins B(2024)Encoding Data Through Tactile Vibrations2024 28th International Conference Information Visualisation (IV)10.1109/IV64223.2024.00011(1-6)Online publication date: 22-Jul-2024
https://doi.org/10.1109/IV64223.2024.00011
Müller-Putz GKobler RPereira JLopes-Dias CHehenberger LMondini VMartínez-Cagigal VSrisrisawang NPulferer HBatistić LSburlea A(2022)Feel Your Reach: An EEG-Based Framework to Continuously Detect Goal-Directed Movements and Error Processing to Gate Kinesthetic Feedback Informed Artificial Arm ControlFrontiers in Human Neuroscience10.3389/fnhum.2022.84131216Online publication date: 11-Mar-2022
https://doi.org/10.3389/fnhum.2022.841312
Show More Cited By

Index Terms

Personalising vibrotactile displays through perceptual sensitivity adjustment
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

Vibrotactile patterns using sensitivity prioritisation
ISWC '17: Proceedings of the 2017 ACM International Symposium on Wearable Computers

This paper investigates sensitivity based prioritisation in the construction of tactile patterns. Our evidence is obtained by three studies using a wearable haptic display with vibrotactile motors (tactors). Haptic displays intended to transmit symbols ...
Passive haptic learning for vibrotactile skin reading
ISWC '18: Proceedings of the 2018 ACM International Symposium on Wearable Computers

This paper investigates the effects of using passive haptic learning to train the skill of comprehending text from vibrotactile patterns. The method of transmitting messages, skin-reading, is effective at conveying rich information but its active ...
Investigating Interactions for Text Recognition using a Vibrotactile Wearable Display
IUI '18: Proceedings of the 23rd International Conference on Intelligent User Interfaces

Vibrotactile skin-reading uses wearable vibrotactile displays to convey dynamically generated textual information. Such wearable displays have potential to be used in a broad range of applications. Nevertheless, the reading process is passive, and users ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ISWC '17: Proceedings of the 2017 ACM International Symposium on Wearable Computers

September 2017

276 pages

ISBN:9781450351881

DOI:10.1145/3123021

General Chairs:
Seungyon "Claire" Lee
Google
,
Leila Takayama
UC Santa Cruz
,
Khai Truong
University of Toronto
,
Program Chairs:
Jennifer Healey
Intel Labs
,
Thomas Ploetz
Georgia Tech

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Horizon 2020

Conference

UbiComp '17

Sponsor:

UbiComp '17: The 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 11 - 15, 2017

Hawaii, Maui

Acceptance Rates

Overall Acceptance Rate 38 of 196 submissions, 19%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
952
Total Downloads

Downloads (Last 12 months)149
Downloads (Last 6 weeks)18

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tawa SNagano HTazaki YYokokohji Y(2024)Three-Dimensional Position Presentation via Head and Waist Vibrotactile ArraysIEEE Transactions on Haptics10.1109/TOH.2023.332992917:3(319-333)Online publication date: Jul-2024
https://doi.org/10.1109/TOH.2023.3329929
Cunha Monteiro WAugusto Soares de Sousa TGregório Marques Soares ADavi Oliveira de Araújo TGustavo Resque dos Santos CSerique Meiguins B(2024)Encoding Data Through Tactile Vibrations2024 28th International Conference Information Visualisation (IV)10.1109/IV64223.2024.00011(1-6)Online publication date: 22-Jul-2024
https://doi.org/10.1109/IV64223.2024.00011
Müller-Putz GKobler RPereira JLopes-Dias CHehenberger LMondini VMartínez-Cagigal VSrisrisawang NPulferer HBatistić LSburlea A(2022)Feel Your Reach: An EEG-Based Framework to Continuously Detect Goal-Directed Movements and Error Processing to Gate Kinesthetic Feedback Informed Artificial Arm ControlFrontiers in Human Neuroscience10.3389/fnhum.2022.84131216Online publication date: 11-Mar-2022
https://doi.org/10.3389/fnhum.2022.841312
Luzhnica GKrajnc AVeas E(2022)Exploring Feedback-based Testing Effects for Skin ReadingProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519393(212-217)Online publication date: 13-Mar-2022
https://dl.acm.org/doi/10.1145/3519391.3519393
Hehenberger LBatistic LSburlea AMüller-Putz G(2021)Directional Decoding From EEG in a Center-Out Motor Imagery Task With Visual and Vibrotactile GuidanceFrontiers in Human Neuroscience10.3389/fnhum.2021.68725215Online publication date: 24-Sep-2021
https://doi.org/10.3389/fnhum.2021.687252
Müller-Putz G(2021)Toward Non-invasive BCI-Based Movement DecodingNeuroprosthetics and Brain-Computer Interfaces in Spinal Cord Injury10.1007/978-3-030-68545-4_10(233-249)Online publication date: 27-Apr-2021
https://doi.org/10.1007/978-3-030-68545-4_10
Elsayed HWeigel MMüller FSchmitz MMarky KGünther SRiemann JMühlhäuser M(2020)VibroMapProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34321894:4(1-16)Online publication date: 18-Dec-2020
https://dl.acm.org/doi/10.1145/3432189
Pescara EDreschner FMarky KKunze KBeigl MZhou BCheng JStrohmeier PIshimaru SKosch T(2020)GenVibeProceedings of the Augmented Humans International Conference10.1145/3384657.3384794(1-9)Online publication date: 16-Mar-2020
https://dl.acm.org/doi/10.1145/3384657.3384794
Hehenberger LSburlea AMüller-Putz G(2020)Assessing the impact of vibrotactile kinaesthetic feedback on electroencephalographic signals in a center-out taskJournal of Neural Engineering10.1088/1741-2552/abb06917:5(056032)Online publication date: 14-Oct-2020
https://doi.org/10.1088/1741-2552/abb069
Luzhnica GVeas EFarrahi KHarle RLane N(2019)Boosting word recognition for vibrotactile skin readingProceedings of the 2019 ACM International Symposium on Wearable Computers10.1145/3341163.3347715(135-144)Online publication date: 9-Sep-2019
https://dl.acm.org/doi/10.1145/3341163.3347715
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten