research-article

Haptobend: shape-changing passive haptic feedback in virtual reality

Authors:

John C. McClelland,

Robert J. Teather,

Audrey GirouardAuthors Info & Claims

SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

Pages 82 - 90

https://doi.org/10.1145/3131277.3132179

Published: 16 October 2017 Publication History

Abstract

We present HaptoBend, a novel shape-changing input device providing passive haptic feedback (PHF) for a wide spectrum of objects in virtual reality (VR). Past research in VR shows that PHF increases presence and improves user task performance. However, providing PHF for multiple objects usually requires complex, immobile systems, or multiple props. HaptoBend addresses this problem by allowing users to bend the device into 2D plane-like shapes and multi-surface 3D shapes. We believe HaptoBend's physical approximations of virtual objects can provide realistic haptic feedback through research demonstrating the dominance of human vision over other senses in VR. To test the effectiveness of HaptoBend in matching 2D planar and 3D multi-surface shapes, we conducted an experiment modeled after gesture elicitation studies with 20 participants. High goodness and ease scores show shape-changing passive haptic devices, like HaptoBend, are an effective approach to generalized haptics. Further analysis supports the use of physical approximations for realistic haptic feedback.

Supplementary Material

MP4 File (p82-mcclelland.mp4)

Download
30.24 MB

References

[1]

Aguerreche, L., Duval, T. and Lécuyer, A. 2010. Reconfigurable tangible devices for 3D virtual object manipulation by single or multiple users. Proceedings of the ACM Symposium on Virtual Reality Software and Technology (2010), 227--230.

[2]

Ahmaniemi, T.T., Kildal, J. and Haveri, M. 2014. What is a device bend gesture really good for? Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '14 (New York, NY, USA, 2014), 3503--3512.

Digital Library

[3]

Azmandian, M., Hancock, M., Benko, H., Ofek, E. and Wilson, A.D. 2016. Haptic retargeting: dynamic repurposing of passive haptics for enhanced virtual reality experiences. Proceedings of the ACM Conference on Human Factors in Computing Systems. CHI '16 (2016), 1968--1979.

[4]

Besançon, L., Issartel, P., Ammi, M. and Isenberg, T. 2017. Mouse, tactile, and tangible input for 3D manipulation. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '17 (2017), 4727--4740.

[5]

Bouzit, M., Burdea, G., Popescu, G. and Boian, R. 2002. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on mechatronics. 7, 2 (2002), 256--263.

[6]

Brooks, F.P. 1999. What's real about virtual reality? IEEE Computer graphics and applications. 19, 6 (1999), 16--27.

Digital Library

[7]

Brooks Jr, F.P., Ouh-Young, M., Batter, J.J. and Jerome Kilpatrick, P. 1990. Project GROPEHaptic displays for scientific visualization. ACM SIGGraph computer graphics (1990), 177--185.

Digital Library

[8]

Buchanan, S., Floyd, B., Holderness, W. and LaViola, J.J. 2013. Towards user-defined multi-touch gestures for 3D objects. Proceedings of the ACM International Conference on Interactive tabletops and surfaces (2013), 231--240.

Digital Library

[9]

Carlin, A.S., Hoffman, H.G. and Weghorst, S. 1997. Virtual reality and tactile augmentation in the treatment of spider phobia: a case report. Behaviour research and therapy. 35, 2 (1997), 153--158.

[10]

Carter, T., Seah, S.A., Long, B., Drinkwater, B. and Subramanian, S. 2013. UltraHaptics: Multi-point mid-air haptic feedback for touch surfaces. Proceedings of the ACM symposium on User interface software and technology, UIST '13 (2013), 505--514.

Digital Library

[11]

Choi, I., Hawkes, E.W., Christensen, D.L., Ploch, C.J. and Follmer, S. 2016. Wolverine: A wearable haptic interface for grasping in virtual reality. IEEE/RSJ International Conference on Intelligent Robots and Systems (2016), 986--993.

[12]

Dominjon, L., Lécuyer, A., Burkhardt, J.-M., Richard, P. and Richir, S. 2005. Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments. Proceedings of IEEE Virtual Reality (2005), 19--25.

[13]

Garcia-Palacios, A., Hoffman, H., Carlin, A., Furness, T.A. u and Botella, C. 2002. Virtual reality in the treatment of spider phobia: a controlled study. Behaviour research and therapy. 40, 9 (2002), 983--993.

[14]

Gomes, A. and Vertegaal, R. 2015. PaperFold: evaluating shape changes for viewport transformations in foldable thin-film display devices. Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction, TEI '15 (2015), 153--160.

Digital Library

[15]

Hermanis, A., Cacurs, R. and Greitans, M. 2016. Acceleration and magnetic sensor network for shape sensing. IEEE Sensors Journal. 16, 5 (2016), 1271--1280.

[16]

Hinckley, K., Pausch, R., Goble, J.C. and Kassell, N.F. 1994. Passive real-world interface props for neurosurgical visualization. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '94 (1994), 452--458.

Digital Library

[17]

Hoffman, H.G. 1998. Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. Proceedings of IEEE VRAIS (1998), 59--63.

[18]

Insko, B.E. 2001. Passive haptics significantly enhances virtual environments. University of North Carolina at Chapel Hill.

[19]

Jackson, B., Lau, T.Y., Schroeder, D., Toussaint, K.C. and Keefe, D.F. 2013. A lightweight tangible 3D interface for interactive visualization of thin fiber structures. IEEE transactions on visualization and computer graphics. 19, 12 (2013), 2802--2809.

Digital Library

[20]

Joyce, R.D. and Robinson, S. 2017. Passive haptics to enhance virtual reality simulations. AIAA Modeling and Simulation Technologies Conference (2017), 1313.

[21]

Katsumoto, Y., Tokuhisa, S. and Inakage, M. 2013. Ninja track: Design of electronic toy variable in shape and flexibility. Proceedings of the International Conference on Tangible, Embedded and Embodied Interaction, TEI '13 (New York, NY, USA, 2013), 17--24.

Digital Library

[22]

Kwon, E., Kim, G.J. and Lee, S. 2009. Effects of sizes and shapes of props in tangible augmented reality. Proceedings of IEEE ISMAR (2009), 201--202.

[23]

Lahey, B., Girouard, A., Burleson, W. and Vertegaal, R. 2011. PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '11 (2011), 1303--1312.

[24]

Lee, M. 2010. Multimodal speech-gesture interaction with 3D objects in augmented reality environments. University of Canterbury. Department of Computer Science and Software Engineering.

[25]

Lee, S.-S., Kim, S., Jin, B., Choi, E., Kim, B., Jia, X., Kim, D. and Lee, K. 2010. How users manipulate deformable displays as input devices. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '10 (2010), 1647--1656.

[26]

Lindeman, R.W., Sibert, J.L. and Hahn, J.K. 1999. Hand-held windows: towards effective 2D interaction in immersive virtual environments. Proceedings of IEEE Virtual Reality (1999), 205--212.

[27]

Lindlbauer, D., Grønbæk, J.E., Birk, M., Halskov, K., Alexa, M. and Müller, J. 2016. Combining shape-changing interfaces and spatial augmented reality enables extended object appearance. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '16 (2016), 791--802.

[28]

Massie, T.H. and Salisbury, J.K. 1994. The phantom haptic interface: a device for probing virtual objects. Proceedings of the ASME (1994), 295--300.

[29]

Nakagaki, K., Follmer, S. and Ishii, H. 2015. LineFORM: actuated curve interfaces for display, interaction, and constraint. Proceedings of the ACM Symposium on User Interface Software & Technology, UIST '15 (2015), 333--339.

Digital Library

[30]

Ortega, F.R., Galvan, A., Tarre, K., Barreto, A., Rishe, N., Bernal, J., Balcazar, R. and Thomas, J.-L. 2017. Gesture elicitation for 3D travel via multi-touch and mid-air systems for procedurally generated pseudo-universe. IEEE Symposium on 3D User Interfaces (3DUI) (2017), 144--153.

[31]

Perry, J.C., Rosen, J. and Burns, S. 2007. Upper-limb powered exoskeleton design. IEEE/ASME transactions on mechatronics. 12, 4 (2007), 408--417.

[32]

Piumsomboon, T., Clark, A., Billinghurst, M. and Cockburn, A. 2013. User-defined gestures for augmented reality. Extended Abstracts on Human Factors in Computing Systems, CHI-EA '13 (2013), 955--960.

Digital Library

[33]

Ramakers, R., Schöning, J. and Luyten, K. 2014. Paddle: highly deformable mobile devices with physical controls. Proceedings of the ACM conference on Human factors in computing systems, CHI '14 (2014), 2569--2578.

[34]

Rendl, C., Kim, D., Fanello, S., Parzer, P., Rhemann, C., Taylor, J., Zirkl, M., Scheipl, G., Rothländer, T., Haller, M. and others 2014. FlexSense: a transparent self-sensing deformable surface. Proceedings of the ACM symposium on User interface software and technology, UIST '14 (2014), 129--138.

[35]

Sato, M. 2002. Development of string-based force display: SPIDAR. VSMM (2002).

[36]

Simeone, A.L., Velloso, E. and Gellersen, H. 2015. Substitutional reality: Using the physical environment to design virtual reality experiences. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '15 (2015), 3307--3316.

[37]

Slater, M. 2009. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences. 364, 1535 (2009), 3549--3557.

[38]

Stoakley, R., Conway, M.J. and Pausch, R. 1995. Virtual reality on a WIM: interactive worlds in miniature. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '95 (1995), 265--272.

Digital Library

[39]

Subramanian, S., Seah, S.A., Shinoda, H., Hoggan, E. and Corenthy, L. 2016. Mid-air haptics and displays: systems for un-instrumented mid-air interactions. Extended Abstracts on Human Factors in Computing Systems, CHI-EA '16 (2016), 3446--3452.

Digital Library

[40]

Teather, R.J., Natapov, D. and Jenkin, M. 2010. Evaluating haptic feedback in virtual environments using ISO 9241-9. IEEE Virtual Reality. (2010), 307--308.

[41]

Vatavu, R.-D. and Wobbrock, J.O. 2015. Formalizing agreement analysis for elicitation studies. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '15. (2015), 1325--1334.

[42]

Wagner, J., Huot, S. and Mackay, W. 2012. BiTouch and BiPad: designing bimanual interaction for hand-held tablets. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '12 (2012), 2317--2326.

[43]

Wobbrock, J.O., Aung, H.H., Rothrock, B. and Myers, B.A. 2005. Maximizing the guessability of symbolic input. Extended Abstracts on Human Factors in Computing Systems, CHI-EA '05 (2005), 1869--1872.

Digital Library

[44]

Wobbrock, J.O., Morris, M.R. and Wilson, A.D. 2009. User-defined gestures for surface computing. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '05 (New York, NY, USA, 2009), 1083--1092.

Digital Library

[45]

Zenner, A. 2016. Investigating Weight Distribution in Virtual Reality Proxy Interaction. Saarland University & DFKI, Germany.

[46]

Zenner, A. and Kruger, A. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy. IEEE Transactions on Visualization and Computer Graphics. (2017), 1285--1294.

Digital Library

Cited By

Razevicius GRoudaut AKarnik A(2024)HoberUI: An Exploration of Kinematic Structures as Interactive Input DevicesMultimodal Technologies and Interaction10.3390/mti80200138:2(13)Online publication date: 13-Feb-2024
https://doi.org/10.3390/mti8020013
Baek MKim S(2024)Demonstration of Haptic Devices with Variable Volume Using Spiral Spring StructuresAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686752(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686752
Ying WHeo S(2024)Enhancing VR Sketching with a Dynamic Shape DisplayProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687714(1-11)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687714
Show More Cited By

Index Terms

Haptobend: shape-changing passive haptic feedback in virtual reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Haptic feedback with HaptoBend: utilizing shape-change to enhance virtual reality
SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

HaptoBend¹ is an original device for providing general passive haptic feedback (PHF) in virtual reality (VR). The importance of haptic feedback in VR is apparent through improvements in presence [3] and user performance [2]. However, most general haptic ...
SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology

We present SoEs (Sword of Elements), an attachable augmented haptic device for enhancing gaming controller in the immersive first-person game. Generally, Player can easily receive visual and auditory feedback through head-mounted displays (HMD) and ...
Wearable head-mounted 3D tactile display application scenarios
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Current generation virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) usually include no or only a single vibration motor for haptic feedback and do not use it for guidance. In a previous work, we presented HapticHead, a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

October 2017

167 pages

ISBN:9781450354868

DOI:10.1145/3131277

General Chair:
Adalberto L. Simeone
KU Leuven, Belgium
,
Program Chairs:
Kyle Johnsen
University of Georgia
,
Rob Teather
Carleton University, Canada
,
Christian Sandor
Nara Institute of Science and Technology (NAIST), Japan

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Sciences and Engineering Research Council of Canada (NSERC)

Conference

SUI '17

Sponsor:

SIGCHI

SUI '17: Symposium on Spatial User Interaction

October 16 - 17, 2017

Brighton, United Kingdom

Acceptance Rates

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
1,013
Total Downloads

Downloads (Last 12 months)102
Downloads (Last 6 weeks)11

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Razevicius GRoudaut AKarnik A(2024)HoberUI: An Exploration of Kinematic Structures as Interactive Input DevicesMultimodal Technologies and Interaction10.3390/mti80200138:2(13)Online publication date: 13-Feb-2024
https://doi.org/10.3390/mti8020013
Baek MKim S(2024)Demonstration of Haptic Devices with Variable Volume Using Spiral Spring StructuresAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686752(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686752
Ying WHeo S(2024)Enhancing VR Sketching with a Dynamic Shape DisplayProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687714(1-11)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687714
Ying WRahman AHeo S(2024)Demonstrating VRScroll: A Shape-Changing Device for Precise Sketching in Virtual RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648662(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3648662
Simeone A(2024)Substitutional RealityEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_254(1778-1781)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_254
Topliss JLukosch SCoutts EPiumsomboon T(2023)Manipulating Underfoot Tactile Perceptions of Flooring Materials in Augmented VirtualityApplied Sciences10.3390/app13241310613:24(13106)Online publication date: 8-Dec-2023
https://doi.org/10.3390/app132413106
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Greenslade MClark ALukosch S(2023)Using Everyday Objects as Props for Virtual Objects in First Person Augmented Reality Games: An Elicitation StudyProceedings of the ACM on Human-Computer Interaction10.1145/36110527:CHI PLAY(856-875)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611052
Feick MBiyikli CGani KWittig ATang AKrüger A(2023)VoxelHap: A Toolkit for Constructing Proxies Providing Tactile and Kinesthetic Haptic Feedback in Virtual RealityProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606722(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606722
Ying WHeo S(2023)VRScroll: A Shape-Changing Device for Precise Sketching in Virtual Reality2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00250(815-816)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00250
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents