research-article

Smooth as Steel Wool: Effects of Visual Stimuli on the Haptic Perception of Roughness in Virtual Reality

Authors:

Sebastian Günther,

Dominik Schön,

Florian Müller,

Martin Schmitz,

Andrii Matviienko,

Max MühlhäuserAuthors Info & Claims

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Article No.: 399, Pages 1 - 17

https://doi.org/10.1145/3491102.3517454

Published: 29 April 2022 Publication History

Abstract

Haptic Feedback is essential for lifelike Virtual Reality (VR) experiences. To provide a wide range of matching sensations of being touched or stroked, current approaches typically need large numbers of different physical textures. However, even advanced devices can only accommodate a limited number of textures to remain wearable. Therefore, a better understanding is necessary of how expectations elicited by different visualizations affect haptic perception, to achieve a balance between physical constraints and great variety of matching physical textures.

In this work, we conducted an experiment (N=31) assessing how the perception of roughness is affected within VR. We designed a prototype for arm stroking and compared the effects of different visualizations on the perception of physical textures with distinct roughnesses. Additionally, we used the visualizations’ real-world materials, no-haptics and vibrotactile feedback as baselines. As one result, we found that two levels of roughness can be sufficient to convey a realistic illusion.

Supplementary Material

Supplemental Materials (3491102.3517454-supplemental-materials.zip)

Download
429.56 KB

MP4 File (3491102.3517454-video-preview.mp4)

Video Preview

Download
34.84 MB

MP4 File (3491102.3517454-talk-video.mp4)

Talk Video

Download
282.42 MB

MP4 File (3491102.3517454-video-figure.mp4)

Video Figure

Download
84.90 MB

References

[1]

Rochelle Ackerley, Ida Carlsson, Henric Wester, Håkan Olausson, and Helena Backlund Wasling. 2014. Touch perceptions across skin sites: differences between sensitivity, direction discrimination and pleasantness. Frontiers in Behavioral Neuroscience 8, FEB (2014), 1–10. https://doi.org/10.3389/fnbeh.2014.00054

[2]

David Alles. 1970. Information Transmission by Phantom Sensations. IEEE Transactions on Man Machine Systems 11, 1 (mar 1970), 85–91. https://doi.org/10.1109/TMMS.1970.299967

[3]

Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake charmer: Physically enabling virtual objects. TEI 2016 - Proceedings of the 10th Anniversary Conference on Tangible Embedded and Embodied Interaction(2016), 218–226. https://doi.org/10.1145/2839462.2839484

Digital Library

[4]

K M Arafat Aziz, Hu Luo, Lehiany Asma, Weiliang Xu, Yuru Zhang, and Dangxiao Wang. 2020. Haptic Handshank – A Handheld Multimodal Haptic Feedback Controller for Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 239–250. https://doi.org/10.1109/ISMAR50242.2020.00047

[5]

Ahmad Barghout, Jongeun Cha, Abdulmotaleb El Saddik, Julius Kammerl, and Eckehard Steinbach. 2009. Spatial resolution of vibrotactile perception on the human forearm when exploiting funneling illusion. In 2009 IEEE International Workshop on Haptic Audio visual Environments and Games. IEEE, 19–23. https://doi.org/10.1109/HAVE.2009.5356122

[6]

Olivier Bau, Ivan Poupyrev, Ali Israr, and Chris Harrison. 2010. TeslaTouch: electrovibration for touch surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, 283–292. https://doi.org/10.1145/1866029.1866074

Digital Library

[7]

Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouchh: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 717–728. https://doi.org/10.1145/2984511.2984526

Digital Library

[8]

Wouter M. Bergmann Tiest and Astrid M.L. Kappers. 2007. Haptic and visual perception of roughness. Acta Psychologica 124, 2 (2007), 177–189. https://doi.org/10.1016/j.actpsy.2006.03.002

[9]

Aaron Bloomfield and Norman I Badler. 2003. A Low Cost Tactor Suit for Vibrotactile Feedback A Low Cost Tactor Suit for Vibrotactile Feedback. Technical Reports (CIS)January (2003), 7.

[10]

Roger Boldu, Sambhav Jain, Juan Pablo Forero Cortes, Haimo Zhang, and Suranga Nanayakkara. 2019. M-Hair: Extended Reality by Stimulating the Body Hair. In SIGGRAPH Asia 2019 XR. ACM, New York, NY, USA, 27–28. https://doi.org/10.1145/3355355.3361881

Digital Library

[11]

Roger Boldu, Sambhav Jain, Juan Pablo Forero Cortes, Haimo Zhang, and Suranga Nanayakkara. 2019. M-Hair: Creating Novel Tactile Feedback by Augmenting the Body Hair to Respond to Magnetic Field. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 323–328. https://doi.org/10.1145/3332165.3347955

Digital Library

[12]

Matthew Botvinick and Jonathan Cohen. 1998. Rubber hands ‘feel’ touch that eyes see. Nature 391, 6669 (feb 1998), 756–756. https://doi.org/10.1038/35784

[13]

Jas Brooks, Steven Nagels, and Pedro Lopes. 2020. Trigeminal-based Temperature Illusions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376806

Digital Library

[14]

Simona Casini, Matteo Morvidoni, Matteo Bianchi, Manuel Catalano, Giorgio Grioli, and Antonio Bicchi. 2015. Design and realization of the CUFF - clenching upper-limb force feedback wearable device for distributed mechano-tactile stimulation of normal and tangential skin forces. In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, Hamburg, Germany, 1186–1193. https://doi.org/10.1109/IROS.2015.7353520

Digital Library

[15]

C. Elaine Chapman. 1994. Active versus passive touch: factors influencing the transmission of somatosensory signals to primary somatosensory cortex. Canadian Journal of Physiology and Pharmacology 72, 5 (may 1994), 558–570. https://doi.org/10.1139/y94-080

[16]

Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174228

Digital Library

[17]

Heather Culbertson and Katherine J. Kuchenbecker. 2017. Ungrounded Haptic Augmented Reality System for Displaying Roughness and Friction. IEEE/ASME Transactions on Mechatronics 22, 4 (aug 2017), 1839–1849. https://doi.org/10.1109/TMECH.2017.2700467

[18]

Heather Culbertson, Juliette Unwin, and Katherine J. Kuchenbecker. 2014. Modeling and Rendering Realistic Textures from Unconstrained Tool-Surface Interactions. IEEE Transactions on Haptics 7, 3 (jul 2014), 381–393. https://doi.org/10.1109/TOH.2014.2316797

[19]

Donald Degraen, André Zenner, and Antonio Krüger. 2019. Enhancing Texture Perception in Virtual Reality Using 3D-Printed Hair Structures. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300479

Digital Library

[20]

Alexandra Delazio, Ken Nakagaki, Roberta L. Klatzky, Scott E Hudson, Jill Fain Lehman, and Alanson P Sample. 2018. Force Jacket: Pneumatically-Actuated Jacket for Embodied Haptic Experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173894

Digital Library

[21]

Mohamad A. Eid and Hussein Al Osman. 2016. Affective Haptics: Current Research and Future Directions. IEEE Access 4(2016), 26–40. https://doi.org/10.1109/ACCESS.2015.2497316

[22]

Lisa A. Elkin, Matthew Kay, James J. Higgins, and Jacob O. Wobbrock. 2021. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. Vol. 1. Association for Computing Machinery. https://doi.org/10.1145/3472749.3474784 arxiv:2102.11824

Digital Library

[23]

Hesham Elsayed, Mayra Donaji Barrera Machuca, Christian Schaarschmidt, Karola Marky, Florian Müller, Jan Riemann, Andrii Matviienko, Martin Schmitz, Martin Weigel, and Max Mühlhäuser. 2020. VRSketchPen: Unconstrained Haptic Assistance for Sketching in Virtual 3D Environments. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST (2020). https://doi.org/10.1145/3385956.3418953

Digital Library

[24]

Hesham Elsayed, Martin Weigel, Florian Müller, Martin Schmitz, Karola Marky, Sebastian Günther, Jan Riemann, and Max Mühlhäuser. 2020. VibroMap: Understanding the spacing of vibrotactile actuators across the body. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (dec 2020), 1–16. https://doi.org/10.1145/3432189

Digital Library

[25]

Marc O Ernst and Martin S Banks. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 6870 (jan 2002), 429–433. https://doi.org/10.1038/415429a

[26]

Greg K. Essick, Francis McGlone, Chris Dancer, David Fabricant, Yancy Ragin, Nicola Phillips, Therese Jones, and Steve Guest. 2010. Quantitative assessment of pleasant touch. Neuroscience & Biobehavioral Reviews 34, 2 (feb 2010), 192–203. https://doi.org/10.1016/j.neubiorev.2009.02.003

[27]

Anna Fenko, Hendrik N.J. Schifferstein, and Paul Hekkert. 2010. Looking hot or feeling hot: What determines the product experience of warmth?Materials & Design 31, 3 (mar 2010), 1325–1331. https://doi.org/10.1016/j.matdes.2009.09.008

[28]

Lukas Gehrke, Sezen Akman, Pedro Lopes, Albert Chen, Avinash Kumar Singh, Hsiang-ting Chen, Chin-Teng Lin, and Klaus Gramann. 2019. Detecting Visuo-Haptic Mismatches in Virtual Reality using the Prediction Error Negativity of Event-Related Brain Potentials. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–11. https://doi.org/10.1145/3290605.3300657

Digital Library

[29]

James J. Gibson. 1962. Observations on active touch.Psychological Review 69, 6 (1962), 477–491. https://doi.org/10.1037/h0046962

[30]

Steve Guest and Charles Spence. 2003. What role does multisensory integration play in the visuotactile perception of texture?International Journal of Psychophysiology 50, 1-2 (oct 2003), 63–80. https://doi.org/10.1016/S0167-8760(03)00125-9

[31]

Sebastian Günther, Sven Kratz, Daniel Avrahami, and Max Mühlhäuser. 2018. Exploring Audio, Visual, and Tactile Cues for Synchronous Remote Assistance. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference. ACM, New York, NY, USA, 339–344. https://doi.org/10.1145/3197768.3201568

Digital Library

[32]

Sebastian Günther, Mohit Makhija, Florian Müller, Dominik Schön, Max Mühlhäuser, and Markus Funk. 2019. PneumAct: Pneumatic Kinesthetic Actuation of Body Joints in Virtual Reality Environments. In Proceedings of the 2019 on Designing Interactive Systems Conference. ACM, New York, NY, USA, 227–240. https://doi.org/10.1145/3322276.3322302

Digital Library

[33]

Sebastian Günther, Florian Müller, Markus Funk, Jan Kirchner, Niloofar Dezfuli, and Max Mühlhäuser. 2018. TactileGlove: Assistive Spatial Guidance in 3D Space through Vibrotactile Navigation. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference. ACM, New York, NY, USA, 273–280. https://doi.org/10.1145/3197768.3197785

Digital Library

[34]

Sebastian Günther, Florian Müller, Felix Hübner, Max Mühlhäuser, and Andrii Matviienko. 2021. ActuBoard: An Open Rapid Prototyping Platform to integrate Hardware Actuators in Remote Applications. In Companion Proceedings of the 13th ACM SIGCHI Symposium on Engineering Interactive Computing Systems(EICS ’21 Companion). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3459926.3464757

Digital Library

[35]

Sebastian Günther, Florian Müller, Dominik Schön, Omar Elmoghazy, Max Mühlhäuser, and Martin Schmitz. 2020. Therminator: Understanding the Interdependency of Visual and On-Body Thermal Feedback in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376195

Digital Library

[36]

Sebastian Günther, Dominik Schön, Florian Müller, Max Mühlhäuser, and Martin Schmitz. 2020. PneumoVolley: Pressure-based Haptic Feedback on the Head through Pneumatic Actuation. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–10. https://doi.org/10.1145/3334480.3382916

Digital Library

[37]

Aakar Gupta, Antony Albert Raj Irudayaraj, and Ravin Balakrishnan. 2017. HapticClench: Investigating Squeeze Sensations using Memory Alloys. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 109–117. https://doi.org/10.1145/3126594.3126598

Digital Library

[38]

Antal Haans, Wijnand A. IJsselsteijn, and Yvonne A.W. de Kort. 2008. The effect of similarities in skin texture and hand shape on perceived ownership of a fake limb. Body Image 5, 4 (dec 2008), 389–394. https://doi.org/10.1016/j.bodyim.2008.04.003

[39]

Heikki A. Hamalainen, Susan Warren, and Esther P. Gardner. 1985. Differential Sensitivity to Airpuffs on Human Hairy and Glabrous Skin. Somatosensory Research 2, 4 (jan 1985), 281–302. https://doi.org/10.3109/07367228509144569

[40]

Liang He, Cheng Xu, Ding Xu, and Ryan Brill. 2015. PneuHaptic: Delivering Haptic Cues with a Pneumatic Armband. Proceedings of the 2015 ACM International Symposium on Wearable Computers - ISWC ’15 (2015), 47–48. https://doi.org/10.1145/2802083.2802091

Digital Library

[41]

Morton A. Heller. 1982. Visual and tactual texture perception: Intersensory cooperation. Perception & Psychophysics 31, 4 (jul 1982), 339–344. https://doi.org/10.3758/BF03202657

[42]

Matthew J. Hertenstein, Dacher Keltner, Betsy App, Brittany A. Bulleit, and Ariane R. Jaskolka. 2006. Touch communicates distinct emotions.Emotion 6, 3 (2006), 528–533. https://doi.org/10.1037/1528-3542.6.3.528

[43]

Mohamad Hoda, Basim Hafidh, and Abdulmotaleb El Saddik. 2015. Haptic glove for finger rehabilitation. In 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). IEEE, Turin, Italy, 1–6. https://doi.org/10.1109/ICMEW.2015.7169803

[44]

Mark Holliins, Richard Faldowski, Suman Rao, and Forrest Young. 1993. Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis. Perception & Psychophysics 54, 6 (1993), 697–705. https://doi.org/10.3758/BF03211795

[45]

Mark Hollins and S. Ryan Risner. 2000. Evidence for the duplex theory of tactile texture perception. Perception and Psychophysics 62, 4 (2000), 695–705. https://doi.org/10.3758/BF03206916

[46]

Matthias Hoppe, Pascal Knierim, Thomas Kosch, Markus Funk, Lauren Futami, Stefan Schneegass, Niels Henze, Albrecht Schmidt, and Tonja Machulla. 2018. VRHapticDrones: Providing Haptics in Virtual Reality through Quadcopters. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia. ACM, New York, NY, USA, 7–18. https://doi.org/10.1145/3282894.3282898

Digital Library

[47]

Gijs Huisman. 2017. Social Touch Technology: A Survey of Haptic Technology for Social Touch. IEEE Transactions on Haptics 10, 3 (jul 2017), 391–408. https://doi.org/10.1109/TOH.2017.2650221

Digital Library

[48]

G. Huisman, Aduen Darriba Frederiks, B. Van Dijk, D. Hevlen, and B. Krose. 2013. The TaSSt: Tactile sleeve for social touch. In 2013 World Haptics Conference (WHC). IEEE, Daejeon, Korea (South), 211–216. https://doi.org/10.1109/WHC.2013.6548410

[49]

Wijnand A IJsselsteijn, Yvonne A. W de Kort, and Antal Haans. 2006. Is This My Hand I See Before Me? The Rubber Hand Illusion in Reality, Virtual Reality, and Mixed Reality. Presence: Teleoperators and Virtual Environments 15, 4 (aug 2006), 455–464. https://doi.org/10.1162/pres.15.4.455

Digital Library

[50]

Sima Ipakchian Askari, Antal Haans, and Wijnand A. IJsselsteijn. 2019. Is Seeing Believing?: The Effect of Morphological Congruent Visual Feedback on Mediated Touch Experience. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312976

Digital Library

[51]

Sima Ipakchian Askari, Ville Harjunen, Michiel Spape, Antal Haans, Niklas Ravaja, and Wijnand Ijsselsteijn. 2021. Receiving a mediated touch from your partner vs. a male stranger: How visual feedback of touch and its sender influence touch experience. IEEE Transactions on Affective Computing(2021), 1–1. https://doi.org/10.1109/TAFFC.2021.3085185

Digital Library

[52]

Ali Israr and Freddy Abnousi. 2018. Towards Pleasant Touch: Vibrotactile Grids for Social Touch Interactions. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188546

Digital Library

[53]

Ali Israr, Seung-Chan Kim, Jan Stec, and Ivan Poupyrev. 2012. Surround Haptics: Tactile Feedback for Immersive Gaming Experiences. In Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA ’12. ACM Press, New York, New York, USA, 1087. https://doi.org/10.1145/2212776.2212392

Digital Library

[54]

Ali Israr and Ivan Poupyrev. 2011. Tactile brush: drawing on skin with a tactile grid display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2019–2028. https://doi.org/10.1145/1978942.1979235

Digital Library

[55]

Jacob Jacoby and Michael S. Matell. 1971. Three-Point Likert Scales Are Good Enough. Journal of Marketing Research 8, 4 (nov 1971), 495–500. https://doi.org/10.1177/002224377100800414

[56]

Smita Kanjanapas, Cara M. Nunez, Sophia R. Williams, Allison M. Okamura, and Ming Luo. 2019. Design and Analysis of Pneumatic 2-DoF Soft Haptic Devices for Shear Display. IEEE Robotics and Automation Letters 4, 2 (apr 2019), 1365–1371. https://doi.org/10.1109/LRA.2019.2895890

[57]

Lawrence H. Kim and Sean Follmer. 2019. SwarmHaptics: Haptic Display with Swarm Robots. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300918

Digital Library

[58]

Seung-Chan Kim, Chong-Hui Kim, Gi-Hun Yang, Tae-Heon Yang, Byung-Kil Han, Sung-Chul Kang, and Dong-Soo Kwon. 2009. Small and lightweight tactile display(SaLT) and its application. In World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, Salt Lake City, UT, USA, 69–74. https://doi.org/10.1109/WHC.2009.4810820

Digital Library

[59]

Roberta L. Klatzky and Susan J. Lederman. 1999. Tactile roughness perception with a rigid link interposed between skin and surface. Perception & Psychophysics 61, 4 (jan 1999), 591–607. https://doi.org/10.3758/BF03205532

[60]

Pascal Knierim, Thomas Kosch, Valentin Schwind, Markus Funk, Francisco Kiss, Stefan Schneegass, and Niels Henze. 2017. Tactile Drones - Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 433–436. https://doi.org/10.1145/3027063.3050426

Digital Library

[61]

Espen Knoop and Jonathan Rossiter. 2015. The Tickler: A Compliant Wearable Tactile Display for Stroking and Tickling. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 1133–1138. https://doi.org/10.1145/2702613.2732749

Digital Library

[62]

Yukari Konishi, Nobuhisa Hanamitsu, Benjamin Outram, Youichi Kamiyama, Kouta Minamizawa, Ayahiko Sato, and Tetsuya Mizuguchi. 2018. Synesthesia Suit: the full body immersive experience. In Lecture Notes in Electrical Engineering. Vol. 432. 499–503. https://doi.org/10.1007/978-981-10-4157-0_84

[63]

Diana Kornbrot, Paul Penn, Helen Petrie, Stephen Furner, and Andrew Hardwick. 2007. Roughness perception in haptic virtual reality for sighted and blind people. Perception & Psychophysics 69, 4 (may 2007), 502–512. https://doi.org/10.3758/BF03193907

[64]

Susan J. Lederman and Susan G. Abbott. 1981. Texture perception: Studies of intersensory organization using a discrepancy paradigm, and visual versus tactual psychophysics.Journal of Experimental Psychology: Human Perception and Performance 7, 4(1981), 902–915. https://doi.org/10.1037/0096-1523.7.4.902

[65]

Susan J Lederman and Roberta L Klatzky. 2004. Multisensory texture perception.In The handbook of multisensory processes.MIT Press, Cambridge, MA, US, 107–122.

[66]

Susan J. Lederman, Georgie Thorne, and Bill Jones. 1986. Perception of texture by vision and touch: Multidimensionality and intersensory integration.Journal of Experimental Psychology: Human Perception and Performance 12, 2(1986), 169–180. https://doi.org/10.1037//0096-1523.12.2.169

[67]

Chi-Jung Lee, Hsin-Ruey Tsai, and Bing-Yu Chen. 2021. HairTouch: Providing Stiffness, Roughness and Surface Height Differences Using Reconfigurable Brush Hairs on a VR Controller. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3411764.3445285

Digital Library

[68]

Yuhu Liu, Satoshi Nishikawa, Young ah Seong, Ryuma Niiyama, and Yasuo Kuniyoshi. 2021. ThermoCaress: A Wearable Haptic Device with Illusory Moving Thermal Stimulation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3411764.3445777

Digital Library

[69]

Haiko Lüpsen. 2017. The aligned rank transform and discrete variables: A warning. Communications in Statistics - Simulation and Computation 46, 9 (oct 2017), 6923–6936. https://doi.org/10.1080/03610918.2016.1217014

[70]

Thomas H Massie and J K Salisbury. 1994. The PHANToM haptic interface: A device for probing virtual objects. In Proceedings of the ASME Dynamic Systems and Control Division. 295–301.

[71]

F. McGlone, H. Olausson, J. A. Boyle, M. Jones-Gotman, C. Dancer, S. Guest, and G. Essick. 2012. Touching and feeling: Differences in pleasant touch processing between glabrous and hairy skin in humans. European Journal of Neuroscience 35, 11 (2012), 1782–1788. https://doi.org/10.1111/j.1460-9568.2012.08092.x

[72]

Francis McGlone and David Reilly. 2010. The cutaneous sensory system. Neuroscience & Biobehavioral Reviews 34, 2 (feb 2010), 148–159. https://doi.org/10.1016/J.NEUBIOREV.2009.08.004

[73]

Francis McGlone, Johan Wessberg, and Håkan Olausson. 2014. Discriminative and Affective Touch: Sensing and Feeling. Neuron 82, 4 (may 2014), 737–755. https://doi.org/10.1016/j.neuron.2014.05.001

[74]

Abu Saleh Md Mahfujur Rahman and Abdulmotaleb El Saddik. 2011. HKiss: Real world based haptic interaction with virtual 3D avatars. In 2011 IEEE International Conference on Multimedia and Expo. IEEE, Barcelona, Spain, 1–6. https://doi.org/10.1109/ICME.2011.6012223

Digital Library

[75]

Sachith Muthukumarana, Don Samitha Elvitigala, Juan Pablo Forero Cortes, Denys J.C. Matthies, and Suranga Nanayakkara. 2020. Touch me Gently: Recreating the Perception of Touch using a Shape-Memory Alloy Matrix. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376491

Digital Library

[76]

Aditya Shekhar Nittala, Klaus Kruttwig, Jaeyeon Lee, Roland Bennewitz, Eduard Arzt, and Jürgen Steimle. 2019. Like A Second Skin: Understanding How Epidermal Devices Affect Human Tactile Perception. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–16. https://doi.org/10.1145/3290605.3300610

Digital Library

[77]

Cara M. Nunez, Bryce N. Huerta, Allison M. Okamura, and Heather Culbertson. 2020. Investigating Social Haptic Illusions for Tactile Stroking (SHIFTS). In 2020 IEEE Haptics Symposium (HAPTICS). IEEE, Crystal City, VA, USA, 629–636. https://doi.org/10.1109/HAPTICS45997.2020.ras.HAP20.35.f631355d

[78]

Shogo Okamoto, Hikaru Nagano, and Hsin-Ni Ho. 2016. Psychophysical Dimensions of Material Perception and Methods to Specify Textural Space. In Pervasive Haptics. Springer Japan, Tokyo, 3–20. https://doi.org/10.1007/978-4-431-55772-2_1

[79]

Shogo Okamoto, Hikaru Nagano, and Yoji Yamada. 2013. Psychophysical Dimensions of Tactile Perception of Textures. IEEE Transactions on Haptics 6, 1 (2013), 81–93. https://doi.org/10.1109/TOH.2012.32

Digital Library

[80]

Håkan Olausson, Johan Wessberg, India Morrison, Francis McGlone, and Åke Vallbo. 2010. The neurophysiology of unmyelinated tactile afferents. Neuroscience and Biobehavioral Reviews 34, 2 (2010), 185–191. https://doi.org/10.1016/j.neubiorev.2008.09.011

[81]

Claudio Pacchierotti, Stephen Sinclair, Massimiliano Solazzi, Antonio Frisoli, Vincent Hayward, and Domenico Prattichizzo. 2017. Wearable haptic systems for the fingertip and the hand: Taxonomy, review, and perspectives. IEEE Transactions on Haptics 10, 4 (2017), 580–600. https://doi.org/10.1109/TOH.2017.2689006

Digital Library

[82]

Mathias Parger, Dieter Schmalstieg, Joerg H. Mueller, and Markus Steinberger. 2018. Human upper-body inverse kinematics for increased embodiment in consumer-grade virtual reality. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST (2018). https://doi.org/10.1145/3281505.3281529

Digital Library

[83]

Gunhyuk Park and Seungmoon Choi. 2018. Tactile Information Transmission by 2D Stationary Phantom Sensations. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173832

Digital Library

[84]

Young-Woo Park, Chang-Young Lim, and Tek-Jin Nam. 2010. CheekTouch: an affective interaction technique while speaking on the mobile phone. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 3241–3246. https://doi.org/10.1145/1753846.1753965

Digital Library

[85]

Daniel Perez-Marcos, Maria V. Sanchez-Vives, and Mel Slater. 2012. Is my hand connected to my body? The impact of body continuity and arm alignment on the virtual hand illusion. Cognitive Neurodynamics 6, 4 (aug 2012), 295–305. https://doi.org/10.1007/s11571-011-9178-5

[86]

Evan Pezent, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, and Nick Colonnese. 2019. Tasbi: Multisensory Squeeze and Vibrotactile Wrist Haptics for Augmented and Virtual Reality. In 2019 IEEE World Haptics Conference (WHC). IEEE, Tokyo, Japan, 1–6. https://doi.org/10.1109/WHC.2019.8816098

[87]

Henning Pohl, Peter Brandes, Hung Ngo Quang, and Michael Rohs. 2017. Squeezeback: Pneumatic Compression for Notification. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI ’17 (2017), 5318–5330. https://doi.org/10.1145/3025453.3025526

Digital Library

[88]

Simone Schütz-Bosbach, Peggy Tausche, and Carmen Weiss. 2009. Roughness perception during the rubber hand illusion., 136–144 pages. https://doi.org/10.1016/j.bandc.2009.01.006

[89]

Melanie F. Simons, Krishna Manaswi Digumarti, Nguyen Hao Le, Hsing-Yu Chen, Sara Correia Carreira, Nouf S. S. Zaghloul, Richard Suphapol Diteesawat, Martin Garrad, Andrew T. Conn, Christopher Kent, and Jonathan Rossiter. 2021. B:Ionic Glove: A Soft Smart Wearable Sensory Feedback Device for Upper Limb Robotic Prostheses. IEEE Robotics and Automation Letters 6, 2 (apr 2021), 3311–3316. https://doi.org/10.1109/LRA.2021.3064269

[90]

Melanie F. Simons, Alice C. Haynes, Yan Gao, Yihua Zhu, and Jonathan Rossiter. 2020. In Contact: Pinching, Squeezing and Twisting for Mediated Social Touch. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–9. https://doi.org/10.1145/3334480.3382798

Digital Library

[91]

Mel Slater. 2008. Towards a digital body: The virtual arm illusion. Frontiers in Human Neuroscience 2 (2008). https://doi.org/10.3389/neuro.09.006.2008

[92]

Hua Chun Sun, Andrew E. Welchman, Dorita H.F. Chang, and Massimiliano Di Luca. 2016. Look but don’t touch: Visual cues to surface structure drive somatosensory cortex. NeuroImage 128(2016), 353–361. https://doi.org/10.1016/j.neuroimage.2015.12.054

[93]

Ivan Sutherland. 1965. The Ultimate Display. In Proceedings of the IFIP Congress. 506–508. http://citeseer.ist.psu.edu/viewdoc/summary?doi=10.1.1.136.3720

[94]

Shan-Yuan Teng, Pengyu Li, Romain Nith, Joshua Fonseca, and Pedro Lopes. 2021. Touch & Fold: A Foldable Haptic Actuator for Rendering Touch in Mixed Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3411764.3445099

Digital Library

[95]

Jonathan Tong, Oliver Mao, and Daniel Goldreich. 2013. Two-point orientation discrimination versus the traditional two-point test for tactile spatial acuity assessment. Frontiers in Human Neuroscience 7, SEP (2013), 1–11. https://doi.org/10.3389/fnhum.2013.00579

[96]

Chantal Triscoli, Rochelle Ackerley, and Uta Sailer. 2014. Touch satiety: Differential effects of stroking velocity on liking and wanting touch over repetitions. PLoS ONE 9, 11 (2014), 1–8. https://doi.org/10.1371/journal.pone.0113425

[97]

Manos Tsakiris and Patrick Haggard. 2005. The Rubber Hand Illusion Revisited: Visuotactile Integration and Self-Attribution., 80–91 pages. https://doi.org/10.1037/0096-1523.31.1.80

[98]

Dzmitry Tsetserukou. 2010. HaptiHug: A novel haptic display for communication of hug over a distance. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6191 LNCS, PART 1(2010), 340–347. https://doi.org/10.1007/978-3-642-14064-8_49

Digital Library

[99]

Dzmitry Tsetserukou, Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka, and Susumu Tachi. 2010. iFeel_IM: innovative real-time communication system with rich emotional and haptic channels. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems, Vol. 6191 LNCS. ACM, New York, NY, USA, 3031–3036. https://doi.org/10.1145/1753846.1753911

Digital Library

[100]

Chelsea Tymms, Denis Zorin, and Esther P. Gardner. 2018. Tactile perception of the roughness of 3D-printed textures. Journal of Neurophysiology 119, 3 (mar 2018), 862–876. https://doi.org/10.1152/jn.00564.2017

[101]

Takafumi Wakita, Natsumi Ueshima, and Hiroyuki Noguchi. 2012. Psychological Distance Between Categories in the Likert Scale. Educational and Psychological Measurement 72, 4 (aug 2012), 533–546. https://doi.org/10.1177/0013164411431162

[102]

Dangxiao Wang, Kouhei Ohnishi, and Weiliang Xu. 2020. Multimodal haptic display for virtual reality: A survey. IEEE Transactions on Industrial Electronics 67, 1 (2020), 610–623. https://doi.org/10.1109/TIE.2019.2920602

[103]

Jamie Ward, Ajua Mensah, and Kristin Jünemann. 2015. The rubber hand illusion depends on the tactile congruency of the observed and felt touch. Journal of Experimental Psychology: Human Perception and Performance 41, 5(2015), 1203–1208. https://doi.org/10.1037/xhp0000088

[104]

Toshio Watanabe and Shigehisa Fukui. 1995. A method for controlling tactile sensation of surface roughness using ultrasonic vibration. In Proceedings of 1995 IEEE International Conference on Robotics and Automation, Vol. 1. IEEE, 1134–1139. https://doi.org/10.1109/ROBOT.1995.525433

[105]

Chyanna Wee, Kian Meng Yap, and Woan Ning Lim. 2021. Haptic Interfaces for Virtual Reality: Challenges and Research Directions. IEEE Access 9(2021), 112145–112162. https://doi.org/10.1109/ACCESS.2021.3103598

[106]

Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173660

Digital Library

[107]

Graham Wilson, Martin Halvey, Stephen A. Brewster, and Stephen A. Hughes. 2011. Some like it hot: thermal feedback for mobile devices. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11. ACM Press, New York, New York, USA, 2555. https://doi.org/10.1145/1978942.1979316

Digital Library

[108]

Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 365–378. https://doi.org/10.1145/3242587.3242645

Digital Library

[109]

Bob G. Witmer and Michael J. Singer. 1998. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoperators and Virtual Environments 7, 3 (jun 1998), 225–240. https://doi.org/10.1162/105474698565686

Digital Library

[110]

Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11. ACM Press, New York, New York, USA, 143. https://doi.org/10.1145/1978942.1978963

Digital Library

[111]

Hideyoshi Yanagisawa and Kenji Takatsuji. 2015. Effects of visual expectation on perceived tactile perception: An evaluation method of surface texture with expectation effect. International Journal of Design 9, 1 (2015), 39–51.

[112]

Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: Pneumatically Actuated Soft Composite Materials for Shape Changing Interfaces. Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST ’13(2013), 13–22. https://doi.org/10.1145/2501988.2502037

Digital Library

[113]

Svetlana Yarosh, Kenya Mejia, Baris Unver, Xizi Wang, Yuan Yao, Akin Campbell, and Brad Holschuh. 2017. SqueezeBands: Mediated Social Touch Using Shape Memory Alloy Actuation. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (dec 2017), 1–18. https://doi.org/10.1145/3134751

Digital Library

[114]

Yoshimi Sato, Keiji Sato, Michi Sato, Shogo Fukushima, Yu Okano, Kanako Matsuo, Sayaka Ooshima, Yuichiro Kojima, Rika Matsue, Satsuki Nakata, Yuki Hashimoto, and Hiroyuki Kajimoto. 2008. Ants in the Pants -ticklish tactile display using rotating brushes-. In 2008 SICE Annual Conference. IEEE, 10.1109/SICE.2008.4654699, 461–466. https://doi.org/10.1109/SICE.2008.4654699

[115]

Ye Yuan and Anthony Steed. 2010. Is the rubber hand illusion induced by immersive virtual reality?Proceedings - IEEE Virtual Reality(2010), 95–102. https://doi.org/10.1109/VR.2010.5444807

Digital Library

[116]

Andre Zenner and Antonio Krüger. 2019. Estimating detection thresholds for desktop-scale hand redirection in virtual reality. 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings (mar 2019), 47–55. https://doi.org/10.1109/VR.2019.8798143

[117]

Zhuoming Zhang, Robin Héron, Eric Lecolinet, Françoise Detienne, and Stéphane Safin. 2019. VisualTouch: Enhancing Affective Touch Communication with Multi-modality Stimulation. In 2019 International Conference on Multimodal Interaction. ACM, New York, NY, USA, 114–123. https://doi.org/10.1145/3340555.3353733

Digital Library

Cited By

Normand EPacchierotti CMarchand EMarchal M(2024)How Different Is the Perception of Vibrotactile Texture Roughness in Augmented versus Virtual Reality?Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687738(1-10)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687738
Günther SSkogseide ABuhlmann RMühlhäuser M(2024)Assessing the Influence of Visual Cues in Virtual Reality on the Spatial Perception of Physical Thermal StimuliProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642154(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642154
Zhang JHuang MChen YLiao KShi JLiang HYang R(2024)TouchMark: Partial Tactile Feedback Design for Upper Limb Rehabilitation in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345617330:11(7430-7440)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456173
Show More Cited By

Index Terms

Smooth as Steel Wool: Effects of Visual Stimuli on the Haptic Perception of Roughness in Virtual Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction devices
      1. Haptic devices

Recommendations

A Preliminary Study on Full-Body Haptic Stimulation on Modulating Self-motion Perception in Virtual Reality
Augmented Reality, Virtual Reality, and Computer Graphics
Abstract
We introduce a novel experimental system to explore the role of vibrotactile haptic feedback in Virtual Reality (VR) to induce the self-motion illusion. Self-motion (also called vection) has been mostly studied through visual and auditory stimuli ...
Enabling Reusable Haptic Props for Virtual Reality by Hand Displacement
MuC '21: Proceedings of Mensch und Computer 2021

Virtual Reality (VR) enables compelling visual experiences. However, providing haptic feedback is still challenging. Previous work suggests utilizing haptic props to overcome such limitations and presents evidence that props could function as a single ...
How Different Is the Perception of Vibrotactile Texture Roughness in Augmented versus Virtual Reality?
VRST '24: Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology

Wearable haptic devices can modify the haptic perception of an object touched directly by the finger in a portable and unobtrusive way. In this paper, we investigate whether such wearable haptic augmentations are perceived differently in Augmented ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

10459 pages

ISBN:9781450391573

DOI:10.1145/3491102

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA
,
Steven Drucker
Microsoft Research, USA
,
Julie Williamson
University of Glasgow, UK
,
Koji Yatani
University of Tokyo, Japan

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
1,058
Total Downloads

Downloads (Last 12 months)266
Downloads (Last 6 weeks)20

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Normand EPacchierotti CMarchand EMarchal M(2024)How Different Is the Perception of Vibrotactile Texture Roughness in Augmented versus Virtual Reality?Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687738(1-10)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687738
Günther SSkogseide ABuhlmann RMühlhäuser M(2024)Assessing the Influence of Visual Cues in Virtual Reality on the Spatial Perception of Physical Thermal StimuliProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642154(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642154
Zhang JHuang MChen YLiao KShi JLiang HYang R(2024)TouchMark: Partial Tactile Feedback Design for Upper Limb Rehabilitation in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345617330:11(7430-7440)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456173
Johnson TPatel DYang HCivici UFernandes Minori AYao L(2023)FlexTure: Designing Configurable and Dynamic Surface FeaturesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595995(580-593)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595995
Di Stefano NSpence C(2022)Roughness perception: A multisensory/crossmodal perspectiveAttention, Perception, & Psychophysics10.3758/s13414-022-02550-y84:7(2087-2114)Online publication date: 26-Aug-2022
https://doi.org/10.3758/s13414-022-02550-y

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents