abstract

Midair Haptic-Optic Display with Multi-Tactile Texture based on Presenting Vibration and Pressure Sensation by Ultrasound

Authors:

Tao Morisaki,

Masahiro Fujiwara,

Yasutoshi Makino,

Hiroyuki ShinodaAuthors Info & Claims

SA '21: SIGGRAPH Asia 2021 Emerging Technologies

Article No.: 10, Pages 1 - 2

https://doi.org/10.1145/3476122.3484849

Published: 14 December 2021 Publication History

Get Access

Abstract

Reproducing the tactile texture of a real object allows humans to interact in virtual reality space with a high sense of immersion. In this study, we develop a midair haptic-optic display with multi-tactile texture using focused ultrasound. In this system, users can touch aerial 3D images with a realistic texture without wearing any devices. For rendering realistic texture, our system simultaneously presents vibration and static pressure sensation. The presentable sensation of the previous ultrasound system is limited to vibrations. The combination of the sensations can improve the reality of rendered tactile texture by ultrasound. In the demo, we presented three textures with different roughness: cloth, wooden board, and gel.

Supplementary Material

MP4 File (3476122.3484849.mp4)

presentation

Download
134.80 MB

References

[1]

Stanley J Bolanowski Jr, George A Gescheider, Ronald T Verrillo, and Christin M Checkosky. 1988. Four channels mediate the mechanical aspects of touch. The Journal of the Acoustical society of America 84, 5 (1988), 1680–1694.

Crossref

Google Scholar

[2]

Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 505–514.

Digital Library

Google Scholar

[3]

Takayuki Hoshi, Masafumi Takahashi, Takayuki Iwamoto, and Hiroyuki Shinoda. 2010. Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Transactions on Haptics 3, 3 (2010), 155–165.

Digital Library

Google Scholar

[4]

Yasutoshi Makino, Yoshikazu Furuyama, Seki Inoue, and Hiroyuki Shinoda. 2016. HaptoClone (Haptic-Optical Clone) for Mutual Tele-Environment by Real-time 3D Image Transfer with Midair Force Feedback. In CHI. 1980–1990.

Google Scholar

[5]

Yasuaki Monnai, Keisuke Hasegawa, Masahiro Fujiwara, Kazuma Yoshino, Seki Inoue, and Hiroyuki Shinoda. 2014. HaptoMime: mid-air haptic interaction with a floating virtual screen. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 663–667.

Digital Library

Google Scholar

[6]

Tao Morisaki, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda. 2020. Midair pressure sensation using high-resolution Lateral Modulation stimulus by focused ultrasound. In 26th Workshop in Haptics. Special Interest Group for Haptics (in Japanese).

Google Scholar

[7]

Emiri Sakiyama, Atsushi Matsubayashi, Daichi Matsumoto, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda. 2020. Midair Tactile Reproduction of Real Objects. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 425–433.

Google Scholar

[8]

Ryoko Takahashi, Keisuke Hasegawa, and Hiroyuki Shinoda. 2019. Tactile stimulation by repetitive lateral movement of midair ultrasound focus. IEEE transactions on haptics 13, 2 (2019), 334–342.

Digital Library

Google Scholar

Cited By

View all

Villa SWeiss YHirsch NWiethoff A(2024)An Examination of Ultrasound Mid-air Haptics for Enhanced Material and Temperature Perception in Virtual EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/36764888:MHCI(1-21)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676488
Xue JMontano Murillo RDawes CFrier WCornelio PObrist M(2024)FabSound: Audio-Tactile and Affective Fabric Experiences Through Mid-air HapticsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642533(1-17)Online publication date: 11-May-2024
https://doi.org/10.1145/3613904.3642533
Morisaki TFujiwara MMakino YShinoda H(2024)Noncontact Haptic Rendering of Static Contact With Convex Surface Using Circular Movement of Ultrasound Focus on a Finger PadIEEE Transactions on Haptics10.1109/TOH.2023.333823017:3(334-345)Online publication date: Jul-2024
https://doi.org/10.1109/TOH.2023.3338230
Show More Cited By

Recommendations

Touchable Cooled Graphics: Midair 3D Image with Noncontact Cooling Feedback using Ultrasound-Driven Mist Vaporization
SA '22: SIGGRAPH Asia 2022 Emerging Technologies

Adding tactile feedback to a midair image realizes immersive mixed reality contents. In this study, we develop a midair 3D image with a noncontact cooling sensation using ultrasound. In this system, users can feel a cooling sensation when touching the ...
Analysis of a new haptic display coupling tactile and kinesthetic feedback to render texture and shape
EuroHaptics'10: Proceedings of the 2010 international conference on Haptics - generating and perceiving tangible sensations: Part II

In the domain of haptics, the sensation of touch is normally classed into two types: tactile and kinesthetic. Correspondingly, the haptic display can also be divided into two categories: tactile display and kinesthetic display. The two aspects are ...
Pinching Tactile Display: A Cloth that Changes Tactile Sensation by Electrostatic Adsorption
AVI '24: Proceedings of the 2024 International Conference on Advanced Visual Interfaces

Haptic displays play an important role in enhancing the sense of presence in VR and telepresence. Displaying the tactile properties of fabrics has potential in the fashion industry, but there are difficulties in dynamically displaying different types of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SA '21: SIGGRAPH Asia 2021 Emerging Technologies

December 2021

39 pages

ISBN:9781450386852

DOI:10.1145/3476122

Editors:
Shuzo John Shiota
CEO, Polygon Pictures Inc., Japan
,
Ayumi Kimura
Research Manager at OLM Digital, Inc., Japan and Program Manager and Collaboration Coordinator at CMIC, Victoria University of Wellington, New Zealand
,
Kouta Minamizawa
Professor, Keio University Graduate School of Media Design, Japan

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 December 2021

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Funding Sources

JST CREST
the JSPS Grant-in-Aid for Scientific Research

Conference

SA '21

Sponsor:

SIGGRAPH

SA '21: SIGGRAPH Asia 2021

December 14 - 17, 2021

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
372
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)7

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Villa SWeiss YHirsch NWiethoff A(2024)An Examination of Ultrasound Mid-air Haptics for Enhanced Material and Temperature Perception in Virtual EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/36764888:MHCI(1-21)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676488
Xue JMontano Murillo RDawes CFrier WCornelio PObrist M(2024)FabSound: Audio-Tactile and Affective Fabric Experiences Through Mid-air HapticsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642533(1-17)Online publication date: 11-May-2024
https://doi.org/10.1145/3613904.3642533
Morisaki TFujiwara MMakino YShinoda H(2024)Noncontact Haptic Rendering of Static Contact With Convex Surface Using Circular Movement of Ultrasound Focus on a Finger PadIEEE Transactions on Haptics10.1109/TOH.2023.333823017:3(334-345)Online publication date: Jul-2024
https://doi.org/10.1109/TOH.2023.3338230
Montano-Murillo RPittera DFrier WGeorgiou OObrist MCornelio P(2024)It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor BehaviourIEEE Transactions on Haptics10.1109/TOH.2023.332049217:2(237-248)Online publication date: Apr-2024
https://doi.org/10.1109/TOH.2023.3320492
Matsubayashi AShiku KMakino YShinoda H(2023)Focusing Reflected Ultrasound Using Boundary Element Model for Mid-Air Tactile PresentationIEEE Transactions on Haptics10.1109/TOH.2023.328445216:4(695-701)Online publication date: 9-Jun-2023
https://dl.acm.org/doi/10.1109/TOH.2023.3284452
Wojna KGeorgiou OBeattie DWright MLutteroth C(2023)Does It Par-?: Investigating the Relationship Between Mid-Air Haptics and Visual Representations of Surface TexturesIEEE Transactions on Haptics10.1109/TOH.2023.327295116:4(561-566)Online publication date: 4-May-2023
https://dl.acm.org/doi/10.1109/TOH.2023.3272951

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

Supplementary Material

References

Cited By

Recommendations

Touchable Cooled Graphics: Midair 3D Image with Noncontact Cooling Feedback using Ultrasound-Driven Mist Vaporization

Analysis of a new haptic display coupling tactile and kinesthetic feedback to render texture and shape

Pinching Tactile Display: A Cloth that Changes Tactile Sensation by Electrostatic Adsorption

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations