Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3573381.3597226acmconferencesArticle/Chapter ViewAbstractPublication PagesimxConference Proceedingsconference-collections
demonstration

Sensorial Immersive Experiences using MPEG Haptic and Scene Description Standards

Published: 29 August 2023 Publication History

Abstract

This paper presents a demonstration showcasing the capabilities of the upcoming MPEG-I standards on Haptics and Scene Description. The demonstration is a sensorial immersive experience using a virtual reality headset, haptic-enabled controllers and a haptic vest. The proposed experience is an interactive go-kart race-like game where interactions with the environment will trigger spatialized haptic feedback to provide an enhanced sense of immersion. By implementing the MPEG-I standards on Haptics and Scene Description, and by designing this demonstration using exclusively these standards, this work showcases part of the research and standardization efforts produced through the MPEG ecosystem.

Supplementary Material

MP4 File (IMX_DEMO_VIDEO.mp4)
This paper presents a demonstration showcasing the capabilities of the upcoming MPEG-I standards on Haptics and Scene Description. The demonstration is a sensorial immersive experience using a virtual reality headset, haptic-enabled controllers and a haptic vest. The proposed experience is an interactive go-kart race-like game where interactions with the environment will trigger spatialized haptic feedback to provide an enhanced sense of immersion. By implementing the MPEG-I standards on Haptics and Scene Description, and by designing this demonstration using exclusively these standards, this work showcases part of the research and standardization efforts produced through the MPEG ecosystem.

References

[1]
Actronika. 2022. Skinetic par Actronika. Actronika. https://fr.skinetic.actronika.com/
[2]
Adilzhan Adilkhanov, Matteo Rubagotti, and Zhanat Kappassov. 2022. Haptic Devices: Wearability-Based Taxonomy and Literature Review. IEEE Access 10 (2022), 91923–91947. https://doi.org/10.1109/ACCESS.2022.3202986
[3]
Daniel K.Y. Chen, Jean-Baptiste Chossat, and Peter B. Shull. 2019. HaptiVec: Presenting Haptic Feedback Vectors in Handheld Controllers Using Embedded Tactile Pin Arrays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3290605.3300401
[4]
Chien-Hsing Chou, Yu-Sheng Su, Che-Ju Hsu, Kong-Chang Lee, and Ping-Hsuan Han. 2020. Design of Desktop Audiovisual Entertainment System with Deep Learning and Haptic Sensations. Symmetry 12, 10 (2020). https://doi.org/10.3390/sym12101718
[5]
Fabien Danieau, Julien Fleureau, Philippe Guillotel, Nicolas Mollet, Marc Christie, and Anatole Lécuyer. 2013. HapSeat: a novel approach to simulate motion in audiovisual experiences. ACM SIGGRAPH Emerging Technologies. https://hal.inria.fr/hal-00918318
[6]
Fabien Danieau, Philippe Guillotel, Olivier Dumas, Thomas Lopez, Bertrand Leroy, and Nicolas Mollet. 2018. HFX Studio: Haptic Editor for Full-Body Immersive Experiences. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (Tokyo, Japan) (VRST ’18). Association for Computing Machinery, New York, NY, USA, Article 37, 9 pages. https://doi.org/10.1145/3281505.3281518
[7]
Fabien Danieau, Anatole Lécuyer, Philippe Guillotel, Julien Fleureau, Nicolas Mollet, and Marc Christie. 2013. Enhancing Audiovisual Experience with Haptic Feedback: A Survey on HAV. IEEE Transactions on Haptics 6 (2013), 193–205.
[8]
Abrar Gani, Oliver Pickering, Caroline Ellis, Omar Sabri, and Philip Pucher. 2022. Impact of haptic feedback on surgical training outcomes: A Randomised Controlled Trial of haptic versus non-haptic immersive virtual reality training. Annals of Medicine and Surgery 83 (2022), 104734. https://doi.org/10.1016/j.amsu.2022.104734
[9]
ISO/IEC. 2022. ISO/IEC 12113:2022 Information technology — Runtime 3D asset delivery format — Khronos glTF™ 2.0. Standard ISO/IEC 12113:2022. International Organization for Standardization.
[10]
ISO/IEC JTC1/SC 29. 2021. Call for Proposals for the Coded Representation of Haptics - Phase 1. Output Document ISO/IEC JTC 1/SC 29/WG 02 N00070. International Organization for Standardization. https://www.mpeg.org/wp-content/uploads/mpeg_meetings/134_OnLine/w20227.zip
[11]
ISO/IEC JTC1/SC 29. 2021. Encoder Input Format for MPEG Haptics. Output Document ISO/IEC JTC 1/SC 29/WG 02 N00072. International Organization for Standardization. https://www.mpeg.org/wp-content/uploads/mpeg_meetings/134_OnLine/w20229.zip
[12]
ISO/IEC JTC1/SC 29. 2021. Information technology — Coded representation of immersive media — Part 5: Visual volumetric video-based coding (V3C) and video-based point cloud compression (V-PCC). Specification ISO/IEC 23090-5:2021. International Organization for Standardization.
[13]
ISO/IEC JTC1/SC 29. 2021. MPEG CE Methodology for Haptics. Output Document ISO/IEC JTC 1/SC 29/WG 02 N0073. International Organization for Standardization. https://www.mpeg.org/wp-content/uploads/mpeg_meetings/134_OnLine/w20230.zip
[14]
ISO/IEC JTC1/SC 29. 2021. Submissions and Evaluation Procedures for Haptics CfP – Phase 1. Output Document ISO/IEC JTC 1/SC 29/WG 02 N00071. International Organization for Standardization. https://www.mpeg.org/wp-content/uploads/mpeg_meetings/134_OnLine/w20228.zip
[15]
ISO/IEC JTC1/SC 29. 2022. Text of ISO/IEC CD 23090-31 Haptics Coding. Standard ISO/IEC JTC 1/SC 29/WG 07 N00449. International Organization for Standardization.
[16]
ISO/IEC JTC1/SC 29. 2023. Information technology — Coded representation of immersive media — Part 12: MPEG Immersive video. Specification ISO/IEC FDIS 23090-12. International Organization for Standardization.
[17]
Mohamed Khamis, Nora Schuster, Ceenu George, and Max Pfeiffer. 2019. ElectroCutscenes: Realistic Haptic Feedback in Cutscenes of Virtual Reality Games Using Electric Muscle Stimulation. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST ’19). Association for Computing Machinery, New York, NY, USA, Article 13, 10 pages. https://doi.org/10.1145/3359996.3364250
[18]
Sihui Li, Raagini Rameshwar, Ann Marie Votta, and Cagdas D. Onal. 2019. Intuitive Control of a Robotic Arm and Hand System With Pneumatic Haptic Feedback. IEEE Robotics and Automation Letters 4, 4 (2019), 4424–4430. https://doi.org/10.1109/LRA.2019.2937483
[19]
Shi-Hong Liu, Neng-Hao Yu, Liwei Chan, Yi-Hao Peng, Wei-Zen Sun, and Mike Y. Chen. 2019. PhantomLegs: Reducing Virtual Reality Sickness Using Head-Worn Haptic Devices. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, 817–826. https://doi.org/10.1109/VR.2019.8798158
[20]
Evelien M. Overtoom, Tim Horeman, Frank-Willem Jansen, Jenny Dankelman, and Henk W. R. Schreuder. 2019. Haptic Feedback, Force Feedback, and Force-Sensing in Simulation Training for Laparoscopy: A Systematic Overview. Journal of Surgical Education 76, 1 (2019), 242–261. https://doi.org/10.1016/j.jsurg.2018.06.008
[21]
Sabrina Panëels, Margarita Anastassova, and Lucie Brunet. 2013. TactiPEd: Easy Prototyping of Tactile Patterns. In Human-Computer Interaction – INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 228–245.
[22]
Kyung Rok Pyun, John A. Rogers, and Seung Hwan Ko. 2022. Materials and devices for immersive virtual reality. Nature Reviews Materials 7, 11 (2022), 841–843. https://doi.org/10.1038/s41578-022-00501-5 Number: 11 Publisher: Nature Publishing Group.
[23]
Jonghyun Ryu and Seungmoon Choi. 2008. posVibEditor: Graphical authoring tool of vibrotactile patterns. In 2008 IEEE International Workshop on Haptic Audio visual Environments and Games. IEEE, Ottawa, ON, Canada, 120–125. https://doi.org/10.1109/HAVE.2008.4685310
[24]
Oliver S. Schneider and Karon E. MacLean. 2016. Studying design process and example use with Macaron, a web-based vibrotactile effect editor. In 2016 IEEE Haptics Symposium (HAPTICS). IEEE, Philadelphia, PA, USA, 52–58. https://doi.org/10.1109/HAPTICS.2016.7463155
[25]
Teslasuit. 2022. Teslasuit | Meet our Haptic VR Suit and Glove with Force Feedback. Teslasuit. https://teslasuit.io/
[26]
Luca Turchet, Travis West, and Marcelo M. Wanderley. 2021. Touching the audience: musical haptic wearables for augmented and participatory live music performances. Personal and Ubiquitous Computing 25, 4 (2021), 749–769. https://doi.org/10.1007/s00779-020-01395-2

Index Terms

  1. Sensorial Immersive Experiences using MPEG Haptic and Scene Description Standards

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IMX '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences
    June 2023
    465 pages
    ISBN:9798400700286
    DOI:10.1145/3573381
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 August 2023

    Check for updates

    Author Tags

    1. Haptic
    2. MPEG
    3. Standard
    4. Virtual Reality

    Qualifiers

    • Demonstration
    • Research
    • Refereed limited

    Conference

    IMX '23

    Acceptance Rates

    Overall Acceptance Rate 69 of 245 submissions, 28%

    Upcoming Conference

    IMX '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 77
      Total Downloads
    • Downloads (Last 12 months)56
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 17 Nov 2024

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media