Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3681756.3697943acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
poster

Signal2Hand: Sensor Modality Translation from Body-Worn Sensor Signals to Hand-Depth Images

Published: 02 December 2024 Publication History

Abstract

We present Signal2Hand, a method that reconstructs hand-depth images from body-worn sensor signals. To do this, we trained VQ-VAE using a pair of body-worn sensor signals and a hand-depth image. We conducted a preliminary study of the method and evaluated the reconstruction results using four evaluation metrics.

Supplemental Material

MP4 File
Supplementary Video

References

[1]
Takashi Amesaka, Hiroki Watanabe, Masanori Sugimoto, and Buntarou Shizuki. 2022. Gesture Recognition Method Using Acoustic Sensing on Usual Garment. ACM Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 6, 2 (2022).
[2]
Shangchen Han, Beibei Liu, Randi Cabezas, Christopher D. Twigg, Peizhao Zhang, Jeff Petkau, Tsz-Ho Yu, Chun-Jung Tai, Muzaffer Akbay, Zheng Wang, Asaf Nitzan, Gang Dong, Yuting Ye, Lingling Tao, Chengde Wan, and Robert Wang. 2020. MEgATrack: Monochrome Egocentric Articulated Hand-tracking for Virtual Reality. ACM Transactions on Graphics (TOG) 39, 4 (2020).
[3]
Korrawe Karunratanakul, Sergey Prokudin, Otmar Hilliges, and Siyu Tang. 2023. HARP: Personalized Hand Reconstruction from a Monocular RGB Video. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
[4]
Yuki Kubo, Yuto Koguchi, Buntarou Shizuki, Shin Takahashi, and Otmar Hilliges. 2019. AudioTouch: Minimally Invasive Sensing of Micro-Gestures via Active Bio-Acoustic Sensing. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI).
[5]
Aaron Van Den Oord, Oriol Vinyals, and Koray Kavukcuoglu. 2017. Neural Discrete Representation Learning. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS).

Index Terms

  1. Signal2Hand: Sensor Modality Translation from Body-Worn Sensor Signals to Hand-Depth Images

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SA '24: SIGGRAPH Asia 2024 Posters
    December 2024
    260 pages
    ISBN:9798400711381
    DOI:10.1145/3681756
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 December 2024

    Check for updates

    Author Tags

    1. Hand-depth image reconstruction
    2. active bio-acoustic sensing

    Qualifiers

    • Poster

    Conference

    SA '24
    Sponsor:
    SA '24: SIGGRAPH Asia 2024 Posters
    December 3 - 6, 2024
    Tokyo, Japan

    Acceptance Rates

    Overall Acceptance Rate 178 of 869 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 113
      Total Downloads
    • Downloads (Last 12 months)113
    • Downloads (Last 6 weeks)8
    Reflects downloads up to 09 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media