poster

Poster: Sonicnect: Accurate Hands-Free Gesture Input System with Smart Acoustic Sensing

Authors:

Maotian Zhang,

Ping Li,

Panlong Yang,

Jie Xiong,

Chang TianAuthors Info & Claims

MobiSys '16 Companion: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services Companion

Page 91

https://doi.org/10.1145/2938559.2948830

Published: 25 June 2016 Publication History

Get Access

Abstract

This work presents Sonicnect, an acoustic sensing system with smartphone that enables accurate hands-free gesture input. Sonicnect leverages the embedded microphone in the smartphone to capture the subtle audio signals generated with fingers touching on the table. It supports 9 commonly used gestures (click, flip, scroll and zoom, etc) with above 92% recognition accuracy, and the minimum gesture movement could be 2cm. Distinguishable features are then extracted by exploiting spatio-temporal and frequency properties of the subtle audio signals. We conduct extensive real environment experiments to evaluate its performance. The results validate the effectiveness and robustness of Sonicnect.

Cited By

View all

Zhang QZhang JLiu XTong XLi K(2022)Secure RFID Handwriting Recognition–Attacker Can Hear but Cannot UnderstandWireless Algorithms, Systems, and Applications10.1007/978-3-031-19208-1_34(413-426)Online publication date: 17-Nov-2022
https://doi.org/10.1007/978-3-031-19208-1_34
Wei ZYang SXie YLi FZhao B(2021)SVSVInformation Sciences: an International Journal10.1016/j.ins.2021.04.099572:C(109-125)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1016/j.ins.2021.04.099
Luo GYang PChen MLi P(2020)HCI on the Table: Robust Gesture Recognition Using Acoustic Sensing in Your HandIEEE Access10.1109/ACCESS.2020.29733058(31481-31498)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2973305
Show More Cited By

Index Terms

Poster: Sonicnect: Accurate Hands-Free Gesture Input System with Smart Acoustic Sensing
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input

Recommendations

EyeGesener: Eye Gesture Listener for Smart Glasses Interaction Using Acoustic Sensing

The smart glasses market has witnessed significant growth in recent years. The interaction of commercial smart glasses mostly relies on the hand, which is unsuitable for scenarios where both hands are occupied. In this paper, we propose EyeGesener, an ...
Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality
IUI '23: Proceedings of the 28th International Conference on Intelligent User Interfaces

Mid-air text input in augmented or virtual reality (AR/VR) is an open problem. One proposed solution is gesture typing where the user performs a gesture trace over the keyboard. However, this requires the user to move their hands precisely and ...
FingerPing: Recognizing Fine-grained Hand Poses using Active Acoustic On-body Sensing
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

FingerPing is a novel sensing technique that can recognize various fine-grained hand poses by analyzing acoustic resonance features. A surface-transducer mounted on a thumb ring injects acoustic chirps (20Hz to 6,000Hz) to the body. Four receivers ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MobiSys '16 Companion: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services Companion

June 2016

172 pages

ISBN:9781450344166

DOI:10.1145/2938559

General Chairs:
Rajesh Balan
Singapore Management University
,
Archan Misra
Singapore Management University
,
Program Chairs:
Landon Cox
Duke University
,
Yutaka Arakawa
NAIST
,
Xia Zhou
Dartmouth College
,
Robert LiKamWa
Rice University

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2016

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

NSFC

Conference

MobiSys'16

Sponsor:

SIGMOBILE

MobiSys'16: The 14th Annual International Conference on Mobile Systems, Applications, and Services

June 25 - 30, 2016

Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 274 of 1,679 submissions, 16%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
162
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhang QZhang JLiu XTong XLi K(2022)Secure RFID Handwriting Recognition–Attacker Can Hear but Cannot UnderstandWireless Algorithms, Systems, and Applications10.1007/978-3-031-19208-1_34(413-426)Online publication date: 17-Nov-2022
https://doi.org/10.1007/978-3-031-19208-1_34
Wei ZYang SXie YLi FZhao B(2021)SVSVInformation Sciences: an International Journal10.1016/j.ins.2021.04.099572:C(109-125)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1016/j.ins.2021.04.099
Luo GYang PChen MLi P(2020)HCI on the Table: Robust Gesture Recognition Using Acoustic Sensing in Your HandIEEE Access10.1109/ACCESS.2020.29733058(31481-31498)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2973305
Elouali N(2019)Time Well Spent with multimodal mobile interactionsJournal on Multimodal User Interfaces10.1007/s12193-019-00310-1Online publication date: 22-Jul-2019
https://doi.org/10.1007/s12193-019-00310-1
Chen JLi FChen HYang SWang Y(2019)Dynamic gesture recognition using wireless signals with less disturbancePersonal and Ubiquitous Computing10.1007/s00779-018-1182-x23:1(17-27)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1007/s00779-018-1182-x
Cao SHe XZhu PChen MLi XYang P(2018)iPand: Accurate Gesture Input with Ambient Acoustic Sensing on Hand2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC)10.1109/PCCC.2018.8710858(1-8)Online publication date: Nov-2018
https://doi.org/10.1109/PCCC.2018.8710858
Cao ZZhang HLiu B(2018)Performance and Stability of Application Placement in Mobile Edge Computing System2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC)10.1109/PCCC.2018.8710802(1-8)Online publication date: Nov-2018
https://doi.org/10.1109/PCCC.2018.8710802
Du HLi PZhou HGong WLuo GYang P(2018)WordRecorder: Accurate Acoustic-based Handwriting Recognition Using Deep LearningIEEE INFOCOM 2018 - IEEE Conference on Computer Communications10.1109/INFOCOM.2018.8486285(1448-1456)Online publication date: Apr-2018
https://doi.org/10.1109/INFOCOM.2018.8486285

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

EyeGesener: Eye Gesture Listener for Smart Glasses Interaction Using Acoustic Sensing

Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality

FingerPing: Recognizing Fine-grained Hand Poses using Active Acoustic On-body Sensing