Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3025453.3025678acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Inferring Motion Direction using Commodity Wi-Fi for Interactive Exergames

Published: 02 May 2017 Publication History

Abstract

In-air interaction acts as a key enabler for ambient intelligence and augmented reality. As an increasing popular example, exergames, and the alike gesture recognition applications, have attracted extensive research in designing accurate, pervasive and low-cost user interfaces. Recent advances in wireless sensing show promise for a ubiquitous gesture-based interaction interface with Wi-Fi. In this work, we extract complete information of motion-induced Doppler shifts with only commodity Wi-Fi. The key insight is to harness antenna diversity to carefully eliminate random phase shifts while retaining relevant Doppler shifts. We further correlate Doppler shifts with motion directions, and propose a light-weight pipeline to detect, segment, and recognize motions without training. On this basis, we present WiDance, a Wi-Fi-based user interface, which we utilize to design and prototype a contactless dance-pad exergame. Experimental results in typical indoor environment demonstrate a superior performance with an accuracy of 92%, remarkably outperforming prior approaches.

Supplementary Material

suppl.mov (pn2148p.mp4)
Supplemental video

References

[1]
Heba Abdelnasser, Moustafa Youssef, and Khaled A. Harras. 2015. Wigest: A ubiquitous wifi-based gesture recognition system. In Proc. of IEEE INFOCOM.
[2]
Fadel Adib, Zachary Kabelac, and Dina Katabi. 2015. Multi-person localization via rf body reflections. In Proc. of USENIX NSDI.
[3]
Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C. Miller. 2014. 3d tracking via body radio reflections. In Proc. of USENIX NSDI.
[4]
Fadel Adib and Dina Katabi. 2013. See through walls with wifi! In Proc. of ACM SIGCOMM.
[5]
Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In Proc. of ACM CHI.
[6]
Kamran Ali, Alex Xiao Liu, Wei Wang, and Muhammad Shahzad. 2015. Keystroke recognition using wifi signals. In Proc. of ACM MobiCom.
[7]
Meng-Chieh Chiu, Shih-Ping Chang, Yu-Chen Chang, Hao-Hua Chu, Cheryl Chia-Hui Chen, Fei-Hsiu Hsiao, and Ju-Chun Ko. 2009. Playful bottle: a mobile social persuasion system to motivate healthy water intake. In Proc. of ACM Ubicomp.
[8]
Stefan Göbel, Sandro Hardy, Viktor Wendel, Florian Mehm, and Ralf Steinmetz. 2010. Serious games for health: personalized exergames. In Proc. of ACM MM.
[9]
Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Predictable 802.11 packet delivery from wireless channel measurements. In Proc. of ACM SIGCOMM.
[10]
Hamilton A. Hernandez, Zi Ye, T. C. Graham, Darcy Fehlings, and Lauren Switzer. 2013. Designing action-based exergames for children with cerebral palsy. In Proc. of ACM CHI.
[11]
Leo Holsti, Tuukka Takala, Aki Martikainen, Raine Kajastila, and Perttu Hämäläinen. 2013. Body-controlled trampoline training games based on computer vision. In Proc. of ACM CHI.
[12]
Kiran Joshi, Dinesh Bharadia, Manikanta Kotaru, and Sachin Katti. 2015. Wideo: Fine-grained device-free motion tracing using rf backscatter. In Proc. of USENIX NSDI.
[13]
Raine Kajastila, Leo Holsti, and Perttu Hämäläinen. 2016. The Augmented Climbing Wall: High-Exertion Proximity Interaction on a Wall-Sized Interactive Surface. In Proc. of ACM CHI.
[14]
Dagmar Kern, Mark Stringer, Geraldine Fitzpatrick, and Albrecht Schmidt. 2006. Curball - A Prototype Tangible Game for Inter-Generational Play. In Proc. of IEEE WETICE.
[15]
Mallory Ketcheson, Luke Walker, and T. C. Graham. 2016. Thighrim and Calf-Life: a study of the conversion of off-the-shelf video games into exergames. In Proc. of ACM CHI.
[16]
Mengyuan Li, Yan Meng, Junyi Liu, Haojin Zhu, Xiaohui Liang, Yao Liu, and Na Ruan. 2016. When CSI Meets Public WiFi: Inferring Your Mobile Phone Password via WiFi Signals. In Proc. ACM SIGSAC CCS.
[17]
Alex T. Mariakakis, Souvik Sen, Jeongkeun Lee, and Kyu-Han Kim. 2014. SAIL: single access point-based indoor localization. In Proc. of ACM MobiSys.
[18]
Pedro Melgarejo, Xinyu Zhang, Parameswaran Ramanathan, and David Chu. 2014. Leveraging directional antenna capabilities for fine-grained gesture recognition. In Proc. of ACM Ubicomp.
[19]
Phuc Nguyen, Xinyu Zhang, Ann Halbower, and Tam Vu. 2016. Continuous and Fine-grained Breathing Volume Monitoring from Afar Using Wireless Signals. In Proc. of IEEE INFOCOM.
[20]
Wei Peng, Jih-Hsuan Lin, and Julia Crouse. 2011. Is playing exergames really exercising? A meta-analysis of energy expenditure in active video games. Cyberpsychology, Behavior, and Social Networking 14, 11 (2011), 681--688.
[21]
John G. Proakis. 1995. Digital communications. McGraw-Hill, New York (1995).
[22]
Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home gesture recognition using wireless signals. In Proc. of ACM MobiCom.
[23]
Raf Ramakers, Fraser Anderson, Tovi Grossman, and George Fitzmaurice. 2016. Retrofab: A design tool for retrofitting physical interfaces using actuators, sensors and 3d printing. In Proc. of ACM CHI.
[24]
Kyle Rector, Cynthia L Bennett, and Julie A Kientz. 2013. Eyes-free yoga: an exergame using depth cameras for blind & low vision exercise. In Proc. of ACM SIGACCESS.
[25]
Longfei Shangguan, Zheng Yang, Alex X Liu, Zimu Zhou, and Yunhao Liu. 2016. STPP: Spatial-Temporal Phase Profiling-Based Method for Relative RFID Tag Localization. IEEE/ACM Transactions on Networking (2016).
[26]
Mike Sheinin and Carl Gutwin. 2014. Exertion in the small: improving differentiation and expressiveness in sports games with physical controls. In Proc. of ACM CHI.
[27]
Amanda E Staiano and Sandra L Calvert. 2011. Exergames for physical education courses: Physical, social, and cognitive benefits. Child development perspectives 5, 2 (2011), 93--98.
[28]
Sheng Tan and Jie Yang. 2016. WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition. In Proc. of ACM MobiHoc.
[29]
Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human Respiration Detection with Commodity WiFi Devices: Do User Location and Body Orientation Matter? In Proc. of ACM Ubicomp.
[30]
Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and modeling of wifi signal based human activity recognition. In Proc. of ACM MobiCom.
[31]
Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: device-free location-oriented activity identification using fine-grained wifi signatures. In Proc. of ACM MobiCom.
[32]
Teng Wei and Xinyu Zhang. 2015. mtrack: High-precision passive tracking using millimeter wave radios. In Proc. of ACM MobiCom.
[33]
Chenshu Wu, Zheng Yang, Zimu Zhou, Xuefeng Liu, Yunhao Liu, and Jiannong Cao. 2015. Non-invasive detection of moving and stationary human with wifi. IEEE Journal on Selected Areas in Communications (2015).
[34]
Dan Wu, Daqing Zhang, Chenren Xu, Yasha Wang, and Hao Wang. 2016. WiDir: Walking Direction Estimation Using Wireless Signals. In Proc. of ACM Ubicomp.

Cited By

View all
  • (2024)GrainSense: A Wireless Grain Moisture Sensing System Based on Wi-Fi SignalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785898:3(1-25)Online publication date: 9-Sep-2024
  • (2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
  • (2024)WiVelo: Fine-grained Wi-Fi Walking Velocity EstimationACM Transactions on Sensor Networks10.1145/366419620:4(1-21)Online publication date: 8-Jul-2024
  • Show More Cited By

Index Terms

  1. Inferring Motion Direction using Commodity Wi-Fi for Interactive Exergames

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
      May 2017
      7138 pages
      ISBN:9781450346559
      DOI:10.1145/3025453
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 02 May 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Honorable Mention

      Author Tags

      1. exergame
      2. motion direction recognition
      3. off-the-shelf wi-fi
      4. wireless sensing

      Qualifiers

      • Research-article

      Funding Sources

      • National Key Research Plan
      • NSFC

      Conference

      CHI '17
      Sponsor:

      Acceptance Rates

      CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)165
      • Downloads (Last 6 weeks)14
      Reflects downloads up to 30 Sep 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)GrainSense: A Wireless Grain Moisture Sensing System Based on Wi-Fi SignalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785898:3(1-25)Online publication date: 9-Sep-2024
      • (2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
      • (2024)WiVelo: Fine-grained Wi-Fi Walking Velocity EstimationACM Transactions on Sensor Networks10.1145/366419620:4(1-21)Online publication date: 8-Jul-2024
      • (2024)WiFi-CSI Difference ParadigmProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596088:2(1-29)Online publication date: 15-May-2024
      • (2024)Pushing the Limits of WiFi Sensing With Low Transmission RatesIEEE Transactions on Mobile Computing10.1109/TMC.2024.337404623:11(10265-10279)Online publication date: Nov-2024
      • (2024)A Location-independent Human Activity Recognition Method Based on CSI: System, Architecture, ImplementationIEEE Transactions on Mobile Computing10.1109/TMC.2023.3296987(1-14)Online publication date: 2024
      • (2024)A Handwriting Recognition System With WiFiIEEE Transactions on Mobile Computing10.1109/TMC.2023.327960823:4(3391-3409)Online publication date: Apr-2024
      • (2024)Wi-Rotate: An Instantaneous Angular Speed Measurement System Using WiFi SignalsIEEE Transactions on Mobile Computing10.1109/TMC.2022.322363323:1(985-1000)Online publication date: Jan-2024
      • (2024)Dr. Defender: Proactive Detection of Autopilot Drones Based on CSIIEEE Transactions on Information Forensics and Security10.1109/TIFS.2023.331196419(194-206)Online publication date: 2024
      • (2024)In-Band Full-Duplex: The Physical LayerProceedings of the IEEE10.1109/JPROC.2024.3366768112:5(433-462)Online publication date: May-2024
      • Show More Cited By

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media