Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3081333.3081356acmconferencesArticle/Chapter ViewAbstractPublication PagesmobisysConference Proceedingsconference-collections
research-article

Strata: Fine-Grained Acoustic-based Device-Free Tracking

Published: 16 June 2017 Publication History

Abstract

Next generation devices, such as virtual reality (VR), augmented reality (AR), and smart appliances, demand a simple and intuitive way for users to interact with them. To address such needs, we develop a novel acoustic based device-free tracking system, called Strata, to enable a user to interact with a nearby device by simply moving his finger. In Strata, a mobile (e.g., smartphone) transmits known audio signals at inaudible frequency, and analyzes the received signal reflected by the moving finger to track the finger location. To explicitly take into account multipath propagation, the mobile estimates the channel impulse response (CIR), which characterizes signal traversal paths with different delays. Each channel tap corresponds to the multipath effects within a certain delay range. The mobile selects the channel tap corresponding to the finger movement and extracts the phase change of the selected tap to accurately estimate the distance change of a finger. Moreover, it estimates the absolute distance of the finger based on the change in CIR using a novel optimization framework. We then combine the absolute and relative distance estimates to accurately track the moving target. We implement our tracking system on Samsung Galaxy S4 mobile phone. Through micro-benchmarks and user studies, we show that our system achieves high tracking accuracy and low latency without extra hardware.

References

[1]
Microsoft X-box Kinect. http://xbox.com.
[2]
F. Adib, Z. Kabelac, D. Katabi, and R. Miller. Witrack: Motion tracking via radio reflections off the body. In Proc. of NSDI, 2014.
[3]
F. Adib, H. Mao, Z. Kabelac, D. Katabi, and R. C. Miller. Smart homes that monitor breathing and heart rate. In Proceedings of the CHI Conference on Human Factors in Computing Systems, pages 837--846. ACM, 2015.
[4]
M. T. I. Aumi, S. Gupta, M. Goel, E. Larson, and S. Patel. Doplink: Using the doppler effect for multi-device interaction. In Proc. of ACM UbiComp, pages 583--586, 2013.
[5]
P. Bahl and V. N. Padmanabhan. Radar: An in-building RF-based user location and tracking system. In INFOCOM 2000. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE, volume 2, pages 775--784, 2000.
[6]
Google Cardboard. https://www.microsoft.com/microsoft-hololens/en-us.
[7]
T. Carter, S. A. Seah, B. Long, B. Drinkwater, and S. Subramanian. Ultrahaptics: Multi-point mid-air haptic feedback for touch surfaces. In Proceedings of UIST, 2013.
[8]
Google Daydream. https://vr.google.com/daydream/.
[9]
Edm mix 2017 - best remixes of popular music. https://www.youtube.com/watch?v=IpHXpQ5sWZI&t=1038s.
[10]
Face camera - snappy photo. https://play.google.com/store/apps/details?id=com.fotoable.snapfilters.
[11]
Microsoft HoloLens. https://www.microsoft.com/microsoft-hololens/en-us.
[12]
W. Huang, Y. Xiong, X.-Y. Li, H. Lin, X. Mao, P. Yang, and Y. Liu. Shake and walk: Acoustic direction finding and fine-grained indoor localization using smartphones. In Proc. of IEEE INFOCOM, 2014.
[13]
K. Joshi, D. Bharadia, M. Kotaru, and S. Katti. Wideo: Fine-grained device-free motion tracing using RF backscatter. In Proc. of NSDI, 2015.
[14]
M. Kotaru, K. Joshi, D. Bharadia, and S. Katti. Spotfi: Decimeter level localization using wifi. In ACM SIGCOMM, volume 45, pages 269--282. ACM, 2015.
[15]
P. Lazik and A. Rowe. Indoor pseudo-ranging of mobile devices using ultrasonic chirps. In Proc. of ACM SenSys, pages 99--112, 2012.
[16]
Leap motion. https://www.leapmotion.com/.
[17]
J. Lien, N. Gillian, M. E. Karagozler, P. Amihood, C. Schwesig, E. Olson, H. Raja, and I. Poupyrev. Soli: ubiquitous gesture sensing with millimeter wave radar. In Proc. of SIGGRAPH, 2016.
[18]
W. Mao, J. He, and L. Qiu. Accurate audio tracker. In Proceedings of ACM MobiCom, Oct. 2016.
[19]
A. T. Mariakakis, S. Sen, J. Lee, and K.-H. Kim. Sail: Single access point-based indoor localization. In Proceedings of the 12th annual international conference on Mobile systems, applications, and services, pages 315--328. ACM, 2014.
[20]
R. Nandakumar, S. Gollakota, and N. Watson. Contactless sleep apnea detection on smartphones. In Proc. of ACM MobiSys, 2015.
[21]
R. Nandakumar, V. Iyer, D. Tan, and S. Gollakota. Fingerio: Using active sonar for fine-grained finger tracking. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 1515--1525. ACM, 2016.
[22]
A. V. Oppenheim, R. W. Schafer, J. R. Buck, et al. Discrete-time signal processing, volume 2. Prentice-hall Englewood Cliffs, 1989.
[23]
C. Peng, G. Shen, Y. Zhang, Y. Li, and K. Tan. BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices. In Proc. of ACM SenSys, 2007.
[24]
Q. Pu, S. Gupta, S. Gollakota, and S. Patel. Whole-home gesture recognition using wireless signals. In Proc. of ACM MobiCom, 2013.
[25]
M. Pukkila. Channel estimation modeling. Nokia Research Center, 2000.
[26]
A. Rai, K. K. Chintalapudi, V. N. Padmanabhan, and R. Sen. Zee: zero-effort crowdsourcing for indoor localization. In Proc. of ACM MobiCom, 2012.
[27]
T. S. Rappaport et al. Wireless communications: principles and practice, volume 2. Prentice Hall PTR New Jersey, 1996.
[28]
S. Sen, J. Lee, K.-H. Kim, and P. Congdon. Avoiding multipath to revive inbuilding wifi localization. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services, pages 249--262. ACM, 2013.
[29]
L. Shangguan and K. Jamieson. The design and implementation of a mobile rfid tag sorting robot. In Proceedings of ACM MobiCom, pages 31--42. ACM, 2016.
[30]
K. G. Shin and Y.-C. Tung. Real-time warning for distracted pedestrians with smartphones, Sept. 25 2015. US Patent App. 14/865,262.
[31]
A. Smith, H. Balakrishnan, M. Goraczko, and N. Priyantha. Tracking moving devices with the cricket location system. In Proc. of ACM MobiSys, 2005.
[32]
L. Sun, S. Sen, D. Koutsonikolas, and K. Kim. Widraw: Enabling hands-free drawing in the air on commodity wifi devices. In Proc. of ACM MobiCom, 2015.
[33]
Z. Sun, A. Purohit, R. Bose, and P. Zhang. Spartacus: spatially-aware interaction for mobile devices through energy-efficient audio sensing. In Proc. of ACM Mobisys, pages 263--276, 2013.
[34]
J. Taylor, L. Bordeaux, T. Cashman, B. Corish, C. Keskin, T. Sharp, E. Soto, D. Sweeney, J. Valentin, B. Luff, A. Topalian, E. Wood, S. Khamis, P. Kohli, S. Izadi, R. Banks, A. Fitzgibbon, and J. Shotton. Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. In Proc. of SIGGRAPH, 2016.
[35]
D. Tse and P. Viswanath. Fundamentals of wireless communication. Cambridge university press, 2005.
[36]
D. Vasisht, S. Kumar, and D. Katabi. Decimeter-level localization with a single wifi access point. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16), pages 165--178, 2016.
[37]
Vive. http://www.htcvive.com.
[38]
J. Wang, D. Vasisht, and D. Katabi. RF-IDraw: virtual touch screen in the air using RF signals. In Proc. of ACM SIGCOMM, 2014.
[39]
S. Wang, J. Song, J. Lien, I. Poupyrev, and O. Hilliges. Interacting with soli: Exploring fine-grained dynamic gesture recognition in the radio-frequency spectrum. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST), pages 851--860. ACM, 2016.
[40]
W. Wang, A. X. Liu, and K. Sun. Device-free gesture tracking using acoustic signals. In Proceedings of ACM MobiCom, pages 82--94. ACM, 2016.
[41]
T. Wei and X. Zhang. mTrack: high precision passive tracking using millimeter wave radios. In Proc. of ACM MobiCom, 2015.
[42]
J. Xiong and K. Jamieson. Arraytrack: A fine-grained indoor location system. In Proc. of NSDI, pages 71--84, 2013.
[43]
L. Yang, Y. Chen, X.-Y. Li, C. Xiao, M. Li, and Y. Liu. Tagoram: Real-time tracking of mobile RFID tags to high precision using cots devices. In Proc. of ACM MobiCom, 2014.
[44]
S. Yun, Y. chao Chen, and L. Qiu. Turning a mobile device into a mouse in the air. In Proc. of ACM MobiSys, May 2015.
[45]
Z. Zhang, D. Chu, X. Chen, and T. Moscibroda. Swordfight: Enabling a new class of phone-to-phone action games on commodity phones. In Proc. of ACM MobiSys, 2012.

Cited By

View all
  • (2024)Visar: Projecting Virtual Sound Spots for Acoustic Augmented Reality Using Air NonlinearityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785468:3(1-30)Online publication date: 9-Sep-2024
  • (2024)Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic SignalsACM Transactions on Sensor Networks10.1145/367712220:5(1-32)Online publication date: 26-Aug-2024
  • (2024)Above-Screen Fingertip Tracking and Hand Representation for Precise Touch Input with a Phone in Virtual RealityProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670961(1-15)Online publication date: 3-Jun-2024
  • Show More Cited By

Index Terms

  1. Strata: Fine-Grained Acoustic-based Device-Free Tracking

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MobiSys '17: Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services
    June 2017
    520 pages
    ISBN:9781450349284
    DOI:10.1145/3081333
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 June 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. acoustic tracking
    2. channel impulse response
    3. gesture recognition

    Qualifiers

    • Research-article

    Conference

    MobiSys'17
    Sponsor:

    Acceptance Rates

    MobiSys '17 Paper Acceptance Rate 34 of 188 submissions, 18%;
    Overall Acceptance Rate 274 of 1,679 submissions, 16%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)139
    • Downloads (Last 6 weeks)16
    Reflects downloads up to 22 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Visar: Projecting Virtual Sound Spots for Acoustic Augmented Reality Using Air NonlinearityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785468:3(1-30)Online publication date: 9-Sep-2024
    • (2024)Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic SignalsACM Transactions on Sensor Networks10.1145/367712220:5(1-32)Online publication date: 26-Aug-2024
    • (2024)Above-Screen Fingertip Tracking and Hand Representation for Precise Touch Input with a Phone in Virtual RealityProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670961(1-15)Online publication date: 3-Jun-2024
    • (2024)LiTEfoot: Ultra-low-power Localization using Ambient Cellular SignalsProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699356(535-548)Online publication date: 4-Nov-2024
    • (2024)Acoustic Side-Channel Communications for Aerial Drones with HUMProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699337(267-280)Online publication date: 4-Nov-2024
    • (2024)Sensing to Hear through MemoryProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595988:2(1-31)Online publication date: 15-May-2024
    • (2024)Pushing the Limits of Acoustic Spatial Perception via Incident Angle EncodingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595838:2(1-28)Online publication date: 15-May-2024
    • (2024)FusionTrack: Towards Accurate Device-free Acoustic Motion Tracking with Signal FusionACM Transactions on Sensor Networks10.1145/365466620:3(1-30)Online publication date: 30-Mar-2024
    • (2024)Room-scale Location Trace Tracking via Continuous Acoustic WavesACM Transactions on Sensor Networks10.1145/364913620:3(1-23)Online publication date: 13-Apr-2024
    • (2024)CW-AcousLen: A Configurable Wideband Acoustic MetasurfaceProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661882(29-41)Online publication date: 3-Jun-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media