WiBend: Wi-Fi for Sensing Passive Deformable Surfaces
Pages 339 - 348
Abstract
We present WiBend, a system that recognizes bending gestures as the input modalities for interacting on non-instrumented and deformable surfaces using WiFi signals. WiBend takes advantage of off-the-shelf 802.11 (Wi-Fi) devices and Channel State Information (CSI) measurements of packet transmissions when the user is placed and interacting between a Wi-Fi transmitter and a receiver. We have performed extensive user experiments in an instrumented laboratory to obtain data for training the HMM models and for evaluating the precision of WiBend. During the experiments, participants performed 12 distinct bending gestures with three surface sizes, two bending speeds and two different directions. The performance evaluation results show that WiBend can distinguish between 12 bending gestures with a precision of 84% on average.
References
[1]
Fadel Adib, Zachary Kabelac, Dina Katabi, and Robert C. Miller. 2014. 3D Tracking via Body Radio Reflections. In Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation(NSDI’14). USENIX Association, Berkeley, CA, USA, 317–329. http://dl.acm.org/citation.cfm?id=2616448.2616478
[2]
Sylvain Arlot 2010. A survey of Cross-Validation Procedures for Model Selection. Statistics surveys 4(2010), 40–79.
[3]
Aesculap. Company Bbraun. 2019. OrthoPilot Navigation system. https://www.bbraun.com.
[4]
Victor Cheung, Alexander Keith Eady, and Audrey Girouard. 2018. Deformable Controllers: Fabrication and Design to Promote Novel Hand Gestural Interaction Mechanisms. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 732–735.
[5]
Céline Coutrix and Cédric Masclet. 2015. Shape-change for zoomable tuis: Opportunities and limits of a resizable slider. In Human-Computer Interaction. Springer, 349–366.
[6]
David T Gallant, Andrew G Seniuk, and Roel Vertegaal. 2008. Towards More Paper-like Input: Flexible Input Devices for Foldable Interaction Styles. In Proceedings of the 21st annual ACM symposium on User interface software and technology. ACM, 283–286.
[7]
Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11n Traces with Channel State Information. ACM SIGCOMM CCR 41, 1 (Jan. 2011), 53.
[8]
Felix Heibeck, Basheer Tome, Clark Della Silva, and Hiroshi Ishii. 2015. uniMorph: Fabricating Thin Film Composites for Shape-Changing Interfaces. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology(UIST ’15). ACM, New York, NY, USA, 233–242. https://doi.org/10.1145/2807442.2807472
[9]
Vikram Iyer, Justin Chan, and Shyamnath Gollakota. 2017. 3D Printing Wireless Connected Objects. ACM Trans. Graph. 36, 6, Article 242 (Nov. 2017), 13 pages. https://doi.org/10.1145/3130800.3130822
[10]
Lee Jones, John McClelland, Phonesavanh Thongsouksanoumane, and Audrey Girouard. 2017. Ambient Notifications with Shape Changing Circuits in Peripheral Locations. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces(ISS ’17). ACM, New York, NY, USA, 405–408. https://doi.org/10.1145/3132272.3132291
[11]
Mohammadreza Khalilbeigi, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2011. Xpaaand: Interaction Techniques for Rollable Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2729–2732.
[12]
Kevin SC Kuang, Wesley J Cantwell, and Patricia J Scully. 2002. An Evaluation of a Novel Plastic Optical Fibre Sensor for Axial Strain and Bend Measurements. Measurement Science and Technology 13, 10 (2002), 1523.
[13]
Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: Understanding the Use of Bend Gestures in Mobile Devices with Flexible Electronic Paper Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1303–1312.
[14]
Anamary Leal, Doug Bowman, Laurel Schaefer, Francis Quek, and Clarissa K Stiles. 2011. 3D Sketching using Interactive Fabric for Tangible and Bimanual Input. In Proceedings of Graphics Interface 2011. Canadian Human-Computer Communications Society, 49–56.
[15]
Vincent Liu, Aaron Parks, Vamsi Talla, Shyamnath Gollakota, David Wetherall, and Joshua R. Smith. 2013. Ambient Backscatter: Wireless Communication out of Thin Air. In Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM(SIGCOMM ’13). ACM, New York, NY, USA, 39–50. https://doi.org/10.1145/2486001.2486015
[16]
Jessica Lo and Audrey Girouard. 2014. Fabricating Bendy: Design and Development of Deformable Prototypes. IEEE Pervasive Computing 13, 3 (2014), 40–46.
[17]
Yongsen Ma, Gang Zhou, Shuangquan Wang, Hongyang Zhao, and Woosub Jung. 2018. SignFi: Sign Language Recognition Using WiFi. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 23 (March 2018), 21 pages. https://doi.org/10.1145/3191755
[18]
Mie Nørgaard, Tim Merritt, Majken Kirkegaard Rasmussen, and Marianne Graves Petersen. 2013. Exploring the Design Space of Shape-Changing Objects: Imagined Physics. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces. ACM, 251–260.
[19]
Simon Olberding, Sergio Soto Ortega, Klaus Hildebrandt, and Jürgen Steimle. 2015. Foldio: Digital Fabrication of Interactive and Shape-Changing Objects with Foldable Printed Electronics. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 223–232.
[20]
Michael Ortega, Jérôme Maisonnasse, and Laurence Nigay. 2017. EXHI-bit: a Mechanical Structure for Prototyping EXpandable Handheld Interfaces. In 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2017). 4:1–4:11.
[21]
Natural Point. 2011. Optitrack. Natural Point, Inc.,[Online]. Available: http://optitrack.com.[Accessed 12 06 2018] (2011).
[22]
Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home Gesture Recognition Using Wireless Signals. In Proceedings of the 19th Annual International Conference on Mobile Computing & Networking(MobiCom ’13). ACM, New York, NY, USA, 27–38. https://doi.org/10.1145/2500423.2500436
[23]
Christian Rendl, David Kim, Sean Fanello, Patrick Parzer, Christoph Rhemann, Jonathan Taylor, Martin Zirkl, Gregor Scheipl, Thomas Rothländer, Michael Haller, 2014. FlexSense: A Transparent Self-Sensing Deformable surface. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 129–138.
[24]
Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: Toward High ”Shape Resolution” in Self-actuated Flexible Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). ACM, New York, NY, USA, 593–602. https://doi.org/10.1145/2470654.2470738
[25]
Martin Schmitz, Jürgen Steimle, Jochen Huber, Niloofar Dezfuli, and Max Mühlhäuser. 2017. Flexibles: Deformation-Aware 3D-Printed Tangibles for Capacitive Touchscreens. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1001–1014.
[26]
Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad: Highly Flexible Bending Interactions for Projected Handheld Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). ACM, New York, NY, USA, 237–246. https://doi.org/10.1145/2470654.2470688
[27]
Paul Strohmeier, Jesse Burstyn, Juan Pablo Carrascal, Vincent Levesque, and Roel Vertegaal. 2016. ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input. In Proceedings of the TEI’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 185–192.
[28]
Guanhua Wang, Yongpan Zou, Zimu Zhou, Kaishun Wu, and Lionel M. Ni. 2014. We Can Hear You with Wi-Fi!. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking(MobiCom ’14). ACM, New York, NY, USA, 593–604. https://doi.org/10.1145/2639108.2639112
[29]
Jue Wang, Deepak Vasisht, and Dina Katabi. 2014. RF-IDraw: Virtual Touch Screen in the Air Using RF Signals. In ACM SIGCOMM Computer Communication Review, Vol. 44. ACM, 235–246.
[30]
Wei Wang, Alex X. Liu, and Muhammad Shahzad. 2016. Gait Recognition Using Wifi Signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing(UbiComp ’16). ACM, New York, NY, USA, 363–373. https://doi.org/10.1145/2971648.2971670
[31]
W. Wang, A. X. Liu, M. Shahzad, K. Ling, and S. Lu. 2017. Device-Free Human Activity Recognition Using Commercial WiFi Devices. IEEE Journal on Selected Areas in Communications 35, 5 (May 2017), 1118–1131. https://doi.org/10.1109/JSAC.2017.2679658
[32]
Y. Wang, K. Wu, and L. M. Ni. 2017. WiFall: Device-Free Fall Detection by Wireless Networks. IEEE Transactions on Mobile Computing 16, 2 (Feb. 2017), 581–594. https://doi.org/10.1109/TMC.2016.2557792
[33]
Kristen Warren, Jessica Lo, Vaibhav Vadgama, and Audrey Girouard. 2013. Bending the Rules: Bend Gesture Classification for Flexible Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). ACM, New York, NY, USA, 607–610. https://doi.org/10.1145/2470654.2470740
[34]
Yiyan Wu and William Y Zou. 1995. Orthogonal Frequency Division Multiplexing: A Multi-Carrier Modulation Scheme. IEEE Transactions on Consumer Electronics 41, 3 (1995), 392–399.
[35]
Zi Ye and Hammad Khalid. 2010. Cobra: Flexible Displays for Mobile Gaming Scenarios. In CHI’10 Extended Abstracts on Human Factors in Computing Systems. ACM, 4363–4368.
[36]
Siamak Yousefi, Hirokazu Narui, Sankalp Dayal, Stefano Ermon, and Shahrokh Valaee. 2017. A Survey of Human Activity Recognition Using WiFi CSI. arXiv preprint arXiv:1708.07129(2017).
Recommendations
Nonlocal layerwise theory for bending, buckling and vibration analysis of functionally graded nanobeams
AbstractIn this paper, an efficient method is presented for the bending, buckling, and vibration analysis of functionally graded (FG) nanobeam based on nonlocal elasticity theory and Layerwise theory. The present method takes into account the transverse ...
Towards a Wi-Fi ecosystem: Technology integration and emerging service models
This paper outlines emerging business models of heterogeneous wireless networks that are mainly Wi-Fi centric. Wi-Fi networks can be integrated with the Internet and cellular infrastructures to offer innovative services (data and voice) to individuals ...
PASSIVE WI-FI: Bringing Low Power to Wi-Fi Transmissions
Wi-Fi has traditionally been considered a power-consuming communication system and has not been widely adopted in the sensor network and Internet of Things (IoT) space. We introduce Passive Wi-Fi that demonstrates that one can generate 802.11b ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2019
601 pages
ISBN:9781450368605
DOI:10.1145/3340555
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 14 October 2019
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICMI '19
Acceptance Rates
Overall Acceptance Rate 453 of 1,080 submissions, 42%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 119Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format