Cited By
View all- Noble FXu MAlam F(2023)Static Hand Gesture Recognition Using Capacitive Sensing and Machine LearningSensors10.3390/s2307341923:7(3419)Online publication date: 24-Mar-2023
PViMat: A Self-Powered Portable and Rollable Large Area Gestural Interface Using Indoor Light
Pages 80 - 83
Abstract
We present PViMat, a portable photovoltaic mat that can recognise six unique useful dynamic hover gestures up to 30 cm above the surface over a large area with more than 97% accuracy. We utilised an off-the-shelf portable and rollable outdoor solar tape and employed it to harvest indoor natural and artificial light energy to trickle charge a LiPo battery for self-powering. We demonstrate a low-power operation technique of continuous charging with DC photocurrent and simultaneous event-driven gesture recognition with AC photocurrent. The PViMat prototype harvests 30 mW in a general livingroom light level of 300 lux and consumes 0.8 mW per gesture. Lastly, we propose applications of PViMat with its large-area, flexible and rollable form-factors and the gesture set.
References
[1]
Thomas Augsten, Konstantin Kaefer, René Meusel, Caroline Fetzer, Dorian Kanitz, Thomas Stoff, Torsten Becker, Christian Holz, and Patrick Baudisch. 2010. Multitoe: High-Precision Interaction with Back-Projected Floors Based on High-Resolution Multi-Touch Input. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). Association for Computing Machinery, New York, NY, USA, 209--218.
[2]
Maximilian Christ, Nils Braun, Julius Neuffer, and Andreas W. Kempa-Liehr. 2018. Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh -- A Python package). Neurocomputing 307 (2018), 72 -- 77.
[3]
Vanessa Cobus, Nikolai Bräuer, Armin Pistoor, Hauke Precht, Abdallah El Ali, and Susanne Boll. 2016. Badum Tss! A DIY Paper-Based Interaction to Augment Everyday Situations with Sound Effects. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). Association for Computing Machinery, New York, NY, USA, Article 94, 6 pages.
[4]
Antonio Gomes, Lahiru Lakmal Priyadarshana, Aaron Visser, Juan Pablo Carrascal, and Roel Vertegaal. 2018. Magicscroll: A Rollable Display Device with Flexible Screen Real Estate and Gestural Input. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). Association for Computing Machinery, New York, NY, USA, Article 6, 11 pages.
[5]
Celeste Groenewald, Craig Anslow, Junayed Islam, Chris Rooney, Peter Passmore, and William Wong. 2016. Understanding 3D Mid-Air Hand Gestures with Interactive Surfaces and Displays: A Systematic Literature Review. In Proceedings of the 30th International BCS Human Computer Interaction Conference: Fusion! (HCI '16). BCS Learning & Development Ltd., Swindon, GBR, Article 43, 13 pages.
[6]
Otmar Hilliges, Shahram Izadi, Andrew D. Wilson, Steve Hodges, Armando Garcia-Mendoza, and Andreas Butz. 2009. Interactions in the Air: Adding Further Depth to Interactive Tabletops. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). Association for Computing Machinery, New York, NY, USA, 139--148.
[7]
Kuk Jin Jang, Jungmin Ryoo, Orkan Telhan, and Rahul Mangharam. 2015. Cloud Mat: Context-aware personalization of fitness content. In 2015 IEEE International Conference on Services Computing. IEEE, 301--308.
[8]
Mohammadreza Khalilbeigi, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2011. Xpaaand: Interaction Techniques for Rollable Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). Association for Computing Machinery, New York, NY, USA, 2729--2732.
[9]
Johnny C. Lee, Scott E. Hudson, and Edward Tse. 2008. Foldable Interactive Displays. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). Association for Computing Machinery, New York, NY, USA, 287--290.
[10]
Sang-Su Lee, Sohyun Kim, Bopil Jin, Eunji Choi, Boa Kim, Xu Jia, Daeeop Kim, and Kun-pyo Lee. 2010. How Users Manipulate Deformable Displays as Input Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 1647--1656.
[11]
Yichen Li, Tianxing Li, Ruchir A. Patel, Xing-Dong Yang, and Xia Zhou. 2018. Self-Powered Gesture Recognition with Ambient Light. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 595--608.
[12]
Dong Ma, Guohao Lan, Mahbub Hassan, Wen Hu, Mush?ka B. Upama, Ashraf Uddin, and Moustafa Youssef. 2019. SolarGest: Ubiquitous and Battery-Free Gesture Recognition Using Solar Cells. In The 25th Annual International Conference on Mobile Computing and Networking (MobiCom '19). Association for Computing Machinery, New York, NY, USA, Article Article 12, 15 pages.
[13]
Y. K. Meena, K Seunarine, D. Sahoo, S. Robinson, J. Pearson, A. Pockett, A. Prescott, S. Thomas, K. Lee, and M. Jones. 2020. PV-Tiles: Towards Closely-Coupled Photovoltaic and Digital Materials for Useful, Beautiful and Sustainable Interactive Surfaces. Proceedings of ACM CHI 2020 (-- 2020), --.
[14]
Jon Moeller and Andruid Kerne. 2012. ZeroTouch: An optical multi-touch and free-air interaction architecture. Conference on Human Factors in Computing Systems Proceedings (05 2012).
[15]
Samudrala Nagaraju. 2013. Novel User Interaction Styles with Flexible/Rollable Screens. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI (CHItaly '13). Association for Computing Machinery, New York, NY, USA, Article 20, 7 pages.
[16]
Joseph Paradiso, K. Hsiao, Joshua Strickon, J. Lifton, and A. Adler. 2000. Sensor systems for interactive surfaces. IBM Systems Journal 39 (02 2000), 892 -- 914.
[17]
Jun Rekimoto. 2002. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). Association for Computing Machinery, New York, NY, USA, 113--120.
[18]
Jun Rekimoto and Nobuyuki Matsushita. 1997. Perceptual surfaces: Towards a human and object sensitive interactive display. In Workshop on Perceptual User Interfaces (PUI'97). 30--32.
[19]
Alireza Shirazi, Yomna Abdelrahman, Niels Henze, Stefan Schneegaß, Mohammadreza Khalilbeigi, and Albrecht Schmidt. 2014. Exploiting thermal reflection for interactive systems. Conference on Human Factors in Computing Systems - Proceedings (04 2014).
[20]
David Small and Hiroshi Ishii. 1997. Design of Spatially Aware Graspable Displays. In CHI '97 Extended Abstracts on Human Factors in Computing Systems (CHI EA '97). Association for Computing Machinery, New York, NY, USA, 367--368.
[21]
Jürgen Steimle and Simon Olberding. 2012. When Mobile Phones Expand into Handheld Tabletops. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). Association for Computing Machinery, New York, NY, USA, 271--280.
[22]
Nicolas Villar, Daniel Cletheroe, Greg Saul, Christian Holz, Tim Regan, Oscar Salandin, Misha Sra, Hui-Shyong Yeo, William Field, and Haiyan Zhang. 2018. Project Zanzibar: A Portable and Flexible Tangible Interaction Platform. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--13.
[23]
Yang Zhang, Chouchang (Jack) Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++: Room-Scale Interactive and Context-Aware Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--15.
Index Terms
- PViMat: A Self-Powered Portable and Rollable Large Area Gestural Interface Using Indoor Light
Recommendations
Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human InteractionThe natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
A real time vision-based hand gestures recognition system
ISICA'10: Proceedings of the 5th international conference on Advances in computation and intelligenceHand gesture recognition is an important aspect in Human-Computer interaction, and can be used in various applications, such as virtual reality and computer games. In this paper, we propose a real time hand gesture recognition system. It includes three ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2020
203 pages
ISBN:9781450375153
DOI:10.1145/3379350
- General Chairs:
- Shamsi Iqbal,
- Karon MacLean,
- Program Chairs:
- Fanny Chevalier,
- Stefanie Mueller
Copyright © 2020 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 October 2020
Check for updates
Author Tags
Qualifiers
- Poster
Funding Sources
Conference
UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology
October 20 - 23, 2020
Virtual Event, USA
Acceptance Rates
Overall Acceptance Rate 561 of 2,567 submissions, 22%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 177Total Downloads
- Downloads (Last 12 months)27
- Downloads (Last 6 weeks)2
Reflects downloads up to 16 Nov 2024
Other Metrics
Citations
Cited By
View all- Noble FXu MAlam F(2023)Static Hand Gesture Recognition Using Capacitive Sensing and Machine LearningSensors10.3390/s2307341923:7(3419)Online publication date: 24-Mar-2023
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in