Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article
Open access

MiniKers: Interaction-Powered Smart Environment Automation

Published: 07 September 2022 Publication History

Abstract

Automating operations of objects has made life easier and more convenient for billions of people, especially those with limited motor capabilities. On the other hand, even able-bodied users might not always be able to perform manual operations (e.g., both hands are occupied), and manual operations might be undesirable for hygiene purposes (e.g., contactless devices). As a result, automation systems like motion-triggered doors, remote-control window shades, contactless toilet lids have become increasingly popular in private and public environments. Yet, these systems are hampered by complex building wiring or short battery lifetimes, negating their positive benefits for accessibility, energy saving, healthcare, and other domains. In this paper we explore how these types of objects can be powered in perpetuity by the energy generated from a unique energy source - user interactions, specifically, the manual manipulations of objects by users who can afford them when they can afford them. Our assumption is that users' capabilities for object operations are heterogeneous, there are desires for both manual and automatic operations in most environments, and that automatic operations are often not needed as frequently - for example, an automatic door in a public space is often manually opened many times before a need for automatic operation shows up. The energy harvested by those manual operations would be sufficient to power that one automatic operation. We instantiate this idea by upcycling common everyday objects with devices which have various mechanical designs powered by a general-purpose backbone embedded system. We call these devices, MiniKers. We built a custom driver circuit that can enable motor mechanisms to toggle between generating powers (i.e., manual operation) and actuating objects (i.e., automatic operation). We designed a wide variety of mechanical mechanisms to retrofit existing objects and evaluated our system with a 48-hour deployment study, which proves the efficacy of MiniKers as well as shedding light into this people-as-power approach as a feasible solution to address energy needed for smart environment automation.

References

[1]
Abul Al Arabi, Jiahao Li, Xiang'Anthony Chen, and Jeeeun Kim. 2022. Mobiot: Augmenting Everyday Objects into Moving IoT Devices Using 3D Printed Attachments Generated by Demonstration. In CHI Conference on Human Factors in Computing Systems. 1--14.
[2]
Nivedita Arora and Gregory D Abowd. 2018. ZEUSSS: Zero energy ubiquitous sound sensing surface leveraging triboelectric nanogenerator and analog backscatter communication. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings. 81--83.
[3]
Nivedita Arora, Ali Mirzazadeh, Injoo Moon, Charles Ramey, Yuhui Zhao, Daniela C Rodriguez, Gregory D Abowd, and Thad Starner. 2021. MARS: Nano-Power Battery-free Wireless Interfaces for Touch, Swipe and Speech Input. In The 34th Annual ACM Symposium on User Interface Software and Technology. 1305--1325.
[4]
Nivedita Arora, Steven L Zhang, Fereshteh Shahmiri, Diego Osorio, Yi-Cheng Wang, Mohit Gupta, Zhengjun Wang, Thad Starner, Zhong Lin Wang, and Gregory D Abowd. 2018. SATURN: A thin and flexible self-powered microphone leveraging triboelectric nanogenerator. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1--28.
[5]
ZED Automation. 2022. Automatic Door. http://www.zedautomation.com/ Last accessed 12 May 2022.
[6]
Aude Billard, Sylvain Calinon, Ruediger Dillmann, and Stefan Schaal. 2008. Robot programming by demonstration. Springer handbook of robotics (2008), 1371--1394.
[7]
Mayara Bonani, Raquel Oliveira, Filipa Correia, André Rodrigues, Tiago Guerreiro, and Ana Paiva. 2018. What my eyes can't see, A robot can show me: Exploring the collaboration between blind people and robots. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. 15--27.
[8]
Bradford Campbell and Prabal Dutta. 2014. An energy-harvesting sensor architecture and toolkit for building monitoring and event detection. In Proceedings of the 1st ACM Conference on Embedded Systems for Energy-Efficient Buildings. 100--109.
[9]
Tim Campbell, Eric Larson, Gabe Cohn, Jon Froehlich, Ramses Alcaide, and Shwetak N Patel. 2010. WATTR: A method for self-powered wireless sensing of water activity in the home. In Proceedings of the 12th ACM international conference on Ubiquitous computing. 169--172.
[10]
Hyungjun Cho, Han-Jong Kim, JiYeon Lee, Chang-Min Kim, Jinseong Bae, and Tek-Jin Nam. 2021. IoTIZER: A Versatile Mechanical Hijacking Device for Creating Internet of Old Things. In Designing Interactive Systems Conference 2021. 90--103.
[11]
Peter Constantinou and Saibal Roy. 2016. A 3D printed electromagnetic nonlinear vibration energy harvester. Smart Materials and Structures 25, 9 (2016), 095053.
[12]
Alexander Curtiss, Blaine Rothrock, Abu Bakar, Nivedita Arora, Jason Huang, Zachary Englhardt, Aaron-Patrick Empedrado, Chixiang Wang, Saad Ahmed, Yang Zhang, et al. 2021. FaceBit: Smart Face Masks Platform. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 4 (2021), 1--44.
[13]
World Energy Data. 2022. World Final Energy. https://www.worldenergydata.org/world-final-energy/ Last accessed 23 July 2022.
[14]
Scott Davidoff, Nicolas Villar, Alex S Taylor, and Shahram Izadi. 2011. Mechanical hijacking: how robots can accelerate UbiComp deployments. In Proceedings of the 13th international conference on Ubiquitous computing. ACM, 267--270.
[15]
Jasper De Winkel, Vito Kortbeek, Josiah Hester, and Przemysław Pawełczak. 2020. Battery-free game boy. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1--34.
[16]
Samuel DeBruin, Bradford Campbell, and Prabal Dutta. 2013. Monjolo: An energy-harvesting energy meter architecture. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems. 1--14.
[17]
Automatic door closer. 2022. https://www.amazon.com/Automatic-Door-Closer/s?k=Automatic+Door+Closer Last accessed 20 July 2022.
[18]
Markus Ehrenmann, Oliver Rogalla, Raoul Zöllner, and Rüdiger Dillmann. 2001. Teaching service robots complex tasks: Programming by demonstration for workshop and household environments. In Proceedings of the 2001 International Conference on Field and Service Robots (FSR), Vol. 1. 397--402.
[19]
David Fischinger, Peter Einramhof, Konstantinos Papoutsakis, Walter Wohlkinger, Peter Mayer, Paul Panek, Stefan Hofmann, Tobias Koertner, Astrid Weiss, Antonis Argyros, et al. 2016. Hobbit, a care robot supporting independent living at home: First prototype and lessons learned. Robotics and Autonomous Systems 75 (2016), 60--78.
[20]
Tobias Grosse-Puppendahl, Steve Hodges, Nicholas Chen, John Helmes, Stuart Taylor, James Scott, Josh Fromm, and David Sweeney. 2016. Exploring the design space for energy-harvesting situated displays. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 41--48.
[21]
Josiah Hester and Jacob Sorber. 2017. The future of sensing is batteryless, intermittent, and awesome. In Proceedings of the 15th ACM conference on embedded network sensor systems. 1--6.
[22]
Guy Hoffman and Wendy Ju. 2014. Designing Robots With Movement in Mind. Journal of Human-Robot Interaction (2014). https://doi.org/10.5898/jhri.3.1.hoffman
[23]
HC SMART HOME. 2022. HC SMART HOME. https://hcsmarthome.com/ Last accessed 12 May 2022.
[24]
Smart home solutions. 2022. https://smarthomesolutionsinc.com/solutions/smart-home-automation Last accessed 20 July 2022.
[25]
Solar Lighting International. 2022. LED Solar Powered Street Lighting. https://www.solarlightingitl.com/solar-street-lighting/ Last accessed 14 May 2022.
[26]
JGendron. 2017. RobotShop Announces Canada and Europe Distribution Exclusivity with Solar Pool Technologies. https://www.robotshop.com/community/blog/show/robotshop-announces-canada-and-europe-distribution-exclusivity-with-solar-pool-technologies Last accessed 24 April 2022.
[27]
Mustafa Emre Karagozler, Ivan Poupyrev, Gary K Fedder, and Yuri Suzuki. 2013. Paper generators: harvesting energy from touching, rubbing and sliding. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 23--30.
[28]
Kasa. 2022. Smart Wi-Fi Light Switch, Dimmer. https://www.kasasmart.com/us/products/smart-switches
[29]
Bartosz Kawa, Krzysztof Śliwa, Vincent Ch Lee, Qiongfeng Shi, and Rafał Walczak. 2020. Inkjet 3D printed MEMS vibrational electromagnetic energy harvester. Energies 13, 11 (2020), 2800.
[30]
Tarik Keleştemur, Naoki Yokoyama, Joanne Truong, Anas Abou Allaban, and Taşkin Padir. 2019. System architecture for autonomous mobile manipulation of everyday objects in domestic environments. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 264--269.
[31]
KeyiRobot. 2022. Coding Fun Robot for Steam Learning. https://keyirobot.com/ Last accessed 12 May 2022.
[32]
Ioannis Kostavelis, Dimitrios Giakoumis, Georgia Peleka, Andreas Kargakos, Evangelos Skartados, Manolis Vasileiadis, and Dimitrios Tzovaras. 2018. RAMCIP robot: A personal robotic assistant; demonstration of a complete framework. In Proceedings of the European conference on computer vision (ECCV) workshops. 0--0.
[33]
Ecube labs. 2022. CleanCUBE, the solar-powered trash compactor. https://www.ecubelabs.com/solar-powered-trash-compactor/ Last accessed 14 May 2022.
[34]
Jiahao Li, Meilin Cui, Jeeeun Kim, and Xiang'Anthony' Chen. 2020. Romeo: A Design Tool for Embedding Transformable Parts in 3D Models to Robotically Augment Default Functionalities. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 897--911.
[35]
Jiahao Li, Jeeeun Kim, and Xiang'Anthony' Chen. 2019. Robiot: A design tool for actuating everyday objects with automatically generated 3D printable mechanisms. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 673--685.
[36]
Jiahao Li, Alexis Samoylov, Jeeeun Kim, and Xiang'Anthony' Chen. 2022. Roman: Making Everyday Objects Robotically Manipulable with 3D-Printable Add-on Mechanisms. In CHI Conference on Human Factors in Computing Systems. 1--17.
[37]
Yichen Li, Tianxing Li, Ruchir A Patel, Xing-Dong Yang, and Xia Zhou. 2018. Self-powered gesture recognition with ambient light. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 595--608.
[38]
Zhong Lin Wang. 2014. Triboelectric nanogenerators as new energy technology and self-powered sensors-Principles, problems and perspectives. Faraday discussions 176 (2014), 447--458.
[39]
LogiTech. 2021. K750 Wireless Solar Powered Keyboard. https://www.logitech.com/en-us/products/keyboards/k750-wireless-solar.920-002912.html Last accessed 24 April 2022.
[40]
Gabriel Marcano and Pat Pannuto. 2022. Soil Power? Can Microbial Fuel Cells Power Non-Trivial Sensors. In Proceedings of the 1st ACM Workshop on No Power and Low Power Internet-of-Things (New Orleans, LA, USA)(LP-IoT'21). 8--13.
[41]
Cable Matters. 2022. Self Powered Wireless Doorbell Kit. https://www.walmart.com/ip/Self-Powered-Wireless-Doorbell-Kit-in-White/677869871
[42]
Andrew Meehan, Hongwei Gao, and Zbigniew Lewandowski. 2010. Energy harvesting with microbial fuel cell and power management system. IEEE Transactions on power electronics 26, 1 (2010), 176--181.
[43]
Microbot. 2022. MicroBot Push. https://microbot.is/collections/best-selling-products/products/microbot-push Last accessed 12 May 2022.
[44]
101 Mobility. 2022. Automatic Door Openers. https://www.101mobility.com/products/automatic-door-openers/ Last accessed 12 May 2022.
[45]
Nordic. 2022. nRF52832 Product Specification. https://infocenter.nordicsemi.com/pdf/nRF52832_PS_v1.4.pdf Last accessed 12 May 2022.
[46]
Michaël Peigney and Dominique Siegert. 2013. Piezoelectric energy harvesting from traffic-induced bridge vibrations. Smart Materials and Structures 22, 9 (2013), 095019.
[47]
Philips. 2022. Light hub. https://www.philips-hue.com/en-us Last accessed 20 July 2022.
[48]
Kyle Pietrzyk, Joseph Soares, Brandon Ohara, and Hohyun Lee. 2016. Power generation modeling for a wearable thermoelectric energy harvester with practical limitations. Applied energy 183 (2016), 218--228.
[49]
Samuel Poirier, François Routhier, and Alexandre Campeau-Lecours. 2019. Voice control interface prototype for assistive robots for people living with upper limb disabilities. In 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR). IEEE, 46--52.
[50]
My Q. 2022. Smart Locks. https://www.myq.com/smart-lock/ Last accessed 12 May 2022.
[51]
Raf Ramakers, Fraser Anderson, Tovi Grossman, and George Fitzmaurice. 2016. Retrofab: A design tool for retrofitting physical interfaces using actuators, sensors and 3d printing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 409--419.
[52]
Michaela R Reisinger, Sebastian Prost, Johann Schrammel, and Peter Fröhlich. 2022. User requirements for the design of smart homes: dimensions and goals. Journal of Ambient Intelligence and Humanized Computing (2022), 1--20.
[53]
Kimiko Ryokai, Peiqi Su, Eungchan Kim, and Bob Rollins. 2014. Energybugs: Energy harvesting wearables for children. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1039--1048.
[54]
Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. 2012. Midas: fabricating custom capacitive touch sensors to prototype interactive objects. In Proceedings of the 25th annual ACM symposium on User interface software and technology. 579--588.
[55]
Johny's Selected Seeds. 2022. Green House Auto Ven Opener. https://www.johnnyseeds.com/tools-supplies/greenhouse-and-tunnel-supplies/vents-and-vent-openers/ Last accessed 12 May 2022.
[56]
Senic. 2022. Battery free and wireless switches. https://www.senic.com/products/pro-switch
[57]
Pavle Skocir, Petar Krivic, Matea Tomeljak, Mario Kusek, and Gordan Jezic. 2016. Activity detection in smart home environment. Procedia Computer Science 96 (2016), 672--681.
[58]
Somfy. 2022. Somfy: Motorization solutions for a smarter home inside out. https://www.somfysystems.com/en-us/ Last accessed 12 May 2022.
[59]
Thad Starner and Joseph A Paradiso. 2004. Human generated power for mobile electronics. Low-power electronics design 45 (2004), 1--35.
[60]
Frolic Studio. 2022. Smartians. https://www.frolicstudio.com/portfolio/smartians Last accessed 12 May 2022.
[61]
Switchbot. 2022. SwitchBot Curtain. https://www.switch-bot.com/ Last accessed 24 April 2022.
[62]
Tesla. 2022. Electric Cars, Solar & Clean Energy | Tesla. https://www.tesla.com/ Last accessed 14 May 2022.
[63]
Nicolas Villar and Steve Hodges. 2010. The Peppermill: A human-powered user interface device. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. 29--32.
[64]
Aggeliki Vlachostergiou, Georgios Stratogiannis, George Caridakis, George Siolas, and Phivos Mylonas. 2016. User adaptive and context-aware smart home using pervasive and semantic technologies. Journal of Electrical and Computer Engineering 2016 (2016).
[65]
Anandghan Waghmare, Qiuyue Xue, Dingtian Zhang, Yuhui Zhao, Shivan Mittal, Nivedita Arora, Ceara Byrne, Thad Starner, and Gregory D Abowd. 2020. UbiquiTouch: Self sustaining ubiquitous touch interfaces. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1--22.
[66]
Hao Wang, Abbas Jasim, and Xiaodan Chen. 2018. Energy harvesting technologies in roadway and bridge for different applications-A comprehensive review. Applied energy 212 (2018), 1083--1094.
[67]
Weitian Wang, Rui Li, Yi Chen, Z. Max Diekel, and Yunyi Jia. 2018. Facilitating Human-Robot Collaborative Tasks by Teaching-Learning-Collaboration From Human Demonstrations. 14 pages. https://doi.org/10.1109/TASE.2018.2840345
[68]
Zhiyi Wu, Jianhong Tang, Xin Zhang, and Zhicheng Yu. 2017. An energy harvesting bracelet. Applied Physics Letters 111,1 (2017), 013903.
[69]
Robert Xiao, Gierad Laput, and Chris Harrison. 2014. Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 193--196.
[70]
Xiaodong Yang and Yingli Tian. 2010. Robust door detection in unfamiliar environments by combining edge and corner features. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, 57--64.
[71]
Zuozong Yin, Shiqiao Gao, Lei Jin, Shengkai Guo, Qinghe Wu, and Zezhang Li. 2021. A shoe-mounted frequency up-converted piezoelectric energy harvester. Sensors and Actuators A: Physical 318 (2021), 112530.
[72]
Dingtian Zhang, Jung Wook Park, Yang Zhang, Yuhui Zhao, Yiyang Wang, Yunzhi Li, Tanvi Bhagwat, Wen-Fang Chou, Xiaojia Jia, Bernard Kippelen, et al. 2020. OptoSense: Towards ubiquitous self-powered ambient light sensing surfaces. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1--27.
[73]
Yang Zhang, Yasha Iravantchi, Haojian Jin, Swarun Kumar, and Chris Harrison. 2019. Sozu: Self-powered radio tags for building-scale activity sensing. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 973--985.
[74]
Chen Zhao, Sam Yisrael, Joshua R Smith, and Shwetak N Patel. 2014. Powering wireless sensor nodes with ambient temperature changes. In Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing. 383--387.

Cited By

View all
  • (2024)NeuroCamTags: Long-Range, Battery-free, Wireless Sensing with Neuromorphic CamerasProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785298:3(1-25)Online publication date: 9-Sep-2024
  • (2024)Push the Limit of Highly Accurate Ranging on Commercial UWB DevicesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596028:2(1-27)Online publication date: 15-May-2024
  • (2024)UTrack3D: 3D Tracking Using Ultra-wideband (UWB) RadiosProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661881(345-358)Online publication date: 3-Jun-2024
  • Show More Cited By

Index Terms

  1. MiniKers: Interaction-Powered Smart Environment Automation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 6, Issue 3
    September 2022
    1612 pages
    EISSN:2474-9567
    DOI:10.1145/3563014
    Issue’s Table of Contents
    This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 September 2022
    Published in IMWUT Volume 6, Issue 3

    Check for updates

    Author Tags

    1. Automation
    2. Energy harvesting
    3. Interaction-powered
    4. People-as-power
    5. Self-sustaining computing
    6. Smart environments

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)426
    • Downloads (Last 6 weeks)49
    Reflects downloads up to 18 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)NeuroCamTags: Long-Range, Battery-free, Wireless Sensing with Neuromorphic CamerasProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785298:3(1-25)Online publication date: 9-Sep-2024
    • (2024)Push the Limit of Highly Accurate Ranging on Commercial UWB DevicesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596028:2(1-27)Online publication date: 15-May-2024
    • (2024)UTrack3D: 3D Tracking Using Ultra-wideband (UWB) RadiosProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661881(345-358)Online publication date: 3-Jun-2024
    • (2024)Interaction-Power Stations: Turning Environments into Ubiquitous Power Stations for Charging WearablesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650769(1-8)Online publication date: 11-May-2024
    • (2023)XRLoc: Accurate UWB Localization to Realize XR DeploymentsProceedings of the 21st ACM Conference on Embedded Networked Sensor Systems10.1145/3625687.3625810(459-473)Online publication date: 12-Nov-2023
    • (2023)E3DProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108977:3(1-31)Online publication date: 27-Sep-2023
    • (2023)CubeSense++: Smart Environment Sensing with Interaction-Powered Corner Reflector MechanismsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606744(1-12)Online publication date: 29-Oct-2023
    • (2022)Augmenting Everyday Objects into Personal Robotic DevicesSIGGRAPH Asia 2022 Emerging Technologies10.1145/3550471.3564763(1-2)Online publication date: 6-Dec-2022

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media